Research And Application Of 3D Medical Image Visual Interaction Method

Medical image visualization technology plays an important role in clinical medical applications.Constrained by the traditional mouse,keyboard and touch screen interaction technologies can not be "interactive,dialogue" in a more "natural" way.The rapid development of three-dimensional visualization technology which based on graphics technology puts higher requirements on computer human-computer interaction technology.In recent years,The application of virtual reality and somatosensory technology to medical image interactions,thereby achieving “dialogue and interaction” in a more “natural” manner has attracted widespread attention with the rapid development of somatosensory and virtual reality-related technologies.We summarize the existing interactive methods of 3D medical visualization images and the development status at home and abroad.The Leap Motion somatosensory interaction technology and HTC VIVE virtual reality interaction technology are discussed in the 3D medical visualization image interaction method and application,and the specific implementation principles and methods are given.The specific work and results are as follows:1.Our methods are based on the Leap Motion Somatosensory Controller and proposes a three-dimensional visual interaction method which based on double Leap Motion.We propose to set up double Leap Motion in different directions and solve the single Leap Motion finger occlusion problem by analyzing two Leap Motion detected gesture data in real time.In order to obtain the optimal setting angle of the double Leap Motion,we set the double Leap Motion to 45°,90°,135° and 180° angles,respectively.Experiments with a large number of image rotation operations by the experimenter resulted in a double Leap Motion setting angle of 90°.The phenomenon of the occurrence of the lower finger occluding phenomenon is the least,and the best effect is to solve the occluding problem of the finger.2.Based on the HTC VIVE virtual reality technology,the OpenVR virtual reality API library is integrated into the SCIVIS scientific visualization platform.The system integrates several modules,such as data loading,data processing,data visualization,and virtual reality interaction modules,to realize a natural and immersive interaction method for 3D medical visualization in the virtual reality environment.Then it explored the application technology and interactive methods of virtual reality technology in the field of scientific visualization-related technologies,as well as the future of virtual reality technology.3.For the two interactive system design methods,a scientific user research experiment method was proposed respectively.The scientific,practical and forward-looking design of the interactive system was verified.