Design And Implementation Of Liver 3D Visualization System Based On Kinect

Medical image 3D reconstruction technology is refers to the CT digital medical imaging equipment to obtain the sequence of 2D slice images into a realistic 3D model.It's one of the research hotspots in the field of image processing.The liver is one of the major organs vulnerable to malignant tumors both primary and metastatic.With the help of Medical image 3D reconstruction,Doctors could obtain disease information such as position and shape from the medical images.The diagnosis and surgical navigation of auxiliary doctors are of great significance and value.There are commonly two kinds of methods for 3D reconstruction:surface rendering and volume rendering.Surface rendering is very fast,but it can only get the surface shape of the original object,not the internal information of the organs.Volume rendering method can well show the inside of the viscera information,has the high image quality,the medical image 3D reconstruction results displayed in real time.Doctors can control the cutting plane to the tensile,scaling,translation and rotation operation of 3D model cutting,in order to observe the internal structure of the organ and the accurate grasp the operation process has an important guiding significance.However,doctors in the surgery process is often required in the sterile environment,the doctor can not directly contact the mouse or touch the display with hand.And with the help of Kinect,this system can capture hand's information and depth image,tracking 20 human skeleton joints.To obtain a doctor's gesture to control the three-dimensional model of the viscera without contact,so that the doctor and the computer model in the absence of contact with the conditions of the contact.Kinect is a equipment released by Microsoft which can capture RGB color image and depth image.And it also can predict 20 human skeleton joints from a single depth image.And it's the ideal equipment for gesture recognition research based on computer vision.The experimental results show that the Kinect can collect the operator gesture,movement,sound and so on,that change to the command which the operating system could understand,carrying out corresponding operation for the system to support the operation.The main content of the article is as follows:(1)This paper use volume rendering's Ray Casting and surface rendering's Marching Cubes to accomplish the 3D reconstruction.And an optimization method for 3D models is proposed.In based on 3D reconstruction,the plane cutting technology,simulation of the reconstruction of body planar cutting.(2)According to the characteristics of the device body sense of equipment and the system requirements analysis,design a set of human-computer interaction gestures,including single hand clenched fists,single hand open,drag,rotate,amplification,narrow,realize the reconstruction of medical 3D model of rotating,zooming and mobile operations.(3)A Liver 3D Visualization System Based on Kinect is developed with the implementation of methods above.The basic function are Kinect control,data 10,3D reconstruction,model optimization,image display and graphic display.