The Key Technology Research Of Virtual Surgery Based On Gesture Interaction

Virtual Surgery is a process which use Virtual Reality technology to realize surgery simulation,it can provide doctors with real-life experience of visual,auditory,tactile and so on,and it also plays an important role in surgical training and planning.Recent years,with the escalation of somatosensory interaction devices,using markerless gestures to interact with computer has become an important development in the field of human-computer interaction,which makes Virtual Surgery based on gesture interaction possible.In this thesis,Gesture Interaction is combined with Virtual Surgery by defining a gesture database which include several commonly used gestures based on the natural requirements of Gesture Recognition technology and Virtual Surgery operation and establishing a mapping relationship between gestures and Virtual Operation.Also we use some gestures to control the movement of virtual surgical equipment in the virtual scene.During the interation process,we use Leap Motion Controller to obtain hand information such as user hand joint positions,posture,finger.We use the feature vector extracted from the doctor's hand to recognise the gesture,and then complete the process of Virtual Surgery through a combination of gestures.In order to ensure the accuracy and stability of the virtual devices in three dimensional space,we use Kalman Filter and Unscented Kalman Filter to process user's original data in the position and attitude.In the end,this thesis verify the gesture controll and filtering effect on the Virtual Surgery platform of ocular muscles based on gesture interaction in the laboratory.