Research On Data-glove Based Interactive Technology For Virtual Operation Training System

This thesis aims to solve the important problems about virtual hand interaction in virtual delivery training, and give their solutions. Using data-glove as the HCI interface, the user can control the virtual hand in real time, and can be immersed in the virtual operation environment.This thesis studied in the construction of virtual hand and operation environment in detail, as well as the control and interaction of virtual hand. We implemented about the interaction system, which would provide a good foundation for the research of virtual operation training. The main research issues included in this thesis are as follows:Firstly, the static construction, dynamic control and the interaction of virtual hand have been analyzed and researched. And the implementations have been given. The hand's 3D model is rapidly built by 3dsMax mesh modeling, according to the shape and appearance of human hand. Use model-dividing method to divide the hand model to blocks and layers, on the basis of analyzing the hand bones'structure and joints' freedom degrees. And then, the conjunctions of virtual hand are built. In order to make the virtual hand move, it needs series of graphics transformations to the models. Meanwhile, the data-glove' use needs to be known, and its datum should be received in the interactive application. At last, the mapping of data-glove and virtual hand is built to implement the virtual hand's HCI.Secondly, aiming to the virtual delivery operation, the construction and management of virtual operation environment have been researched. Also, the collision of virtual hand and other model has been discussed. The elementary operation rule has been established in delivery training. The construction of medical 3D models has been discussed, and its method has been given.Thirdly, in terms of medical theory and operation training requests, this paper puts forward the primary frame of virtual operation interactive training, and has given its blue-print to virtual operation HCI implementation. The development work of virtual hand's interaction in virtual operation training system has been accomplished, basing on Visual C++6.0(MFC), 5DT SDK ,EON Studio 5.0, EON SDK and Windows XP, using the 5DT Data-glove5 as HCI tool and 3dsMax as the modeling tool. In order to control the virtual hand in real time, a virtual hand control node was developed by Eon SDK, and the data-glove datum-received module was built by 5DT SDK. The hand model and operation environment was constructed by the tools like 3dsMax and Eon. In the end, all the functions were generalized in the VC++ platform.