Semi-Virtual Reality Cockpit Technology Research Based On Data Glove

Head-mounted Display(HMD) is taken as a scene equipment in Light Weight Flight Simulator. It has brought some problems to the operation in the cockpit thought it's a guarantee of lightness and cheapness. Pilot cannot see the real button and his hand after he put on the HMD, which will set an obstacle on human-computer interacton and filght simulation.This dissertation proposes Semi-Virtual Reality Cockpit solution. All the view scene in and out of the cockpit are created based on virtual reality technology, including apparatus board, all kinds of buttons and switches and the hand of pilot. On the other hand,all parts which can be touched keep 1:1 proportion. This is so-called "Seeing is virtual, Touching is believing, Keeping virtual and real consistency" principle.Firstly, the method of how to apply signal collection chip and its API interfaces to ensure the button operation synchronization is introduced. Secondly, the virtual hand model is created based on the research of the structure and movement characteristics of human hand,and the action mapping from human hand to virtual hand is established which implement the control of virtual hand. Meanwhile, with the help of dataglove, we can perform the initial calibration and gesture recognition, and conclude, record the special gesture of the operation on the typical switches. Then the 6 DOF electromagnetic tracker LIBERTY is introduced to calibrate the virtual hand's spatial location with the help of the coordinates of typical switches, which increases the precision of hand location. Finally, the VegaPrime runtime simulation of virtual-real contrast test system integrated with all the peripheral equipment is designed, and the virtual-real contrast test system is implemented on the .NET platform.