Research And Implementation Of Virtual Hands Interactive Technology Based On Binocular Stereo Vision

Virtual Reality (VR) technology is a new comprehensive technology, evolving from computer, and computer graphics, and transducer, and human-computer interaction technologies. VR has provided people with a new form of human-computer interaction. Thus the traditional WIMP interface and interactive tools based on mouse and keyboard have been unable to meet the need of interaction in virtual environment. Then virtual gestures, stereoscopic display and other more natural interactive channels greatly improve the nature and efficiency of human-computer interaction. Especially, tracking the movement of human hand and gesture recognition plays an important role in human-computer interaction. Gestures-based interaction technique must investigate many issues, mainly including hand modeling, and gesture input, and gesture recognition, etc. Aimed at the issues above, the system provides deeply contributions in hand modeling and gesture recognition with Data Glove Ultra 14, Open Inventor and Visual C++, Based on VR Juggler.Work is as follows:1. The paper makes deeply research on the principle and realization technology of stereoscopic display. According to the conditions, the paper chooses prismatic technique and builds stereoscopic display system based on binocular vision on VR Juggler, and solves the problem of synchronization.2. The paper has proposed hierarchical geometrical model of the hand based on the analysis of the structure and movement of the hand. Then the paper simplifies the human hand as a link joint manipulator, adds reasonable bound relationship and models the hand kinematics according to robotic theory. The hand model lays the good groundwork for solving the issues in gesture interaction and synchronization. The relationship between hand in the real world and virtual hand in the virtual environment has been established.In the end, a prototype system has been designed and implemented on the basis of the researches above. In this prototype system, users are able to navigate in virtual environments using virtual gestures, and are also able to directly manipulate virtual object. In other architecture of virtual environment, persons can learn from the paper and research the issue about interaction deeply.