Research On Human-Computer Interaction Technology Based On Virtual Hand

Natural and efficient human-computer interaction has always been a focus in the field of computer application research. Virtual hand technology is a new kind of natural and efficient interaction technology, and it can make user feel immersion while operation. This paper studies the key technologies of human-computer interaction based on virtual hand and also the realization method of it. Firstly, this paper analyzes the principle of human-computer interaction based on virtual hand, proposes the theoretical structure and operating flowchart of virtual hand operating system, then describes the main function of every part in the system, and indicates the key technologies of the whole system. This paper focuses on the technology of motion mapping between human hand and virtual hand. The object-oriented theory and method of virtual hand modeling is proposed on the basis of analyzing the anatomic structure and motion feature of hand; The theory of motion tracking is studied, and the motion tracking to hand is realized by using data glove and motion tracker; The theory of motion mapping is studied, and the solving method of motion mapping between human hand and virtual hand is brought out. The technology of virtual hand operating is also studied in details in this paper. The theory of virtual scene's building and management is studied; The paper studies the collision detection technology, especially the theory and realization of collision detection technology based on OBB; The grasping theory of virtual hand is studied, then an improved rule for grasping is proposed and also the realization technology of virtual hand operating. Finally, a prototype system for virtual hand operating is developed by using Open Inventor as software platform and using 5DT DataGlove and motion tracker as main input devices under VC++ and Windows system, and its application prospect is introduced.