Study On The Interaction Technology Based On Virtual Hand

In the project “the key technology of 3D virtual display in cultural theme park”, the core technology is Virtual Reality(VR) technology, VR is one of the hotspot of computer network in the world at present, and it has been applied to many aspects of social life and has a very good prospect. In the virtual environment, VR technology has effect on the users by intuitive sense(such as sight, hearing and touch), which can generate immersive feeling. The virtual reality technology has been developed widely with the development of computer technology.Human-Computer interaction technology based on the virtual hand is a key technology in the field of virtual reality and it makes the interaction more natural and harmonious. This paper is focused on motion mapping from real hand to virtual hand, collision detection, accurate and stable grasping of virtual hand.In the field of motion mapping from real hand to virtual hand, and in the Human-Computer interaction of virtual hand based on Kinect, the motion retargeting method based on Kalman filter is put forward. This method makes the act of virtual model similar to the act of real person as far as possible. More importantly, it makes the act of the virtual model more nature and genuine.In the field of collision detection,on the account of problems of the poor accuracy the low efficiency collision detection in large-scale and complex scene at present, and based on the characteristics of grasping objects with virtual hand, this paper puts forward to a novel collision detection algorithm based on the octree and hierarchical oriented bounding box(OBB). The efficiency and accuracy is greatly improved by using the method of progressive detection from rough to detailed, then to precise. Experiment shows that the method is feasible.In the aspect of virtual hand grasping, through the deep study of the current typical algorithms of virtual hand grasping, we find that the grasping posture is not natural and the grasping is not stable in the current grasping algorithms. Based on the above problems and combined with the rules of real hand grasping, this paper proposes a grasping algorithm based on finger’s fingertip grasp trajectory. The grasping algorithm can both grasp object correctlyand the grasping posture is very real and natural. It meets the requirements of immersion and real-time performance in virtual reality.