Research On Immersive Natural Gesture Interaction Technology

In recent years,immersive interactive technology has gradually become a new way of virtual interaction.In the immersive environment,users can get a good sense of immersion.Currently,the technology has been widely used in auxiliary medical,industrial design,VR games,3D movies and other fields.However,precise interaction is difficult in the virtual world.In the immersive environment of virtual reality,the user can only observe the virtual scene rendered by the VR headset.The traditional interactive device(mouse,keyboard,etc.)cannot be directly applied to the immersive environment,which reduces the accuracy and efficiency of visual analysis of the three-dimensional data.Gesture interaction is a human-computer interaction realized by tracking gesture actions,which has intuitive and natural characteristics.In order to realize the interaction of 3D data in immersive virtual environment,this paper implements a gesture natural interaction system in a non-contact immersive environment.The main work of this paper is as follows:(1)Aiming at the problem of less effective interaction in immersive environment,a gesture interaction method based on cursor model is proposed.Using the cursor model to quickly determine the state of the gesture,including four basic gestures of fist,open,OK and pointing,solve the problem of gesture jitter through the spring model,and implement a hand model allows the user to feel the position of their hands in the immersive environment.(2)This paper implements a gesture natural interaction system in an immersive environment based on Leap Motion and HTC Vive.By the binding interaction method,users can customize their combined gestures for 3D interaction.This method reduces the coupling degree of gesture interaction.The combined operation performed by the combined gesture simultaneously completes different interactions,improving the efficiency of interaction.In this paper,the sensor device is used to collect the user's gesture motion data,and the virtual scene is displayed in real time through the headset.This paper realized the gesture natural interaction system in the immersive environment.(3)The gesture interaction system in the immersive environment implemented in this paper was tested.Through six test cases,two-dimensional mouse interaction,three-dimensional handle interaction are compared,and the effectiveness of the system is verified from the aspects of practice time,completion task time,partial gesture difficulty and user feedback.User evaluations show that gesture interaction provides a better interactive experience than two-dimensional mouse interaction and three-dimensional handle interaction.