Study On Dynamic Gesture Interaction Technology Based On Deep Vision

AR technology is generated in the development of virtual real ity technology.The computer draws the virtual image by rendering.The AR technology accurately integrates the virtual image into the real world captured by the camera.Finally,through the video display device,the fused scene is presented to complete the perfect combination of the real world and the virtual world.Nowadays,the interactive system of modern industry has moved away from the virtual environment.Today,as the growing virtual reality and augmented reality technologies,the natural interaction with the virtual environment becomes more and more important.However,technologies interacting with the virtual environment still have some shortcomings.For instance,external objects such as gloves need to be interacted with in a virtual environment.H ardware devices have problems of occlusion and identification when identifying gestures.Based on the above problems,this paper presents a solution,which is the content of this article: based on the depth of visual three-dimensional dynamic hand gestures interaction technology.Using Intel Real Sense depth camera combined with depth information and bone movement features to construct the virtual hand model and set up an interactive system to achieve accurate interaction with the virtual environment to ensure the virtual reality of the hand and virtual hand consistency.In order to set up the above system,this article has done the following research: Using Real Sense depth camera to identify 22 bones of human body.Based on the physical structure of human ha nd,the characteristics of skeletal movement and the virtual hand hierarchy model,a virtual hand skeleton model that is consistent with human hand characteristics and real-time and consistent is established by using Unity3 D software.In order to realize t he human-computer interaction under the virtual environment,this paper writes a script under the Unity3 D platform to complete the design of the VR virtual numeric keypad and realize the virtual hand gesture interaction technology of digitizing the fingert ip by pressing the numeric keys.Among them,in order to achieve a more accurate fingertip click operation,this paper detects,locates and tracks the fingertip through the key point detection of the fingertip to achieve the accurate positioning of the fingertip of the fingertip.The specific implementation method is to detect the contour of the finger contour after cutting and translating,detect the initial state fingertip point by using the curvature relationship of the hand side pixel,and perform fitting optimization and space coordinate conversion to obtain the check point.Finally,Kalman filter is used to get the accurate three-dimensional coordinates of fingertip.Experiments show that the virtual hand model has a good effect and high real-time performance.Compared with the traditional method,the finger-tip detection part has less error with the real fingertip data and has higher robustness,and the fingertips click accuracy rate above 95%.