Research On Virtual-Real Registration And Interaction Technology Based On Marker

Augmented Reality (AR) is a new technology that blends the virtual information generated by computer into the real world scene. It presented to the user a new environment in terms of the sensory effect. With the development of human-computer interaction technology, users utilize several more natural ways to interact with virtual objects instead of traditional interactive way, like gesture recognition, body posture, face recognition, etc. The virtual-real registration based on marker has the advantages of higher accuracy and low cost. Therefore, this paper mainly research on virtual-real registration and interaction technology based on marker.This paper achieves the virtual-real registration for every arbitrary marker and eliminates most of the mismatched points in the process of traditional SURF algorithm based on the optimized SURF algorithm. Firstly, this paper introduces several common marker-based augmented reality systems and the principles of the tracking and registration. Secondly, to solve the problem of the registration failure when the marker is partially occluded, this paper mainly researches on the virtual-real registration for arbitrary marker based on SURF algorithm. Finally, to overcome the matching error problem in the process of matching, this paper optimizes the SURF algorithm. This paper obtains a more accurate result after removing the mismatched points by using the RANSAC algorithm.This paper proposes a gesture recognition algorithm based on Kinect and achieves the operations of virtual objects by hand gesture. In order to satisfy the natural interaction between the user and the virtual object generated by the computer, this paper researches on the hand gesture recognition based on depth image and the interaction between the user and the computer. Firstly, this paper utilizes Kinect sensor to obtain the depth image of user’s hand and uses NiTE2 and OpenNI2 to extract the gesture area by setting the threshold. Secondly, this paper extracts the feature vector of different hand gestures combined with the convex hull algorithm. Finally, this paper recognizes different gestures by utilizing the support vector machine method, and accomplishes the operation of virtual objects by using simple gestures.This paper designs and implements a virtual reality interaction system based on marker registration by applying the above improved methods on the virtual reality interaction system. In this way, the system completes the modules of virtual-real registration based on marker and gesture recognition based on depth image. Finally, this paper achieves the function that the virtual model is superposed on the marker and the real-time interaction by hand gestures recognition. The running results of this system show that the virtual reality interaction system has a strong sense of immersive, which can enhances the user’s interaction.