Gesture Recognition And Palm Positioning In Augmented Reality

The technology of Augmented Reality can combine the virtual world with the real world.And it has a wide application prospect.Augmented Reality based on gesture recognition is a popular technology of augmented reality at present.It has important application value to come true Augmented Reality technology by using palm and gesture as natural interactive signs.By using human hands as an interactive tool,it overcomes the shortcomings of existed interactive devices such as AR handle and digital gloves.It improves the sense of immersion of users,saves some hardware costs and is more convenient.The Augmented Reality technology can be used in the field of entertainment,education and medical care.At present,the widely used gesture recognition technology is based on the neural network framework.Although the gesture recognition technology is relatively accurate,it requires a large amount of data for training and requires high hardware requirements.In this paper,a new gesture recognition algorithm is proposed by introducing a new orthogonal function system-V-system.A new feature vector is obtained by fusion of boundary feature vector and region feature vector of gesture,which is used as the feature information of gesture.Moreover,the gesture is recognized.Experiment results show that the result of gesture recognition is better than the results of Fourier algorithm and Zernike algorithm under certain scenes.For the real-time location of the camera in Augmented Reality,an algorithm is proposed based on fusion features of the point and line of the palm in this paper.Firstly,the palm is taken as the reference plane.And then,Hough transform is used for extracting the edge line of the finger as the linear feature.Moreover,ORB algorithm is adopted to extract the point feature of the palm.A large number of experimental results show that the accuracy of camera positioning is significantly improved through the fusion of point and line features.Based on the above algorithms,an Augmented Reality demonstration system is built based on gesture recognition and palm positioning,which can enhance the effect of real images.The function that interacting with virtual objects by gestures is carried out.