Research On Technology Of Personalized Virtually Interactive Display Of Heritage Based On Kinect

The recognition of hand gesture and body posture is one of the hot research directions in the field of interactive display.However,the algorithm based on computer vision is vulnerable to be affected by some factors in the real environment,such as the light conditions or the background scenes; and the process of fingertips detection is susceptible to the size of the hand or the abnormal contour. Aiming at these shortcomings and deficiency, the main research content in this paper is as follows:1)Have researched the current situation of human action recognition and gesture recognition, and on the basis of this, this paper analyzes the problems existing in the current technology.2)A threshold algorithm is proposed based on the depth information and the joint information of palm captured by the Kinect to realize the hand segmentation. This algorithm not only sets a distance threshold based on the depth of palm.but also sets an area threshold on the depth image. So as to reduce the times of comparing. There for,it can effectively rule out the effects of light conditions or background scene to the hand segmentation.3)A fingertips detection algorithm is proposed based on the average K curvature.The average K curvature algorithm, the K-means clustering algorithm and fingertips exclusion algorithm and so on are the component of it.This algorithm reduces the influence on the result of fingertips by some factors,including the size of hand, the distance from the hand to the camera of the Kinect and the abnormal points of the gesture contour.4)A body posture recognition algorithm is proposed based on the 20 joints information of body captured by the Kinect.This algorithm first captures and tracks the 20 joints of human body,and then defines some special body gestures on the basis of the angle relation of involved,and by setting the various thresholds,this algorithm realizes the body posture recognition effectively at last.5)A personalized virtual interactive display prototype system of the cultural heritage based on the Kinect is designed and implemented.This system put the recognition results of body posture and hand gesture into practice,that is,puts them into the personalized virtual interactive display of the cultural heritage,and at the same time,this system proves the effectiveness of the above algorithm.