Research And Application Of Data Fusion Technology Of Kinect And Leap Motion Sensors

Human-computer interaction technology is the link between human and computer system,which is a research hotspot in the current IT field.With the gradual maturation of various sensor technologies,a new generation of human-computer interaction technology places more emphasis on the natural coordination and portability of interaction.This paper studies the implementation of the calibration and data fusion applications of Kinect and Leap Motion.First,a dynamic fingertip acquisition algorithm based on Kinect depth image is proposed.Then,a one-dimensional calibration rod algorithm based on the reflective ball is proposed.The preliminary calibration of Kinect and Leap Motion is implemented.Then the corresponding point set registration algorithm is used to register the data of the two sensors.Finally,using Unity3 D to fuse the two data and design a human-computer interaction virtual system,the integration of the Oculus helmet and the human-computer interaction virtual system is studied.Experiments show that the fusion of these three sensors can extend the field of hand tracking,improve the collision detection between hands and virtual objects,and increase the immersion of human-computer interaction.