Study On The Hand Gesture Recognition Based On Leap Motion

With the concept of "wisdom city" proposed in 2010,the non-contact interaction gradually become a hot research.Leap Motion is a motion-sensing controller that launched in 2013 by Leap company,it through two infrared LED cameras to capture finger's images from different angles.This thesis mainly studied Auxiliary speech and 3D product display technology based on Leap Motion.The main work is as follows:1.Based on the auxiliary speech technology of Leap Motion,including Leap Motion PPT based on Leap display technology and Motion based image display technology.First establish left waved,right hand waving,painting line,move up and downward,forward and shift model gestures,gesture recognition is performed by tracing the palm orientations and vector method,the finger tip and the direction and position,pitch angle,the second time through the spy software for application program interface,finally through gestures to complete the PPT page,simulate the mouse button,underscore control and the picture browsing,zooming,rotation control.The experimental results show that the commonly used gestures into control commands to control the PPT and pictures in an interactive way to assist the speech function,can effectively improve the atmosphere of active speech,the audience's interest.2.Leap Motion 3D display technology based on commodity.First by 3ds Max and ogre build 3D product model,followed by the establishment of left and right shifts gesture model,and through to palm orientations and vector method,fingertip direction and position,pitch angle,roll angle tracking gesture recognition is performed,again through the spy software obtained 3D product model interface,the gesture control 3D product amplification,narrow and multi angle rotation.Experimental results show that the technology can achieve real time 3D merchandise display,with no contact and interactive way to carry out a full range of 360 degree display of goods,greatly enhance the user experience effect.