Research On Human-computer Interaction Technology Based On Leap Motion

In recent years,more and more people have chosen hand-sculpting as a hobby,but real hand-sculpting activities cost high.This thesis designs and implements a web applications which supports manual sculpture based on Leap Motion sensor.The application provides a more natural user experience,while greatly reduce the cost of operation.The hand-sculpturing application is based on Leap Motion sensor's high precision hand motion acquisition and the WebGL standard.The vivid simulation of hand-sculpturing is implemented by using the hand motion acquired by Leap Motion sensor to change the shape,scale and color of 3D objects with WebGL API.The main contributions of the thesis are as follows.1.Designed a web application which supports manipulating 3D graphics with gestures based on Leap API and WebGL.2.Established a comprehensive and large gesture database to simulate hand-sculpting operations.3.Chose a HCNF-based gesture recognition algorithm as the user input method after thorough experimental verification.4.Improved the application according to the feedbacks of multiple users after they operated with the application.Gesture acquisition system algorithm validation results show that the use HCNF accurate gesture recognition rate is higher than the use of HCRF effect.The test score of the hand-sculpturing application shows that the web application based on Leap Motion provides better interactive experiences than applications with traditional keyboard and mouse inputs do.