Research And Implemention Of 3D Model Transformation By Free-hand Gestures Interaction Based On Leap Motion Controller

With the quick development of software and hardware of computers, the methods of Human-Computer Interaction is changing continuously. Compared with the traditional method of HCI using the mouse and the keyboard, interacting with computers by using gestures is more convenient, faster, and more in line with the habits of human beings.Leap Motion controller is a device which can capture the geometric information of user's hands, and it can capture the geometric information of hands in real-time. This thesis focuses on the study on the method of interacting with the models in virtual scene conveniently and efficiently, based on the hand geometry data which are captured by Leap Motion.Firstly,This thesis introduces the background and the significance of natural hand gesture interaction, and the research status of the gesture interaction. The next section introduces the related technologies of Leap Motion and Virtual Reality. Then, the gestures used for interacting with models is designed. The feature data of gestures and the comparative coefficient of motion and rotation are determined by experiments. And the process of gesture interaction is designed. Based on it, this thesis designs a correspondence between gestures of two hands and operations. The operations on 3D models include creating model, translation, rotation, scale, and operations on meshes like twisting and plane scaling. The transformation values which are calculated by the data from Leap Motion, are used to transform 3D models in order to implement these operations. The original methods of rotation, scaling, and so on are improved in order to make transformation of models follow the hand gesture. Finally, the interaction system using gestures is realized in Unity 3D game engine,based on the research results of this thesis, in which users are able to use hand gestures to translate,rotate,scale,twist the 3D models in the virtual scene. Based on the research results, an application is developed which makes users be able to manipulate the model through the hole in the wall,and a virtual assembly application is developed.