Research On Virtual Object Manipulation With Bare Hands Based On Leap Motion

In recent years,with the development of technology and society,people tend to pursue more intelligent living and working environment.As the most commonly used mean,virtual hand operation technology has high research significance and broad application environment.Previous operations rely on traditional data extraction methods and have inherent shortcomings.In order to better operate,this study analyzes hand data extraction,collision detection,hand operation and related technologies.The main research work are as follows:(1)Bare hand data is extracted and virtual environment is constructed.This article chooses Leap Motion sensor to collect the bare hand data,then analyzes the data processing principle in detail and obtains the virtual hand model needed for further interaction.The virtual experimental environment is built and pre-operations including unit unification and coordinate transformation are completed.(2)The effective collision detection algorithm is designed and implmented.This paper classifies the collision situations in the virtual environment,designs the OBB hierarchical bounding box tree structure and construction method,and conducts rough detection by building and traversing the tree.Then,the basic geometric elements of virtual object are analyzed,and the geometric elements are detected according to the detection results of bounding box,so as to effectively improve the detection efficiency.(3)The algorithms of virtual hand grasping based on bounding box and operating are designed and implemented.The object interaction in the virtual environment is defined as several states,and grasping gestures in line with people's operation habits are designed,at the same time gestures are designed to manipulate the movement,rotation or scaling of objects.The operation of virtual object is completed,solving the problem of virtual object penetration.Common mechanical parts are used as interactive objects,importing in the environment,then scripts are programmed to realize the algorithms.The experiment results show that the collision detection,virtual hand grasping and operating algorithms adopted in this paper have better accuracy,solving the problem of penetration and wrong grasping in the process of operation,significantly enhance the sense of reality of operation.