Application Of Gesture Interaction Technology Based On Leap Motion In Virtual Scene

In recent years,with the continuous progress of virtual reality and multimedia technology,somatosensory interaction has become a popular way of human-computer interaction,which is widely used in industrial simulation,virtual teaching,virtual roaming and other fields,making the interaction between human and computer more natural and rich.Leap Motion,as a gesture interactive device,can collect natural gestures,extract features and feedback user needs through computer vision recognition technology.System framework and design method are the basic guarantee of human-computer interaction system design.However,at present,Leap Motion-based virtual system design often centers on function and technology,and lacks a general and effective design framework and design method of gesture interaction system.This paper analyses the characteristics of Leap Motion's human-computer interaction system,aiming at improving the feasibility of the application of gesture interaction technology in virtual scenes by considering the situation perception and user-centered design principles from the perspective of system operators.The main research work of this paper includes:(1)The human-computer interaction characteristics of gesture interaction system based on Leap Motion are analyzed,and the principle of gesture design based on Leap Motion is summarized.On this basis,the design framework of gesture interaction system for virtual scene is designed.(2)According to the system design framework,the design strategy of gesture interaction system for virtual scene is proposed,which includes the integration strategy of interactive information,gesture-aware interactive information driver and object interactive behavior management.(3)Based on the theory of user mental model,the design method of system interactive gesture is proposed.Combining with the characteristics of virtual scene,the method of describing virtual gesture by feature set is proposed,which improves the development efficiency of gesture interaction function.(4)Based on the interaction function and task of traditional Web3 D virtual museum interface,the system design framework and method proposed above are applied to the design of the system.A virtual museum using gesture interaction is developed by using Unity3 D and Leap Motion.Thefeasibility of the design framework and method proposed in this paper is verified by testing the system.The test results show that the proposed design framework and method can effectively guide the interaction design of the whole virtual scene,improve the experience of gesture interaction process,and guide the development of gesture interaction system.