Research And Realization Of Virtual Interaction In Crane Loading Simulator System

Interaction is one of the most key features in the system of virtual reality,so human-computer interaction technology has been made a hotspot in the field of virtual reality.Adding interaction devices such as position tracker and data glove in crane loading simulator system can control movement of virtual hand in the virtual scene. Then virtual hand operates virtual device in the cab.This design will increase way of human-computer virtual interaction,and facilitate work of training and assessment.Firstly,the paper discusses the theory of the construction of virtual scene graph and studies the topological structure of scene graph.VTree is applied as software platform responsible for the construction and management of scene graph.Then,this paper focuses on the anatomic structure and motion features of human hand.According to operation manual and photos,it studies the function and construction of operation panel in the cab.The paper discusses the principles and functions of data glove and position tracker.Based on that,the models of virtual hand and virtual operation panel are constructed by MultiGen Creator.Virtual hand travels in the virtual scene by the position of human hand based on position tracker.Simultaneously,gestures recognition of human hand based on data glove and motion mapping from human hand to virtual hand are also discussed.This paper mainly studies the theory and implementation of virtual hand operating on virtual objects.The theory of several types is designed applying to virtual hand operating on different virtual devices in the cab.And the paper realizes change of gestures of virtual hand in consistent and natural way by key frame technology.Also, the paper designs collision detection methodology realizing operation of virtual hand on virtual devices,and has models of information lights in the cab,indicating virtual hand operation on different virtual devices according to the change of the lights' state.