Research On Double Hands Interaction Technology In Virtual Assembly Simulation

As a typical application of virtual reality technology in the field of product design, the value of virtual assembly has caused more and more attention. Because of the use of mouse and keyboard interaction devices, the bad immersion and interaction exists in many traditional virtual assembly systems. To solve this problem, the thesis focused on the human-computer interaction in virtual assembly, starting from behavioral and cognitive psychology point of view, proposed the overall design concept of the virtual assembly simulation system based on double hands interaction instead of the traditional mouse interaction, and accomplished the virtual assembly simulation system for an optical helmet. In the simulation system, users can use the virtual hands to grab parts, and completed the assembly task through the collaboration of double hands.First, the thesis summarized the technology of gesture recognition and gesture tracking, analyzed the scope of many gesture recognition methods, and described the gesture recognition method based on Hu moments characteristic in detail. At the same time, after discussing the advantages and disadvantages of a variety of tracking methods, response to the shortcoming of CamShift algorithm can not tracking objects automatically, the solution of contour extraction and motion tracking checking with each other is proposed to make CamShift algorithm semi-automatic tracking into automatic tracking.Secondly, the thesis designed the structure and processes of virtual assembly simulation system based on double hands’interaction and proposed two core mathematical models:coordinate calculation model and color thresholds Gaussian model, and analyzed the processes of gesture extraction, gesture recognition and collision detection. In the stage of gesture recognition, the Euclidean distance was selected as the measurement criteria between the gestures. In the stage of collision detection, the axis-aligned bounding box was selected to create the system’s bounding box tree, and designed the collision detection strategy of entire system, while described the assembly relations between different parts. Finally, the thesis analyzed the encoding process of key parts of virtual assembly simulation system based on double hands’interaction, combined with the specific assembly process and characteristics of the optical helmet, accomplished a virtual assembly simulation system based on double hands’interaction, and verified the feasibility of double hands’interaction in a virtual assembly system, while analyzed the inadequacies and subsequent improvement that exist in the system design.