Application And Research Of Gesture Interaction For Large Immersive System

Large immersive system provides a highly immersive interactive environment. As one of the most cutting-edge topic in Human Computer Interaction (HCI), gesture interaction technology brings many possibilities to HCI. This technical fusion not only can solve technical issues, but also to explore the relationship between technology and user.Taxonomy is made for both gesture interaction and large immersive system, showing backgrounds and the state of arts of these techniques. Further discussion of human motion capture algorithm behind Kinect sensor is also generated. With Unity3D game engine as a development platform, the feasibility of the platform is tested, demonstrating the technical route for the combination of immersive environment and gesture interaction. The test system performs in more than20fps in consumer PC, also showing high accuracy of tracking user as well as certain robustness.Based on the research of interactive space, the article presents two interactive modes according to the distance between user and display. A3D map application is conducted for the user test. The paired samples T-test analysis results show that gesture interaction can significantly reduce the limitations of a large touch screen environment, especially for functions like3D view navigation; menu selection; drag-and-drop function; and assisting disable users.According to the user test and technical route generated above, a system of combining360degree cylindrical immersive environment and gesture interaction is presented. The system enables gesture interaction for3D view navigation, object selection, drag-and-drop function. By discussing the basic algorithm behind the system, the system acts as an example of combining these techniques in practice. The system also shows accuracy in gesture recognition, fluency as well as robustness. This research indicates gesture interaction offer better user experience for large immersive system. The article analyzes the significance and practical value in terms of a combination of the two technologies in the field of HCI, thus providing theoretical support and reference for future research and application.