The Research On 3D Human Computer Interaction In Virtual Environment

To provide a serial of reliable and natural human-computer interaction methods is one of the issues that still have to be resolved in the areas of Virtual Reality and Human-Computer Interaction. On this issue, we present gesture recognition based 3D interaction technology, motion capture based 3D interaction technology, pressure sensor based 3D interaction technology and other kinds of 3D interaction technologies. On this basis, we apply gesture recognition based 3D interaction technology to Virtual Digital Olympic Museum (VDOM) by following steps: establishing Gesture-Semantic Map, training the standard gestures, and finally the recognitioning. Experimental results show that the system can recognize input gestures quickly with a reliable recognition rate. The users are able to perform most of the typical interaction tasks in virtual environment by this accelerometer-based device. In addition, we also apply pressure sensor based 3D interaction technology and voice recognition based 3D technology to Virtual Driving Simulation System. Users can throttle or brake by pressing Wii Balance Board. At the same time the system also provides rich interactive feedback. Experimental results show that users can get well experience form these two virtual reality systems.