Augmented Reality In The Actual Fusion And Human-computer Interaction Technology Research And Application

Augmented Reality comes from Virtual Reality technology. It is an interdisciplinary research including computer vision, computer graphics, digital image processing, physics, psychology and other research areas. With the development of science and technology, traditional2D Human-Computer Interaction Techniques no longer meet the needs of people. People need a more natural way to interact with the computer. Augmented Reality is adapted to the needs of people and become the research focus of the next generation of hum an-computer interaction technology. Augmented Reality take full advantage of the various human sensory experiences such as vision, hearing, taste, touch, and superimpose virtual world on the real world to produce sensory experience beyond the reality. Without special training, People can interact with virtual objects by the experience of everyday life.We mainly studies computer vision-based mixed reality technology and human-computer interaction technology, describes the image preprocessing, image segmentation, template match, camera calibration and achieves a markers-based virtual display system and a Motion Sensing-based human-computer interaction.Computer vision-based Augmented Reality has two categories:by marker and by natural feature point. We choose the marker that is a relatively mature and achieve a kind of virtual display system by computer vision library OpenCV and3Dgraphics engine OGRE.We use Prime Sensor obtain depth images, with computer vision, reconstruct3D skeleton of the human body,defined Motion Sensing semantics, Formulate the development of action-command mapping table. With platform OpenNI, We introduce Motion Sensing control technology into the digital display system and achieve two Motion Sensing control:limb control and body control.