Research And Design On Hand Interaction Application Based On Augmented Reality

An augmented reality system supplements the real world with virtual (computer-generated) objects that appear to coexist in the same space as the real world. Augmented reality enhances a user's perception of and interaction with the real world. The information conveyed by the virtual objects helps a user perform real-world tasks.The leading actor in human-computer interface is changing from computer to human. Hand gestures are nature and simple for communication, and have become an important part of human-computer interface in recent years.In this thesis, in order to find out new ways to provide more convenient interaction and more verisimilar scenes in training emulator, the technologies of augmented reality and hand interaction are explored. Then an augmented reality system with hand interaction is designed. In the system, an occlusion extracting scheme is proposed to achieve the occlusion target detection. And a novel gesture model that can simulate mouse is given. Finally, hand interaction is implemented in the demo system, where one can manipulate the verisimilar virtual control panel using hand in real time.