Human Interactions With The Virtual Model Technology Application Research

Augmented Reality (AR) is a kind of technology which integrates virtual information rendered by the computers and real world in the users’ eyes. This technology enriches and strengthens the visual experience of human. In recent years, the software system based on AR technology has being used in many educational establishments such as the Science and Technology Museum, the museum or the classroom, most of which are based on the interactive technology of artificial markers. They have the shortages of lower immersion feeling and hard to using. People-centered human-computer interaction is the future direction of development of computer technology; Hand-based interaction can effectively improve the immersion feeling of human-computer interaction and let it easy to use.The goal of this study is to design and implement an interaction system in which people can use hand to operate of the virtual model in real world. And then we can use this system in the Science and Technology Museum to teach the kids knowledge of dinosaur. Its core is determining the distance relationship between the2D coordinate of a fingertip and the2D coordinate of a marker by localization and tracking the fingertip in one finger of one hand. Then we can implement the real-time interaction of hand and virtual models in real world. This paper includes the following aspects:1. In this paper, the design of an interactive system based on interaction of hand and virtual models has been proposed. This system is based on AR technology, and ads in an interaction method based on hand. Through a modular program design, make this program have portability and applicability.2. Developed a verification system based on marker interaction according to the design program. And we can simulate the hand to make an interaction. I have explored and determined the interaction semantics which are suitable for the environment of the Science and Technology Museum and the young audience. The interaction semantics are getting, dragging, and putting. We can integrate the gesture recognition module in this system,3. Determined using a single fingertip vertical reach out as an interactive gesture. And we improve the algorithm accuracy and operational efficiency by optimization and comparison of various algorithms to make my program be more useful. I have calculated the2D coordinates of the fingertip in real-time picture through three steps: split the skin area first, and then determine the contour area of the hand, and find out the fingertip at last. Then I find the distance between the2D coordinates of the fingertip and the2D coordinates of the midpoint of the marker, and use this distance to be the core technology of the interaction. Then I can implement the interaction semantics of getting, dragging, and putting. At last I integrate the interface into the system implemented in step two, and accomplish the testing and analysis of this system.