Interactive Application System Based On Augmented Reality

Augmented Reality (AR for short) is a new technique based on virtual reality (VR for short). AR allows the user to see the real world, with virtual objects superimposed upon or composited with it, thus AR makes the real world more colorful.AR technique now has a lot of applications. It can be well used in areas such as game, entertainment, exhibition, education and so on. With the wider and more demanding use, we require the system to be stronger in3D tracking and support various virtual elements rendering, with straightforward interaction and excellent expansibility. This paper is devoted to design and implement an Augmented Reality Application system which meets these requirements.The system has two parts, they are preprocessing subsystem and real-time display application system.Preprocessing subsystem--Preprocessing for Augmentation Reality is kind of complex and not user friendly. This paper first introduces the stages of preprocess and the AR techniques associated with them, and then design and implement an integrated preprocessing software system. The work for preprocessing would be much easier and user friendly if we use this software.Real-time display application system--The paper introduces the framework, flow path and implementation for the application in detail. We adopt modularization and multi-threading design, and partition the whole system into four modules. They are grab module, track module, interact module and render module. The system supports capturing video through web camera, industrial camera and local images loading. It supports3D scene tracking. It supports literals, image, video,3D object rendering. One of the most important functions of the system is interaction. We use finger to interact in this paper. We combine edge detection, color analysis and shape analysis to detect the finger in real time. The system has excellent expansibility. Two real examples are given in the end of the paper, to show the result of the system. These are Live Paper system and3D Terrain system.