The Research Of Augmented Reality Scene Soft Integration And Real-Time Rendering Technology

Augmented Reality systems could place and mix the virtual objects on the position in a real environment. And the virtual objects are generated by the computer technology and visualization technology. In addition, the position of the virtual objects is calibrated in a prime time.At last, the fusion videos of virtual objects and real environment display in the display device. A new visual impact and a special efficiency are created by Augmented Reality systems. For example, missing parts of cultural relics and historic sites could be created in mixed word by the technology of Augmented Reality virtual-real integration and real-time rendering. For the disappeared historic sites, this technology could recovery them on the prime sites based on historical records and pictures. So that,visitors could review the historical wonders. The researches of this subject contain two aspects--combination between virtual reality and real-time interaction. For the purpose of restoring historical sites and protecting cultural heritages.Augmented Reality scene soft integration and real-time rendering are to improve the fidelity of virtual scenes and realistic scenes fusion. At present, the major method is to model real scenes in advance. Obviously, the workload is so huge and the portability of AR systems is poor. Or estimate the illumination of real scenes in the offline way. But, it doesn’t render real scenes in real-time and it is lack of interaction with virtual scenes. According to the problems of current researches, the main work of this paper are as follows:1. An overview of the key technologies of Augmented Reality is conducted, including display technology, tracking registration technology, the virtual-real fusion technology and real-time interaction technology, and introduction of ARToolkit basic working principles, internal algorithm processes and frame structure.2. A real-time rendering algorithm was presented which is based on three-dimensional markers. And the recognition principle of three-dimensional markers is analyzed. And median cut algorithm is applied to the environment map from three-dimensional markers. What’s more, a soft shadow generation algorithm in real time is proposed by improved the traditional plane shadow algorithm. It has been found that real-time rendering technologies based on3D markers have high efficiency, and are able to meet the requirements of realistic lighting rendering virtual objects in real-time.3. An improved real-time illumination rendering technology was proposed, which includes the lighting system and the particle system, an effective pixel enhancement algorithm. In our method, the proposed fire particle system is able to render reality ambient light to produce lighting effect on real environments by a virtual light.4. The design and realization of a real-time interactive system of the virtual world and the real world is completed based on ARToolkit. An improved interactive method is proposed which is based on multiple ARToolKit markers. Our system developed is able to import OBJ phantom models to the ARToolkit platform, and then renders the virtual-real scene using the OpenGL. Our system developed is able to show realistically the "real" Qin Terracotta Warriors phantom models illuminated by virtual flame making use of a keyboard and markers. As results, this system has characteristics of rapidity and instantaneity.The preliminary studies of Augmented Reality scene soft integration and real-time rendering technology in our work pointed out some basic problems and proposed improved methods for AR applications. Results show that the system could place virtual objects at the calibration position in the real scene. And virtual objects and real environment have consistent illumination. Moreover, it produces good quality of shadow effect. What’s more, real objects and virtual objects could interact with each other in real time. Our system has a great instantaneity and high display fidelity, is able to meet the requirements of general Augmented Reality applications, which forms a preliminary reference for the future research of augmented reality systems applied to the field of cultural heritage protection.