Research And Implementation Of Photorealistic Blending Technologies In Augmented Reality

Augmented reality(AR)is an information technology that seamlessly integrates digital information into real-world environment using methods of computer graphics and computer vision.The key of geometric consistency is camera calibration,the camera calibration of marker-based AR maintains the stability and anti-interference of tracking by placing artificial markers,which is widely used in AR applications.However,the presence of artificial markers breaks the harmonious,reducing the photorealism of the augmented scene.For this sake,we propose a photorealistic augmented reality blending method based on image inpainting techniques.The specifics as follow :1)A novel hollow marker and its automatic generation method are presented.This marker is inspired by an observation that most area of traditional markers is useless for camera calibration.These calibration-independent regions are hollowed out to reduce the occlusion area of the real-world environment.In order to generate such markers,an automatic generation method is proposed,which hollows out traditional markers without introducing pseudo feature points to interfer camera calibration.Finally,we have done a camera calibration accuracy rate statistics experiments.Consequently,the proposed method achieves the best balance between the calibration accuracy and the area of hollowed out regions.2)This paper proposes a structure-preserving marker hiding approach based on hollow markers.The proposed method firstly recovers structures and reconstructs other regions afterwards,producing a rapid and seamless blending result.Based on the characteristics of hollow markers,an automatic detection of background structure lines in marker occlusion regions is proposed.Then the detected structure lines are reconstructed to recover the background information.After that,the non-structural regions are recovered based on existing inpainting techniques to obtain the final hidden result.3)An AR marker hiding system is designed and implemented.Based on ARToolKit,this system can support both traditional and proposed hollow markers.Functions such as hollow markers generation,markers hiding and virtual objects integration are all contained in this system.The proposed hollow marker in this paper not only reduces the occlusion area of real-world environment,but also ensures the accuracy of camera calibration.We have also proposed a structure-preserving marker hiding approach based on hollow markers.Through a large number of experiments,it is proved that the reconstruction of the marker area can effectively maintain the structural features of the background and achieve the seamless marker hiding effect.Our method in this paper focuses on photorealistic blending approaches in augmented reality,it can promote augmented reality technologies play a greater role in various practical applications.