Research On Virtual-real Fusion Technique In Augmented Reality

With rapid development of computer vision,computer graphics,augmented reality has entered into a new era and has been a hot research topic in the domain of information technology.The key technology of augmented reality system is virtual-real fusion and the effect of fusion directly affects the perception of users,so a wonderful fusion effect is an essential part of an augmented reality system.In addition,the real-time accurate registration and tracking are the premise of virtual-real fusion technique.The performance of registration and tracking will have a big impact on the real-time and robustness of augmented reality system.Therefore,it is also vital for the augmented reality system to achieve real-time robust tracking of the target.Based on this,the paper mainly includes the following two research contents:(1)Improved 3D object tracking algorithm which is based on CAD(Computer Aided Design)model.Traditional 3D object tracking algorithm based on CAD model are difficult to handle the real-time tracking of complex models.To solve this problem,a tracking method based on substitute model is proposed,so that can ensure the robustness of 3D real-time registration tracking in virtual-real fusion.The substitute model simplifies the original CAD model and retains the key structural information as much as possible.The simplified process is to detect the salient edges in the polygon mesh structure of the original model,and the criteria for the edge detection is to preserve the sharp edges.But when the dull edge constitute the object's boundary they are also considered.Experiments have fully confirmed the validity of the tracking algorithm which is based on simplified CAD model,which can achieve real-time,accurate and efficient tracking of complex objects,and then can provide accurate positioning information for real-time registration.(2)Realize the multimodal real-time fusion rendering effect.First of all,use OSG(Open Scene Graph)to achieve realistic rendering of virtual models.And then,implement a variety of fusion rendering effects through the interaction of GLSL(GL Shading language)and OSG.The fusion rendering effect mainly depends on the fusion processing of the virtual model depth data,color data,and video data.Finally,using the OSG interaction mechanism,users can freely select the module of interest to observe and to achieve a flexible and intuitivefusion scene.In this paper,the object tracking algorithm based on the substitute model and the multimodal fusion render method are applied to augmented reality system.The results of the system operation show that the target tracking algorithm based on the substitute model is better for tracking 3D objects than the original CAD model,which provides guarantee for real-time registration of 3D object in the process of fusion.Meanwhile,multimodal fusion effects can fully expresses the information to be enhanced in the scene and achieves a wonderful real-time fusion effect.