Research On Registration And Rendering Method Of Video To Enhance3D Scene

Video surveillance system is an important part of today’s security system, widely used in people’s daily lives, and the virtual three-dimensional system is an important achievement in computer science and related disciplines, it is also widely used. Put the video images into a virtual three-dimensional system in order to enhance the realistic of the virtual three-dimensional scene, on the one hand can play the advantages of video image that is flexible, convenient way to obtain, real-time transport, on the other hand can increase the time dimension of the virtual three-dimensional system, put the real-time, dynamic information of the objective world into the static virtual three-dimensional scene. Meanwhile, put the video information into a virtual three-dimensional scene are also able to overcome the shortcomings of fragmented and unorganized about the video and the static information about the virtual three-dimensional scene. So as to form complementary advantages, enhance the application value of the two overall. This article is in the light of the bottleneck problem of registration and rendering during video image enhancement virtual three-dimensional scene. The main research contents, methods and results are as follows:(1) The two core issues of registration and rendering method are analysised: Based on the consistency of imaging model of video images and virtual three-dimensional scene, the transformation equation between the internal and external orientation elements of video camera and the function of three-dimensional rendering engine is built. Internal and external orientation elements obtained in subsequent calculations could convert to three-dimensional rendering function parameters, which can accurately registere video images into the virtual three-dimensional scene; Generality and particularity about the three-dimensional rendering of video images are researched and analysised, video image filters is designed based on DirectShow streaming media technology, from which textures can obtain real-time images from the video data of different sources, and take advantage of GPU-accelerated rendering method to improve the overall efficiency of the system.(2) On the basis of analysis about the control conditions and priori knowledge of the video surveillance scenes, register methods of video images into the virtual three-dimensional scene is explored, in which the internal and external orientation elements are calculated separately step by step, including the use of one-dimensional calibration method that is cost low, easy to operate and space resection that can synthetic the multiple features.(3) An improved method of one-dimensional one-camera calibration method and a new one-dimensional multi-camera calibration are presented based on the analysis of error source. These two methods can obtain high precision calibration results. It is possible to overcome the poor geometry constraint of the one-dimensional calibration object to some extent.(4) A new method of space resection based on the generalized point photogrammetry theory is proposed, put forward by using horizontal and vertical line, line segment and circle, a unified adjustment model is built to calculate the external orientation elements and can greatly reduce the dependence of traditional resection method on feature points, and the introduction of the redundant observation value can also improve the accuracy and stability of the calculation results to a certain extent, which is suitable for the video surveillance scenario where there is lack of prior knowledge, and difficult to deploy locus of control points.(5) Video images organization, access and scheduling method to improve rendering efficiency is studied, which is in order to solve the bottleneck problem of the data size and real-time. These works include:Based on the multithreading technology, a data read and work allocation in order to resolve conflict response between the user actions and data read is presented; Spatial index information of video data is built based quadtree structure; A calculation method about real-time resolution of the video image is proposed. Comprehensiving the above methods, the buffering and scheduling of video data is built for the video efficient rendered in the virtual three-dimensional scenes. In addition, a visibility detection method based on the Shadow map algorithm to slove the inconsistent between the video camera view and the virtual view is proposed.Through these works, the paper largely resolved these two core issues of registration and rendering when the video image enhance the virtual three-dimensional scene, which is helpful to the application of virtual reality technology, useful to the Video GIS, has a certain significance of the the camera calibration and video texture.