Research On Multi-View Synthesis Method That Based On Triangulation

Telepresence can enhance operator's perception ability of field environment in the teleoperation system and improve the accuracy of operation. Wih the help of Stereoscopic display technology, operators can observe 3-D information of real scene without wearing any auxiliary equipment, it's an important way to enhance the telepresence of the teleoperation system. Currently, most of mainstream stereoscopic display systems show 3-D display by using multi-view and special spectrum display equipment, operators can simultaneously observe 3-D images from different location. Therefore, the research is carried out mainly on multi-view synthesis method, which establishes solid foundation for constructing teleoperation system with deep immersion. The mainly research task of this paper is as follows:Firstly, this paper analyzed the basic theory of stereo imaging and image rectificaton technology.The images can be rectificated by using internal and external parameters which can be get by camera calibration. Then we can get two images that the pixel lines were perfectly aligned in horizontal direction, this is the foundation for the next step of image matching and deformation.Secondly, this paper analyzed view matching method that based on corners. Aiming at the deficiency of existing corner detection algorithm, this paper proposes a MIC-Harris corner detection algorithm which effectively combined high efficiency of MIC algorithm with high precision of Harris algorithm. On the basis of corner extration,and relize image matching.Thirdly, this paper researched view morphing method that based on mesh division, using triangular mesh that based on Delaunay division to characterize the regional feature of the image. On the basis of existing Delaunay method, this paper improved convex polygon generating algorithm and LOP process, which speed up the division. After the establishment of mesh correspondence between images, pixels in the mesh area can be filled by using interpolation algorithm based on affine transformation, then multi-frame of high quality intermediate views can be generated.At last, based on the obove theory, this paper puts up experimental platform of multi-view synthesis. Muti-view synthesis experiment of the was carried out, and verified the related algorithm that proposed obove with the comparation between exsiting image synthesis algorithm. The result shows that, muti-view technology that proposed by this paper can synthesize the view of teleoperation environment with high quality, also can meet the real time requirement.