Research Of Virtual Viewpoint Synthesis Based On Contour Perception

With the development of video technology, the demanding of high qulity video has in-creased fastly by customers, real-world multi-view stereoscopic viewing requirements become more urgent. As an important branch of stereoscopic television, Free Viewpoint Television, FTV, displays stereoscopic image pairs at the same time. Not only meetting the needs of multi-user scenarios depth perception, FTV can also provide a small view range to support the move-ment of user's head without the aid of any auxiliary conditions. Many technologies make it possible to implement the Multi-view Television such as depth image based rendering(DIBR), image restoration, image fusion technology, object outline sensing algorithm and provides the-oretical basis and technical support. The researchers also have proposed many new algorithms to impelement virtual viewpoint synthesis.This paper studis the virtual viewpoint viewpoints synthesis technology based on contour perception algorithm. Contour perception for virtual viewpoint synthesis technology is based on depth and color images of reference viewpoint. To obtain the major features of the object, this method creates the entire grid mesh of the reference viewpoint image by getting the outline of the objects in the image.The deformation of image triangle mesh are formulated by energy formulation. Then we used the warping algorithm to warp the image based on texture mapping to generate virtual viewpoint image, and finally we get the virtual viewpoint image through the integration and image restoration technology.Canny operator is used to obtained the contour edge of the object in the image. The method improves the accuracy of the contour edges in the captured image, and the contour of the object is no longer required to obtained by manually selecting ways. Using the image grid mesh is greatly improving the performance of the virtual viewpoint synthesis.The method also protects the main outline of the objects in the images by using triangular mesh edge energy formula and renders the virtual view image using 3D image warping algorithm in DIBR tchnology. After referring to the mutli viewpoint images, we render the final image by selecting a few results generated by the last step and choosing the proper ones to merge them based on the values of the images got by algorithm.Contour perception of virtual viewpoint synthesis technology which combines edge detec-tion and image grid technology gets a proper result. The performance is increased and visual re-sult is acceptable. The performance of generating the virtual viewpoint image inproves greately compared to previous studies and DIBR tchnology.The experiment makes sure that the method can be applied in the virtual viewpoint synthesis technology.