Research And Implementation Of Virtual Viewpoint Synthesis Algorithm In Multi-view Video System

Multi-view video is a hot-point on the video processing research fieldrecently. It is proposed for interactive multimedia applications, includingbinocular three-dimensional video and multi-view video broadcasting whichwill come into being in the future. Multi-view video needs to solverepresentation, interaction, storage and transmission in 3D interactive video.Its feature focuses on the interaction function which is provided for the usersto select view point interactively. The synthesis of virtual view points is thekey technique in the multi-view video. It produces smooth virtual video in theprocess of view point transition. In this paper, we mainly focus on the layerrepresentation, video object segmentation, the virtual view point synthesis,and implementing the algorithm of the virtual view point synthesis in thecondition of large angel capture system.The main contributions of this thesis are as follows:(1) Research and implementation of the virtual teleconferencingrepresentation and foreground segmentation based on multi-view video.We construct virtual teleconferencing environment by usinghalf-immersion projection display device. We propose a watershed basedalgorithm which extracts stably real time video objects from the staticbackground. And then we implement position based multi-view videoreconstruction and synthesis.(2) Research and implementation of synthesis algorithm in multi-viewvideo system.The main task of this part is to design and implement the synthesisalgorithm in our multi-view video system. The algorithm deals with twokinds of data—the foreground data and the background data. For theforeground data, the algorithm consists of three parts: selecting and trackingfeature points;building incompletely 3D construction and interpolatingvirtual view point images. For the background data, we adopt sprite methodto produce a panoramic image. Finally we combine the two results to get thevirtual view point image.(3)Improvement of the synthesis algorithm in multi-view video systemThe aim of the improvement includes: increasing the quality of thesynthesis image and reducing the executing time of the whole algorithm. Inorder to increase the quality of the synthesis, we mainly improve the methodof tracking the feature points. In addition, to reduce the executing time, we domore improvements in both the system structure and the algorithm. And wetest it by using standard testing sequences.