Research And Relization On Real-Time Virtual Viewpoint Synthesis

Virtual viewpoint synthesis technology is one of the core technology of free viewpoint TV, a display device by simultaneously displaying a plurality of viewpoints images to viewers with 3D sense and immersion. Usually it consists of several pre-collected viewpoints to synthesis virtual viewpoint images, in order to reduce the storage requirement and the transmission bandwidth load of glasses-free 3D display devices. However, the current main virtual viewpoint synthesis technology because of its poor first imaging complex post-image restoration algorithms is needed to deal with image artifacts, hole fillings and so on, which make it difficult to achieve real-time display; while at the same time to meet the real-time and cannot meet the more clearly image quality. In view of this situation, we propose a virtual viewpoint synthesis technology based on light field theory, such technology has better real-time capability, and a higher image quality without post-image restoration work, and lower computational complexity.Research work in this paper include:First, the current virtual viewpoint synthesis technologies are reviewed by comparative analysis of the current limitations of the virtual viewpoint synthesis techniques, such as poor real-time capability, a low one-time imaging quality; because of these drawbacks we choose to research on virtual viewpoint synthesis technology based on light field;Then, a light field reconstruction method based on camera array is proposed, including camera calibration works, light field reconstruction algorithms, frequency domain resampling to simplify the virtual viewpoint synthesis computational complexity, and to solve the large amount of information a light field contains, a data compression algorithm is select based on current studies focus on light field compression;Finally, experiment on real-time and imaging quality is conducted in this paper while the effects on real-time and imaging quality after the light field is compressed is also studied in this experiment. At last, a comparison between a DIBR virtual view synthetic work and our proposed method is also conducted.Overall, based on the work of previous research, this paper proposed a real-time virtual viewpoint synthesis technology based on light field, and the computational complexity is effectively optimized by resampling in frequency domain during the virtual viewpoint synthesis process. Finally, the validity of the proposed method is verified by experiment.