Research On IBR Technology In Free Viewpoint Video System

As the development in technology of computer science and video communication, it’sbelieved that three-dimensional video will be the standard of the next generation video mode.Compared to the traditional two-dimensional video, it can provide third dimension and moreimmersion scene. FVV (free viewpoint video) is a new technology of three-dimensional videowhich has been greatly developed since the beginning of this century. Besides third dimension,another basic characteristic of FVV is interactive, which can let users choose viewpoint freely,and the system will produce the relative frames using virtual view synthesis immediately. IBR(image based rendering) is the most common solution, which is studied well in this thesis. Themajor work of this paper is as follows:To lay a foundation for the subsequent study, the basic theory on homography and camerageometry in projective geometry is elaborated in detail, and the method of image un-distortionby camera calibration is implemented later on.Directing at the application scenarios of arbitrary viewpoint synthesis upon ray-spacerepresentation, a novel method for ray-space interpolation based on affine projection isproposed. It uses affine projection among the image block areas to match and render virtualviewpoint in wavelet transform field. Compared to the traditional BMI (block matchinginterpolation) and DDFI (disparity domain filter interpolation), the proposed method is betterin terms of PSNR and computation time.For the sake of reducing bandwidth and computation complexity and overcome thedisadvantage that the quality of viewpoint synthesis is always restricted to the depth image incurrent DIBR (depth image-based rendering) method, this paper presents a brand-new methodbased on block projection. It uses homography to do projection transform on block area oneby one, which avoids holes and edge ghost producing by view warping directly. Experimentalresults verify the effectiveness of our proposed method.