Holes Filling Algorithm Research And Implementation In 2D To 3D

The basic principle of 3D display technology is to produce a stereoscopic effect through parallax.The viewer observes the left view and the right view through the left eye and the right eye and then forms a stereoscopic image with depth in the brain.3D video with its good three-dimensional experience has been widely used in the fileds of entertainment,military and medical.However,the lack of 3D contents limits the promotion and development of 3D technology.DIBR is an important method of 3D contents production,which has the characteristics of good compatibility,high flexibility,high image quality and low cost.The virtual viewpoint image can be synthesized by using the image data and the corresponding depth map.DIBR virtual viewpoint generation is mainly divided into three steps: depth map acquisition and processing,3D transformation,hole filling.Problems due to depth discontinuities and depth inaccuracies cause holes in the virtual view point image.Different depth of field and occlusion in the scene,occluded objects in the current viewpoint may be exposed in the virtual viewpoint can also cause holes.Therefore,holes need to be handled properly,otherwise it will affect the visual experience.Aiming at the problem of hole,on the basis of analyzing and studying the typical algorithm of hole filling,this paper proposes a corresponding algorithm of hole filling.In depth map preprocessing,the depth map is smoothed by bilateral filtering to reduce distortion holes in the virtual view point image.Depth gradient transition processing is adopted to reduce the boundary holes on the foreground and background boundaries with large depth differences in the depth map.Big holes in virtual viewpoints are dealt with separately from small holes,small holes are filled based on improved neighborhood interpolation method.Big holes are filled by using the corresponding information in the original map.In DIBR compositing,deep adaptive processing is used to improve the visual effects of foreground and background boundaries.The peak signal-to-noise ratio of the filled virtual viewpoints and the visual effects are good in the experiments.On the basis of the hole filling of software,the article studies and realizes the hole filling on FPGA hardware platform.Designing gray-scale conversion module,the window template module,hole filling module on Cyclone IV EP4CE15F17C8 Ndevelopment board to achieve hardware holes filling.