Research Of Content-Aware Stereoscopic Image Retargeting Method

With the popularity of 3D display equipments,content-aware stereoscopic image retargeting problem have attracted great attentions in recent years.Content-Aware stereoscopic image retargeting,which commits stereoscopic images to keep image main features substantially unchanged while maintaining stereo effect,can alleviate the problem of 3D visual resources shortage.Different from 2D image retargeting,resizing a pair of stereoscopic images is expected to preserve visual salient contents of input images,in addition to the disparity consistency.This paper summarizes the existing stereoscopic image retargeting method.Based on the analysis of existing methods,two kinds of content-aware stereoscopic image retargeting methods are proposed.Firstly,we summarized the basic framework of content-aware retargeting methods for stereoscopic image,introducing key technologies in the image retargeting process,such as important region recognition and disparity detection of stereoscopic images.And it also summarizes existing methods base on the classification composes of discrete method and continuous method,especially focus on stereo seam carving,intelligent cropping and mesh warping and point out their strength and weaknesses.Secondly,we proposed a 3D Straight-Line preserved retargeting method for stereoscopic images,which introduces straight lines preservation and applies content-aware random matching to the stereoscopic constraints.Specifically,stereo Hot-target map based on disparity map is firstly calculated to detect visually salient contents and obtain 3D straight-lines of original stereoscopic image.Then,content-aware random matching points are introduced as the stereoscopic constraints.After that,each image is represented as a grid mesh and model an energy distortion function.Each quad mesh is scaled to the target size by minimizing total energy function.Finally,the target stereoscopic image is obtained by interpolation and mapping.Thirdly,we proposed a horizontal stereo seam carving method.We analyze the drawback of existing stereo seam carving methods and introduce a novel definition of horizontal stereo seam by introducing visual disparity-based real projection to avoid multiple pixels in each column and occlusion-based projection to stitch seam fragments.Furthermore,based on above definition,we present a modified geometrically consistent stereo seam carving method which not only maintain the effect of existing stereo seam carving method in horizontal retargeting,but also achieve considerable results in vertical cases.Experimental results demonstrate the effectiveness of both methods.