Efficient Segmentation And Reconstruction Of 3D Objects

It is possible to use 3D reconstruction technique to get rid of complicated human interaction of the traditional 3D modeling method, and make 3D modeling process more simple and convenient. There is also a wide range of applications occurred in 3D movies, computer games,3D measurement, etc.Our paper proposes a 3D reconstruction method. We first apply the fast video segmentation to the input image sequence and get a rough 3D model reconstructed by stereo vision method as the prior, then reconstruct the final 3D model with Visual Hull method. Our method could reconstruct accurate 3D model with very few human interactions and make up for the drawbacks of stereo vision 3D reconstruction method due to its poor texture information, self-occlusion, etc. Specifically, our main contribution includes the following aspects:1. Taking use of the initial low-precision 3D model projection mask as the shape prior, we achieve high performance interactive image segmentation. We first extract the local windows on projection mask’s boundary, then use the local window segmentation method which combines the color information with the projection shape information. After this step, we get the good segmentation results. Furthermore, we can achieve accurate segmentation results with very few user interactions.2. By using both the propagated mask and the projected mask in a linearly weighted way as the shape prior, we could still get good segmentation results even when the propagated mask is inaccurate due to loss of feature points3. We extend GrabCut, a two-dimensional image segmentation algorithm, to 3D space. In our 3D GrabCut algorithm, we take advantage of 3D vertex’s distance information to calculate the weight in Graph Cut. Using this method we can acquire robust 3D scene segmentation results.4. Based on the above techniques, we build an interactive segmentation platform for image sequences, and combine the segmentation results to reconstruct the 3D model with Visual Hull reconstruction method. In addition, we also set up a 3D scene editing platform, with which we can edit 3D scene interactively.