Key Techniques Study On Scene Image Mosaic

Image based rendering (IBR) has been the most important and rapid developed techniques in the computer graphics and virtual reality fields these years. Image mosaic which is one of the hot topics of IBR also becomes research interests of many researchers in the image processing and computer vision fields. It's application covers the areas of virtual scene construction, remote sensing, medical image and military affairs etc. However, there are still some difficult issues need to be studied further, included new optimization methods for image registration, new accelerating methods for image stitching etc, which are the main topics of this thesis.First, as the precision and automatic degree of image mosaic suffers from the algorithm of image registration, A new image stitching optimization method based on maximum mutual information is presented in this thesis. The main idea of the new method is to combine PSO algorithm with wavelet multiresolution strategy and parameters of PSO are adapted along with the resolution of the images.The experiments show that this method can avoid registration process to get stuck into local extremes in image interpolation operations and finds the optimal exchange through limited iterations computation, and obtain subpixel registration accuracy in process of image stitching.Secondly, to solve the problem of image blur stitching when the geometric deformation and the changes of the scale factor among images are serious, a new method based robust features matching is proposed in this thesis. Firest,it searches overlap area between two images by using phase correlation, and then detectes Harris corner points in the overlap areas which are reduced to different scale images by adopting multi resolution pyramid construction. This mothed can solve the Harris arithmetic operator robust characteristics inspection algorithm for the scale effects. In order to improve the running performance of image feature matching, a dimension reduction method of high dimension feature vector is proposed based on PCA. And last the globe parameters are optimized by Lmeds to realize images mosaic. The experiments prove that the methods proposed by this thesis can reduce the computation cost with guarantee of image mosaic quality.Thirdly, reconstruction of virtual scene using unknown viewpoints scenes images are difficulty. To obtain scene mapping images, a new approach is presented in this thesis. It links multi spider network pseudo 3-dimension models built by each scene image together and mapps images based on projection geometry principle to 3-dimension model,and then stitchs images one by one to realize 3-dimension scene rendering. The last each image mosaic area in the 3-dimension model is fused by using of wavelet multiresolution to promote the scene image mosaic precision. The experiments indicate that the virtual scene based on this method eliminates the holes phenomena and can realize the unconstrained smooth virtual scene touring.