Research On Generation Method Of Comic-like Layout Photo Album Based On Scene Classification

Along with the widespread popularity of digital cameras and mobile telephones equipped with such devices, people can take different kinds of photos through various mobile devices anytime and anywhere. However, with the rise of the mount of images, how to search quickly in hundreds of images and browse the content will become very challenging, which leds to the related study of photo album management become a hot field of research in computer graphics. In order to achieve the goal of rational organization and clear display of the set of images, we present a new photo album management method with comic-like layout based on scene classification, which primarily solves the two core problems of how to organize the images based on the scene and how to clearly display the images. And then we design and develop a prototype system named AlbumCollage based on the previous researches. Generally, the main contributions of this paper reflect in the following three aspects:(1) Image Organization Method Based on Qualitative Analysis. Inspired by the 3D model organization method, we propose an image organization method based on qualitative analysis, which utilizes reliable quantitative numerical distance to deduce the topological relations between images, and then uses these topological relations to organize images into a hierarchical structure through qualitative analysis. We first calculate the quantitative numerical distances between images under multiple features of images, such as Color feature, SIFT feature and GIST feature, quantitative numerical distances under the different features depict the similarity of images under different features. Then under each feature of image, we deduce the effective quartets through corresponding reliable quantitative numerical distances, the quartets structure could keep the topological relations between images effectively. Finally, we integrate the quartets under each feature of images to create categorization tree through max-cut algorithm under the condition that meets the topological relations of quartets as much as possible, the categorization tree could organize the images effectively and present a hierarchical structure for images. The categorization tree can not only organize the images effectively, but also provide clues for image search and images summary through hierarchical structure. To verify the effectiveness of our method, we carray out experiments to verify the effectiveness of image features in our method and compare our results with mannually created Ground Truth and classical clustering algorithm, the experimetns demonstrate that our method could organize images effectively and lay the foundation for the subsequent research on image collage with comic-like layout.(2) A Generation Method of Photo Album with Comic-like Layout. We propose a generation method for photo album with comic-like layout, displaying the summary content of images in image collage way with comic-like layout. We first decompose the categorization tree which is created in image organization stage into multiple groups of images by the topological information of the tree, and select appropriate image from each group as representation images to make up the summary of images, and sort them in relative order. Then we use the simple hierarchical enumeration method with the universal and intuitive rules of comic to create template libraries, from which to select appropriate templates based on the penalty function that is defined by the simulation of putting representation images into templates. Finally, we optimize the layout of selected template to get collage result with rich layout styles. To verify the effectiveness of our method, we conduct a user survey and several experiments, the experiment results shows that our results can be convenient for the user to search and browse photo album.(3) Design and Implementation of AlbumCollage System. We combine the previous researches into the prototype system of AlbumCollage. From the perspective of software development, we introduce the composition modules of the system and involved data structures. And we illustrate the main function modules of the system through examples. Our system can not only help users to quickly search the desired images and browse the content, but also provides a new experience of photo album management for users.