Data-driven Virtual Indoor Scene Synthesis System

In recent years,with the rapid growth of 3D model resources,data-driven automatic synthesis of indoor scenes has become a popular research problem in computer graphics.In this paper,we build a resource library of indoor scenes and propose an automatic indoor scene synthesis system based on sample scene images as constraints.The system can automatically synthesize virtual indoor scenes with reasonable layout and harmonious colors based on the input sample scene images.The main work of the paper is as follows.1.A virtual indoor scene resource library is established,including an indoor scene database,a furniture model color library and a furniture model material library.We have organized the publicly available SUNCG,3D-FRONT,Structured3 d datasets.In order to establish the correspondence between furniture models and colors,a color extraction tool is designed to collect the colors of furniture and its components in furniture model thumbnails more easily.The paper analyzes and summarizes the research related to virtual indoor scene repository,and illustrates the limitations of the published indoor scene repository and the application prospects.2.A data-driven indoor scene coloring method is proposed.We transform the color assignment problem in indoor scene coloring into a combinatorial optimization problem,establish an energy equation with the color theme of the reference scene picture as the constraint,obtain the color theme of each furniture model by solving the equation,and select the closest material,and finally generate the indoor scene coloring results that are consistent with the desired color theme.3.A novel virtual indoor scene synthesis system is designed.We design and implement a data-driven virtual indoor scene synthesis system by combining the automatic layout of indoor scenes mentioned in the paper with the furniture coloring recommendation method.In this paper,we introduce the functional modules of the system from the perspective of software development and demonstrate the visualization results of the main functions of the system.When users use the system,they need to input a picture of an indoor scene as a reference,and the system can automatically realize scene synthesis with corresponding color themes to help users quickly synthesize 3D indoor scenes with consistent color tones.