An Application For Shaanxi Opera Face Changing

In 2006 Shaanxi opera was included in the first batch of national non-material cultural heritage list,however, Fewer and fewer teenagers care about Shaanxi Opera. Outstanding historical cultural art form should be inherited by the later generation, but not forgotten or abandoned. To protect the Shaanxi Opera by Digitizing, make Shaanxi Opera more attractive and interesting for teenagers, this paper adopt three-dimensional reconstruction and face mapping technology, design and realize of the simulation of the "Shaanxi opera face changing".Firstly, do the requirement analysis and the overall design of the software and divide it into four functional modules:Face-oriented 3D reconstruction image acquisition module, face image feature extraction and matching module, based on the multi-view picture of 3D facial reconstruction module and texture mapping-based Shaanxi opera face changing modules. Each module is designed and implemented in detail, and the algorithm is studied. The main research includes:1) The technology research of face-oriented 3D reconstruction image acquisition:we can get the photos of the same person from different angles by mobile phone camera, also can use the method of user inputting to load face photos of multiple angles.2) The research of 3D face reconstruction based on the multi-view picture:Firstly, calibrate and match the feature points of the acquired face images from multiple angles. Secondly, do sparse points cloud reconstruction on the obtained feature points by SFM algorithm, based on which do the dense points cloud reconstruction by PMVS algorithm to get the three-dimensional point information of face. In the end, the surface reconstruction is in need of being done on the basic of the point cloud model of the object to get a specific three-dimensional grid model.3) The technology research of Shaanxi opera face changing based on mask mapping:By taking the automatic texture mapping algorithm, the face image is mapped to a specific reconstructed three-dimensional grid model of face to get a three-dimensional face model.Then according to different types of masks chose by users, the Shaanxi opera masks will be mapped to a three-dimensional face model, simulating the effect of Shaanxi Opera face changingExperiments and test results show that the systems can achieve the desired objectives by the trial effect.