Research And Implementation Of Digital Production And Display For Cultural Relic Based On Mixed Reality

Cultural relics bearing splendid civilization,inheriting history and culture,maintaining the national spirit,is the precious historical and cultural heritage of mankind.Because of its own fragile,it has become an international consensus to digital protection them.At present,a large number of digital resources of cultural relics have been accumulated in the field of culture,but their production and display are still in the primary stage.There are some urgent problems to be solved,such as the single means of processing and displaying the cultural relics digital resources,and the difficulty of obtaining personalized cultural experience.Therefore,this paper makes use of the powerful Mixed Reality technology to study from three aspects:assets processing,content production and exhibition of cultural relics digital resources.In this paper,a new method of assets processing is put forward,and a cross-platform multi-device shared experience function under illumination consistency environment is realized.Finally,the digital production and display system is developed.The main work of this paper includes:(1)A method of model patterns flattening extraction and replacement based on rendering sampling is proposed.Using this method,the patterns on the surface of the model can be flattened and extracted to be a 2D picture or replaced to generate a new 3D model.(2)A method of illumination consistency based on device posture and image vision is proposed.Using the data provided by sensors and cameras in the display device,the reflective information of the device in the realworld environment is constructed,and the global alternative light source is estimated.(3)A shared experience method based on coordinate system synchronization is proposed.Aiming at the low popularization rate of Mixed Reality display devices and the difficulty of multi-person experience in digital display project of cultural relics,a method of crossplatform multi-device sharing interactive experience in the same Mixed Reality space is designed by using the theory of virtual world space alignment.(4)A digital production and display system for cultural relics has been designed and realized.Using Unreal Engine to integrate the model patterns flattening extraction and replacement method,illumination consistency method and shared experience method,provide the dual interface of traditional programming mode and node-based visual script,and develop a system that provides the functions of assets processing,content production and exhibition of cultural relics digital resources.In this paper,illumination consistency and shared experience methods are proposed to optimize the path of Mixed Reality technology and solve the problem of single display means.The flattening extraction and replacement methods of model patterns are proposed to expand the processing methods of assets.Based on the theory of Mixed Reality perception,this paper proposes a method of seamless integration of space,interaction and illumination consistency,solves the challenge of making,interacting and displaying on portable display devices,and has a good application prospect in digitization of cultural relics.