Research And Implementation Of Key Technologies In The Integration Of Multimodal Dynamic Content With Panoramic Roaming

Panoramic roaming technology is a dynamic display technology based on image rendering,which enables the viewer to interactively appreciate the real content of the scene from multiple angles,and provides an immersive view.Panoramic roaming system provides the visual operation flow of creating,editing and publishing panoramic roaming,but there are still some problems to be solved in the system.From the aspect of function,the system can not cover all the requirements of the panoramic roaming life cycle,and can not provide effective automatic processing capability for the image restoration process before panoramic rendering.In addition,the display of panoramic roaming is mostly the superposition of static content,lacks of diversity of dynamic display form.From the aspect of performance,in the face of the influx of multi-user traffic,the system lacks scalability and is hard to deal with the performance pressure in the case of high concurrency.Therefore,this paper puts forward the following three parts of research work.(1)In view of the problem of the contamination in the tripod area of panoramic roaming,the restoration method of panoramic roaming pictures is proposed,which could realize the automatic and visual repair of the contamination in the tripod area of panoramic roaming pictures,and it avoids the original problem that the panoramic roaming is blocked and the angle of view is restricted.This method improves the intelligent management ability of the system.(2)In view of the static and single display form of panoramic roaming,the integration method of multiple dynamic contents with panoramic roaming is proposed.For the embedding of video dynamic content in panoramic roaming,the background content of the pure color background video can be automatically eliminated,and the video can be seamlessly integrated with the panoramic roaming scene.For the embedding of dynamic content such as 3D model and live broadcast in panoramic roaming,a dynamic media layer is proposed as a transition method between the dynamic content layer and the panoramic roaming layer,which could realize the interactive embedding of the 3D model and the smooth integration of live content.(3)Design and implement a high performance modular panoramic roaming system.This paper improves the modular deployment of the panoramic roaming system,realizes the load balance of the system and the lateral expansion of the server,and also performs OSS cloud storage and CDN acceleration processing for a large number of static resources to improve system performance.Based on the innovative research of the above three aspects,this paper improves and upgrades the original system,designs and implements an automatic,intelligent,dynamic high-performance panoramic roaming system,and tests the system from the function and performance.The test results indicate that the system could achieve the desired effect of automatic repair of the contamination in the tripod area,seamless integration of a variety of dynamic content with panoramic roaming,and improvement of performance.