| When traditional offline meetings cannot be carried out smoothly due to venue,transportation,epidemic and other conditions,the demand for remote meetings is increasing,and mainstream remote conference forms include teleconferencing and online network video conferencing,which to a certain extent enable participants to interact face-to-face and share meeting documents.At the same time,with the continuous progress and development of information technology means,panoramic VR technology is gradually popularized and applied,users can interact with the real environment simulated by the computer through simple operation,and use its immersive environmental experience and three-dimensional simulation of the space environment,which has great development prospects in some industries,cultural tourism and other industries.Some people propose to combine VR technology with real experience effect with the concept of the conference,so as to change the monotonous interaction between participants and two-dimensional screens,but at present,most of them rely on VR hardware equipment conference systems,so far it is difficult to popularize the application;At the same time,as a conference scenario,the identity of the host is indispensable,and the concept of "virtual host"proposed by most live broadcast platforms can synchronize the host’s behavior information and language information.Therefore,based on the research of the above problems,a scheme of applying the functions of digital human and real-time conference to the VR panoramic roaming of the Web page is proposed,so that the combination of WebVR and realtime conference technology can give full play to the advantages of the two technologies to play a "1+1>2" effect.The main research work of the thesis includes the following:(1)The design scheme of applying the real-time conference environment to the panoramic environment is proposed.From generating a panoramic environment,editing the panoramic environment and visually editing the information of the conference hotspots,to sharing the panorama to invite users to participate;For the embedding of dynamic content such as digital human models and conference files in the panoramic environment,a transparent media layer is used as a transitional means between the content layer and the panoramic roaming layer to realize interactive embedding of the model.The conversion of two-dimensional plane coordinates to three-dimensional spherical coordinates is used to realize manual drag-and-drop editing hotspot positioning in the panorama.(2)The pose information flow of the digital human model in the realtime conference scenario is collected and synchronously transmitted to each browser.In order to realize the effect of synchronizing the host’s actions and audio information in the real-time conference and transmitting them to other web-end users,the mediapipe algorithm is used to complete the collection of body feature point actions and drive the movement of the 3D model,and the attitude information of digital humans is encapsulated into transmittable data streams and audio streams by webRTC.In the communication transmission processing of the conference,server forwarding and P2P-based multi-user communication transmission are combined to achieve efficient information distribution and transmission.(3)For complex conference scenarios,the system optimizes the functional design and supports the system performance of high access.This topic optimizes and improves the panoramic projects with many hierarchical scenarios from visual editing grouping to display grouping,and solves the problem of grouping information occlusion in large-scale conference scenarios.Based on the innovative research of the above three aspects,the original single panoramic roaming system is optimized and upgraded,and the real-time conference function module that supports virtual digital humans is realized,and the system performance optimization is completed and tested for the performance and function of the system. |
