Design And Implementation Of Panoramic Video Conference System

With the development of information technology and multimedia technology,the application scenarios of video conference technology are becoming more and more extensive.Especially in the environment of the outbreak of COVID-19 in 2020,the major companies and schools have adopted the way of remote video conference and remote video teaching.The application scenarios of video conferences are gradually increasing.In some large-scale conference scenarios,the video collected by ordinary monocular lens cannot meet the needs of video conferences.In this paper,panoramic technology is applied to video conference system.Normally,the resolution of the panoramic video is between 4K and 8K.It is difficult to meet the real-time requirements by directly stitching such a huge amount of data.At the same time,such a huge amount of data in the transmission process can not be sent to the remote client in real time.Based on the above problems,this paper has made an in-depth study on panoramic stitching technology and panoramic transmission technology.The main work and innovations of this article are as follows:1.In order to meet the real-time requirements of the panoramic video conference system,we designed and implemented a panoramic video stitching method based on template image frames.This method uses the parameters in the template file for image registration,which greatly reduces the time consumed in the image registration process.In the image fusion stage,this paper takes advantage of GPU parallel processing to improve the efficiency of image fusion.2.We design and implement panoramic video distribution technology according to the characteristics of human eyes when watching panoramic videos.The system will send the video image around the user’s viewpoint to the client,and the rest of the video will not be sent.This strategy greatly reduces the amount of data in panoramic video transmission process.The system also implements two view selection methods:interactive view selection and KCF prediction view selection.This two methods are suitable for different scenes.3.In this paper,a method for dynamically adjusting the bit rate on SFU architecture is designed according to the network congestion encountered during the transmission of video data packets.According to the network topology of the panoramic video conference system,this method sets a code rate recalculation module on the conference control server,and dynamically adjusts the transmission code rate according to the network bandwidth capacity of each receiving end,so that the transmission code rate is always within the network bandwidth range.4.This paper builds a complete panoramic video conference system and completes the realization of the server and client in the panoramic video conference system.Tested the function and performance of the panoramic video conference system.The experimental results show that the panoramic video conference system has good stability under the premise of realizing the communication function.