Design And Implementation Of The Webcast System Based On Panoramic Video

In the 21st century,the virtual reality technology has made great progress,and nowadays,the development of panoramic and 3D stereoscopic technology set off a wave of virtual reality.Panoramic technology including virtual reality and panoramic map has been used more and more widely in today’s society.In order to obtain more realistic and visual enjoyment,people increasingly want to see multi-view and three-dimensional video on the web when they need of two-dimensional and single of view video has been met.The panoramic webcast has become an important direction of research development.This thesis designs and implements a webcast systems which is based on 360-degree cylindrical panoramic video.The system gets horizontal 360-degree panoramic video compared with the traditional single-view broadcast through obtaining multi-view video and splicing processing.Then it compresses and transmits the video to the remote users in real time.The main work of this thesis as follows:1)Collect and produce panoramic video.The system uses six XiaoYi cameras to capture live video.Firstly,the camera’s parameters including location and focal length and resolution need to be set,and then use the corresponding parameters to stitch images and get 360-degree panoramic video.This thesis uses improved SURF algorithm to extract and match feature points to meet the real-time requirement,and it uses multithread to deal with multi-view image stitch and fusion in order to speed up obtaining panoramic image.2)Real-time network transmission of panoramic video.Firstly,Because the amount of panoramic video data is large,the thesis uses the H.264 coding standard to encode the original panorama video and audio,and then it needs to synchronize panoramic video and audio;secondly,the thesis designs reasonable and appropriate webcast architecture.The system uses the traditional C/S mode network to transfer and distribute live video,and the terminal users receive real-time video which is send by Nginx streaming server.3)Webcast terminal receives and displays the panoramic video and make interaction with users.It depends on the network transport protocol to receive live streaming which is send by Nginx server,in addition,it use VR equipment 3Glasses to show panoramic video.It enhances user interactivity especially for the three-dimensional panoramic video.The key of system is the matching of feature points of multiple viewpoint pictures and picture stitch to get 360-degree panoramic video,it requires a higher processing speed and good panoramic effect.Through the system test,the delay of webcast is low,which can meet the real-time requirement,and the panorama picture is stitched naturally,at the same time,it makes the terminal users feel immersive and interactive.The system has a high value in the research and application of virtual reality industry.