Design And Implementation Of Embedded Live Broadcast System Based On Panoramic Video

With the development of communication technology and the rise of virtual reality technology,panoramic video live broadcasting has gradually become popular and outdoor.Although the current image stitching algorithm has been developed for a long time,real-time stitching for panoramic video still has great limitations.Although server real-time stitching can barely meet the live broadcast standard,for outdoor live broadcast and mobile panoramic live broadcast scenes,server systems often cannot meet the requirements.Therefore,this article considers implementing a panoramic video live broadcast system in an embedded system to meet the mobility of the live broadcast scene.This paper designs and implements an embedded live broadcast system based on panoramic video.The system uses a panoramic camera composed of multi-channel fisheye cameras as the video capture device,and completes the functions of video processing,video decoding,image stitching,video encoding,and video push in an embedded system based on Hi3559AV100,and provides concurrent access to streaming media servers.There are fewer problems,and the live content distribution network is designed to meet the access needs of more users.The main work of this paper includes the following contents:1:Obtain the video stream of the network panoramic camera through FFmpeg,and decapsulate the video frame.2.Based on Hi3559AV100,it realizes multi-channel video parallel decoding,real-time panoramic image stitching,panoramic image video encoding,and completes real-time panoramic video production in the embedded system.3.Complete video push based on RTMP protocol in embedded system.4.For streaming media servers,a live content distribution network is designed based on server clusters,and the dispatch server distribution mechanism is dynamically adjusted based on the weighted least connection algorithm combined with the performance data of the servers in the cluster.The final test results show that the system can handle real-time stitching of four-channel video and the splicing quality is good.The resolution of panoramic video can reach 3840X2160,and the video frame rate meets 25fps,and the live broadcast delay is 2-3s,so this system can meet the performance requirements of panoramic video live broadcast.The live content distribution network can complete the forwarding and pushing of live streams and the distribution of user requests,and can guarantee the viewing experience of connected users when multiple users access it.