Design And Implementation Of The Real-Time Netwrok Live Broadcast System For MUL-Source Video And Audio Based On RTSP

Benefiting from the development and improvement of network and multimedia technology, streaming media technology has recently become a research hotspot, and widely been applied to many fields, for instance, video conference, video surveillance, remote assistance. In accordance to a certain actual project, this thesis has done thorough research into the network broadcast system, which is armed at dealing with the problem of sharing video and audio from several separated scenes in real time, and enabling multiple scenes to be viewed both in synchronization and in real time. The followed is the main work in this thesis.Firstly, a software solution is put forward for real-time network live broadcast of multi-source video and audio in the thesis. With the method of software technology, multi-channel video streams from multiple sources can be integrated together, and so can audio streams. Moreover, the output integrated streams, including both a video stream and an audio stream, should be encoded and packed according to relevant standards, which ensures several selected scenes to be recorded, stored and released synchronously, and makes them shared through the Internet.Secondly, this thesis has made an analysis and designed the structure of a real-time network live broadcast system based on RTSP for multi-source video and audio. In order to complete the system, requirement is analyzed detaily, which also helps to analyze and illustrate the design of the system structure from whole to part.Finally, the thesis illustrates the implementation of the system above. First of all, capturing both video and audio is completed with capture devices, and the issue of controlling the capture speed is analyzed and discussed. As far as the issue of integrating multiple streams into one, this thesis presents a method for stitching several video images, and describes the method of audio mixing as well. What’s more, with FFmpeg project, this thesis implements some classes, used for H.264 and AAC encoding, and storage. When the RTSP server is talked about, detailed analysis has been made for live555 project. This thesis modifies the project in some degree, and implements a class for H.264 real-time source and another class for AAC real-time source. Besides, the RTSP server platform is implemented. Before sending H.264 and AAC data, the paper discusses how to deal with inter-media synchronization.The system implemented in the thesis has now been being applied to the technology court project of a certain company. Besides, it performs well during the trial running, and reaches the design target.