Research And Realization Of H.264Real-time Streaming Media Mechanism Based On RTSP

With the rapid development of the Internet and the widespread popularity of multimediatechnology, streaming media transmission technology based on network has been widely used.Such as video calls, video surveillance, video on demand, webcast, telemedicine and so on.However, the Internet is only a "best effort " service, in the course of the video transmission,because of the network delay, unstable bandwidth and the low encoding efficiency, it is easyto cause the loss of data packets, resulting video playback distortion and other problems, so itis necessary to research an effective real-time streaming media solutions to solve theseproblems. Based on the live555secondary development, this theis realizes a RTSP-basedH.264protocol real-time streaming media transmission system, on the use of FFMPEG andefficient H.264codec technology as well as RTSP and RTCP/RTP efficient networktransmission strategy.First, this article introduces the related technologies of streaming media and researchsthe network transport protocol deeply, chooses RTSP, RTP, RTCP protocol as the networktransport and control protocols, H.264and AAC as the main video, audio codec standard.Second, streaming media solutions are compared to select the live555and FFMPEG asthe main technical framework. On the basis of the brief analysis of live555library, FFMPEGlibrary and the Android system architecture, this article proposes a general framework for thesystem, and introduces the main modules of server and client briefly.Third, a detailed analysis of real-time streaming media server scheme is achieved usingRTCP technology to solve the problem of congestion control in real-time transmission process,due to Live555does not support client upload, MP4document issued, real-time forwardingand other issues, carring on a secondary development on Live555, completing the function ofthese additional modules, and a multi-process extension.Then streaming media client programs are described in detail, by transplanting FFMPEGon the Android platform, combined with Anroid API, develop a mobile client that supportsboth RTSP uploading and RTSP playback, through the use of buffer queue and timestamps toresolve audio and video synchronization and playback problems. It also introduces thespecific implementation of the audio and video capture module, audio and video codingmodule, the MP4file parsing module of client, audio and video decoding module, audio andvideo playback module, audio and video synchronization module.Finally, the hardware and software environment of the system are introduced, and related tests are done on streaming media server and client, test results show that the system hasgood real-time performance and transmission quality.