With the living standards improve continuously, a variety of embedded devices work into people’s lives gradually. Smart phones, PDA, etc. have now become an integral part of life. With the comprehensive coverage of the3G network, a comprehensive upgrade of the transmission rate, using the terminal mobile devices for remote video surveillance has become the new hot point of the monitoring field.This paper studies the H.264video decoding, audio and video data transmission of RTP technology and audio and video playing synchronously in the streaming media technology. On this basis, Design and implement a mobile real-time monitoring system on the Android operating system. Main completed work and achievements are as follows:First, implement the audio and video data network transmitting by RTP/RTCP. According to the practical application, simplify the standard RTP/RTCP protocol. Under the premise of no more than the network MTU size, design different encapsulations. For the real-time requirement, the transmission uses RTP/UDP/IP architecture. To receive the audio and video data, design2FIFO linked lists as buffer for reordering, also for the video frame assembling. Use an improved algorithm based on AIMD for traffic and congestion control to guarantee a certain QoS.Second, the public network server uses a database to manage customer information, uses the mechanism all sessions of the same user manage centralized to forward the audio and video streaming correctly between different users.Third, on the Android platform implement the H.264video decoding and playing with the audio synchronously. Transplant ffmpeg H.264decoding part to the Android platform. Video decoded in the monitoring node through the JNI technology. Design a way of communication between the threads for audio and video playing synchronously based on the RTP timestamp.In the end, test the system on the tiny6410development board. The result verifies that the program using a public network server to forward the audio and video streaming for real-time monitoring between different LAN terminals is feasible. Also propose the next step of the work. |