Research And Implementation Of Network Video System With Encrypted Transmission Based On Gstreamer

With the rapid development of multimedia technology and computer network technology, real-time stream media technology has been widely used, such as video conference, webcast and surveillance system. With the spread of streaming media technology, higher requirements are raised, and among them, safety is an important one.The thesis develops a real-time video transmission system based on the OMAP(Open Multimedia Application Platform) 4460 on PandaBoard ES development board, using Gstreamer as its development framework. An embedded Linux operating system is migrated to the hardware platform and software platform based on Gstreamer multimedia framework. The video capture module is based on the framework of the V4L2 driver, and the video encoding using H.264 coding standard. RTP/RTCP protocol is chosen to transmit data. This thesis proposes two video encryption schemes for different applications: one of them is based on H.264 NALU payload with higher security, the other is a good real-time performance scheme based on the DCT coefficient and motion vector. Encryption using AES algorithm’s OFB mode. Key stream buffer pool is introduced to the encryption module in order to store key stream, which can improve the response rate of the video encryption and ensure real time of the system. What’s more, the encryption module use key stream synchronization mechanism based on a key stream buffer pool so that NAL units can be restore although some NAL units are lost. System server and client key exchange are conducted on mutual authentication TLS so that the security of key exchange can be ensured. At the end of this thesis, the entire system functions were tested, system can meet the real-time and safety requirements of general application and easy to maintain and extend.