Real Time Video/Audio Processing Technique Under Network Enviroment

This paper mainly research the realtime video&audio processing in network. Using the realtime video processing technique, network video transportation technique, device driver design technique and motion dectecting technique to design and implement a realtime video&audio processing system (RTVA).At first the paper studies realtime video processing and motion detecting: we studies the technique of image processing under Linux operation system and gives a method for realtime video processing based on X Window; we also give a method of detecting the movement on video through analyzing the video frames, and give the data structure of implementing the algorithm.Secondly, the paper studies the technique of designing PCI device driver under Linux environment. We proposed a solution to the problem of PCI bandwidth limitation, and designed the driver of real-time video and audio capture card.The GUI interface design technique, real-time transportation technique, audio processing technique are also studied: we study the GUI interface design technique using gtk+, gives a method for threads synchronization between gtk+ main loop and other user threads; we implement long-distance realtime transportation in IP network, emphasize on analyzing the relationship between transportation process and digital compression process, and give an solution of the reader-writer problem when engaging the transportation over long distance.On the basis of technique research, we implement a RTVA System under Linux, give the overall architecture of system; and implement the realtime video&audio processing, the realtime video transportation; device driver; motion detecting and GUI subsystem.