| Recently, general purpose processers and embedded processors have formed a trend of multi-core cooperative and hardware-accelerated computing. Heterogeneous multi-core processors integrated with different cores of various architecture and performance are widely used in intelligent monitoring, intelligent transportation and other audio and video processing fields because of the high performance and low power consumption. Heterogeneous multi-core processors’ performace dependes on the communication and collaboration between cores and which is researched in this thesis based on TMS320DM8168. And then a multi-channel and HD video and audio processing system is designed based on co-processing of multi-cores.Firstly, the advantage of heterogeneous multi-core processors in HD video applications is analysed, and then the solution of video and audio multi-core co-processing is deliverd using TMS320DM8168.Secondly, the communication mechanism between heterogeneous multi-core processors including the ARM Cortex-A8, DSP and two M3 cores is intensively studied from the hardware level to the drvier and software level. Then the inter-processor communication software is designed based on SysLink module and Inter-Processor Communication module.Thirdly, a multi-channel HD video and audio processing system is designed and implemented. The system achieves two channels 1080 P 60fps video acquisition, preprocessing, coding, display, real-time transmission and can be controled by user using Boa.Fourthy, collaboration in heterogeneous multicore audio and video processing is researched. Audio capture based on Linux ALSA framework and collaborative coding is designed. OSD overlay method is proposed based on font file and multicore processing. Additionally, scene change detection and motion detection are implemented by the collaboration of several cores.Finaly, the performace of Sys Link, IPC and the system is tested. The results show that the system completes complex audio and video precessing tasks using the efficient multi-core communication module. The system is stable and has good reference value for heterogeneous multi-processor applications in audio and video processing. |
PDF Full Text Request