Multi-channel Ultra-High-Definition Video Acquisition And Transmission System Based On CMOS Image Sensor

With the rapid development of technologies,such as 5G communication and artificial intelligence,it is the trend that UHD video regarded as the main carrier of future information presentation and dissemination combines with medical health,assisted driving,and security monitoring.Because the traditional video acquisition way through single video source and video compression transmission can't meet a number of application requirements,this paper designs a set of multi-channel UHD video acquisition and transmission sytem based on CMOS image sensor.The system regards CMOS image sensors as video acquisition elements and integrates 10 Gigabit Ethernet communication technology to achieve long-range real-time transmission of uncompressed UHD video.The hardware system includes two printed circuit boards,a sensor daughter board and a core processing board.The ZYNQ-7000 SOC integrated FPGA and ARM architecture is used as the core processor.The system supports 4 channels of CMOS image sensors and 2 channels of 10 Gigabit Ethernet.The maximum video transmission bandwidth can reach 20 Gbps.The hardware platform contains 14 power modules,818 components,and 2963 signal networks,including 4 pairs of SFP+ signals with a transmission rate of 10.3125 Gbps,60 pairs of MIPI D-PHY signals with a maximum transmission rate of 1.5Gbps,and 32 DDR3 data signals with a transmission rate of 1066 Mbps.During the design process of this system,the problems of signal integrity,power integrity,and electromagnetic compatibility are fully considered.With the help of theoretical analysis and simulation,the hardware design of the 10-layer core processing board and the 4-layer sensor daughter board are completed.The software system includes three parts: FPGA programmable logic,ARM program,and host computer interface program.They are developed in three languages,namely Verilog HDL,C,C#.FPGA programmable logic is the core of the software system,which realizes video receiving and decoding,video display,network communication and so on;ARM program is responsible for parsing host computer's instructions and controlling image sensors' working modes;the host computer interface program is a WPF application based on the.NET Framework,which is used to control the hardware platform remotely and to realize the real-time display of UHD video and the storage of video frames.In conclusion,the hardware and software described in the paper are independently designed,so it is original.This paper proposes solutions for image sensor testing,security monitoring and telemedicine and other application scenarios.