Design And Implementation Of A Portable Infrared And Visible Light Night Scene Image Fusion System

Due to the weak illumination intensity of the night scene,the single illumination angle of the auxiliary light source and the uneven illumination brightness,the image information of the detected object in the night monitoring environment is seriously lost.Compared with the night scene image enhancement system with a single visible light image sensor,using infrared and visible light multi-source image fusion technology can greatly improve the utilization of image information,so as to effectively improve the accuracy of the night monitoring system.In order to meet the requirements of portability,low power consumption,rapidity and accuracy in the process of practical application,this paper uses zynq-7020 chip of FPGA + ARM processor to design a portable embedded system of infrared and visible night scene image fusion.First,the infrared and visible light image sensors are used to perform preprocessing operations such as image denoising and image registration on the images collected in different night scenes.According to the characteristics of night infrared and visible light images,the most suitable night scene image preprocessing algorithm is selected.Next,the infrared and visible night scene images are fused through a variety of fusion methods,and the objective evaluation indicators of the fused image and the visualization effect of the image are compared and comprehensively analyzed,and the optimal night scene image fusion algorithm suitable for the hardware platform is selected.Then according to the overall design requirements of the system,select the optimal system development platform is selected,determine the overall design architecture of the system and the functions of each module are determined.The HLS high-level synthesis tool is used to establish the corresponding IP core for the underlying abstract circuit of image acquisition,preprocessing and fusion algorithm.The data interaction between the IP core and DDR3 is carried out by AXI VDMA.The Linux embedded operating system is transplanted on the ARM microprocessor to build a visual user interface.The processed image results are displayed in real time by HDMI interface.The night scene image fusion software system is built by binocular image acquisition module and PC.Finally,the fusion of infrared and visible night scene images is realized by ZYNQ platform.The fused image can retain the contour and background information of the monitoring target at the same time under the complex environment of weak light intensity.When rain,snow,fog and other harsh natural environments occur at night,it can provide a basis for improving the accuracy of night scene monitoring system.