Research On Infrared And Visible Dual-Band Image Registration Techniques And Development Of Fusion System Based On AM5728

With the rapid development of the image sensor technology,people are eager to see images at night,just like during the day,which consists details and true color at night.Aiming at this goal,using TI's latest AM5728 chip as an image processor,using long-wave infrared and low-illumination visible light as dual-band camera module,A true color system has been developed for image acquisition with the same field of view and simultaneous focus adjustment,image fusion and color transfer.Three related technologies are mainly studied in this system,which includes two-band image registration,image fusion and color transfer to achieve fused image true color.The specific work completed in this thesis includes:(1)For the front-end optical acquisition for long-wave infrared and low-illumination visible images,the optical module is designed to realize synchronous field of view and synchronous focusing function,the field of view can be 45o,and the same field of view is 300 m-?.(2)For close-range infrared and low-light-level cameras,the same field of view is not achieved,design and make a synchronous calibration board,the position relationship between the two cameras can be obtained by synchronous calibration of infrared and low-light-level,convenient for late hardware real-time image registration.(3)For real-time registration,a real-time video registration algorithm based on focal length feedback joint calibration is proposed,calculation of affine transformation matrix by joint focal length feedback,finally,real-time hardware registration is realized,and the DT-CWT wavelet fusion is realized.(4)For color information,the transmission process of true color is adopted,adopt two technical routes,for the infrared image,the improved Reinhard algorithm is used for color transfer,for fused images,an improved Welsh color transfer algorithm is used,and the two types of algorithms are implemented in hardware.(5)Designing Appearance by CAD,and use the 3D printer to print the prototype,after the whole machine is assembled,the system can output low light,infrared or fused color video through the toggle button,and display on a binocular 0.5-inch OLED microdisplay,then enter the human eye by optical amplification at the back end.Realize 1-300 m registration error less than 1pix,speed of 15 fps,800?600 high-resolution video display.