Ultra High Definition Multi View Stereo Image Fusion System

Multi-view stereo display technology consists of multi-view stereo material acquisition,image fusion system and stereo display devices.Nowadays,the research on image fusion system concentrates in developing fusion program on OpenCV.However,OpenCV needs to configure environment variables and its compatibility between different versions is quite poor,which makes the fusion program difficult to transplant.What's more,limited by computer hardware,when dealing with high resolution(such as 4K)video images,it takes a long processing time.Shortcomings above would hinder the promotion of stereo display technology.Thanks to the progress of integrated circuit technology,the ability of parallel data processing of FPGA chips is strengthened.We can develop multi-view stereo image fusion system on FPGA and integrate it into the stereo display device.Since FPGA is programmable and function scalable,we are able to add new features as long as the chip resources are sufficient.This paper reviews the development of stereo display technology and focuses on the stereo display technology based on LCD.Combining with the theory of image fusion,we propose a sub-pixel level multi-view stereo image fusion system which chooses FPGA as the processing core.The whole system can be divided into clock and reset module,initialization module,color space conversion module,HDMI input control module,HDMI timing generation module,HDMI output control module,UART control module.Clock and reset module generates HDMI output clock and internal reset signal.Initialization module configures the HDMI codec chip registers to work in 4K mode through the I2C bus.Color space conversion module convert the input pixels color space from YCrCb to RGB.HDMI input control module scales the input multi-view stereo images vertically,rotates the images by 90°and then buffers the images into DDR3.HDMI output control module reads out buffered images,conduct sub-pixel level image fusion and transmits fused images and HDMI output timing signals to the HDMI encoding chip.UART control module communicates with the external host,configure or read the value of the registers and switch the image fusion mode according to the host command.To design the ultra high definition multi-view stereo image fusion system,we come through hardware selection,algorithm designing,RTL code writing,module synthesis and image fusion experiment.The system is proved to have the ability of real-time processing as well as high scalable.