Reseach On Multi-viewpoint Video Conversion System Based On FPGA

In recent years, naked eye 3D display technology, which does not require the viewer to wear any auxiliary equipment to experience the 3D display effect has become a hotspot in the research of display industry. The defects of 3D sources seriously restrict the development of 3D technology. Currently, there are mainly two kinds of 3D sources: two viewpoints sources and multiview sources.Two viewpoints sources which can produce a 3D effect is based on the premise that the viewers must face the screen. Traditional viewpoints sources which can produce a 3D effect is based on the premise that the viewers must face the screen.Traditional multiview sources which is made by several cameras working synchronously can present realistic 3D effect. But the cost is also extremely high. Therefore, this will be a great boost to the development of 3D display technology, if we can convert two viewpoints image into multiview by using a more economical way.In this paper we build a system to convert two viewpoints image into multiview based on FPGA. There is a practical significance to promote the development of naked eye 3D display technology by using hardware method to reduce the cost of traditional multiview sources. In the conversion of 2D to 3D, the stereo matching has been a key issue. TAfter analyze various matching algorithm, we choose scale-invariant feature transform to realize the feature matching. This paper presents the Gaussian pyramid modules of the algorithm.In this paper we design the hardware circuit of the viewpoint conversion system. By comparing a variety of interfaces, we choose the HDMI as the input or output interface. The hardware system consists of HDMI input and output modules, FPGA, DDR3 memory and peripheral circuits. We use FPGA to control the entire circuit including the implementation of the algorithm, the configuration of input and output modules. DDR3 memory is mainly used to store image data, acts as a cache.Software design includes the I2 C controller configuration of the input and output modules and the design of multi-port DDR3 controller. Multi-port controller can achieve fast communication between FPGA and DDR3 memory, making the system achieve real-time processing.This simulation software, we using, is Xilinx Vivado Development Kit.Vivado is Xilinx’s new development tools.The core of the tools is IP core, it has solved the bottleneck of integrated design, accelerating the design of FPGA.Multi-viewpoint image can expand the range of viewing 3D effect, the viewer can watch the 3D effect in a larger perspective. It has practical value to the development of 3D technology.