The Research Of FPGA Video Processing Technology On Binocular Stereo Imaging And Display

Stereo vision is becoming a hot spot in recent years, as more and more attention are focusing on Augment Reality(AR) and Virtual Reality(VR). A lot of new applications of Stereo vision are created and proposed in military area, public safety, industrial application, and film and game entertainment. Generally, the computer stereo vision system uses a binocular stereo camera to collect the video. But the binocular stereo cameras vary because the computer stereo vision systems are designed to accomplish different task. And the baseline of a binocular stereo camera has great significance toward the binocular stereo display, as the human brain’s visual cortex treat the distance between human eyes as the optical system’s baseline. So adjustment of the binocular display is necessary to accommodate the brain’s false hypothesis.Firstly, Human stereovision theory is discussed, concluding that binocular disparity plays the dominant roles in obtaining the stereopsis for human, then the relationship between the target’s distance and its binocular disparity. After that, binocular camera’s imaging model is illustrated. Finally, binocular stereo display registration is deduced according to these relationships above. Based on this registration, if the parameters of the binocular camera and the binocular stereo display are known, the adjustment can be calculated according to the distance of the target. So the observer could obtain stereo-vision sense.The distance of the target is indispensable according to the binocular display registration. So a distance measure function needs to be added in this system. To achieve that, obtaining accurate parameters of the binocular camera is the precondition. So Zhang’s camera calibration method is introduced. Besides that, the binocular disparity is essential as well. So this paper discusses SURF to complete feature detection and registration. In order to cut down the calculation and increase the precision in feature matching, epipolar geometry constraint is introduced. After that, a laboratorial system on PC platform is constructed to verify whether the theory is practical.In the last part of this paper, the binocular stereo display and distance measure system is attempted to be built based on the FPGA video process board. The binocular camera drive module and the binocular display drive module are carefully discussed. The realization of SURF is elaborately introduced.