Font Size: a A A

Real-time Stereo Imaging Research And Implementation Based On FPGA Binocular Camera

Posted on:2019-01-15Degree:MasterType:Thesis
Country:ChinaCandidate:L J QianFull Text:PDF
GTID:2348330545477897Subject:Electronic and communication engineering
Abstract/Summary:PDF Full Text Request
As a new imaging technology,binocular stereo imaging technology has more advantages than traditional two-dimensional imaging technology.It can not only perceive the plane information of two-dimensional imaging,but also show the depth information of the image more.With the rapid development of microelectronic technology,people's pursuit of imaging resolution is getting higher and higher.In this high resolution image data,the traditional software digital image processing speed has been unable to meet the demand.This paper adopts FPGA hardware parallel processing advantage and optimized image processing algorithm.Around in the process of binocular stereo imaging image acquisition,image synchronization,image processing,video signal decoding and auxiliary stereo display technology research,and put forward a complete set of binocular camera collection without auxiliary stereo imaging implementation scheme.The model of binocular camera is established by analyzing the process of human stereoscopic vision,and the mathematical model is established for the imaging process of binocular camera.After the detailed analysis of binocular camera imaging model,determine the advantages of parallel optical axis binocular stereo camera imaging model,and studies the camera calibration in the necessity of the binocular imaging process and calibration method.Stereo display as an important technology of binocular camera imaging,this topic through the analysis of the differences of auxiliary stereo display and without auxiliary stereo display,determine the without auxiliary stereo display technology scheme based on grating.The difference between vertical grating and tilt grating is briefly described.Because of the low utilization ratio of the grating to the display backlight,this project has studied the feasibility scheme of straight down backlight,and proposed a straight down backlight design method.As the core part of the imaging system of binocular camera,image acquisition needs to study the process of image acquisition and hardware implementation.In this paper,the OV5640 image sensor is adopted,and the structure module of binocular camera and the connection of hardware circuit are designed in detail.The control waveform of image sensor is verified by experiments,and several 'image coding formats and mutual conversion algorithms are studied.After analyzing the two interface forms of image sensor transmission data,the image acquisition terminal is determined to transmit the RGB565 encoded format image in the form of DVP parallel interface.Stereo image processing is the research focus of this project.The two digital images collected by the binocular camera will be displayed in the final three-dimensional display,which needs to be processed by image storage,synchronization,transformation and three-dimensional fusion.Theoretical analysis of the two digital images in DDR3 stored procedures to realize the synchronization scheme.Image transformation image compression is the main research,translation and splicing,the mathematical model and image transformation mathematical model combined with hardware logic,stereo image processing parallel logic implementation using FPGA hardware acceleration.In the process of stereo image fusion,a fusion method based on FPGA internal BRAM separation storage image data and image synchronization signal is studied.Compared with the traditional image fusion method,the stability of the system is greatly improved.In this paper,we focus on the principle of TMDS coding algorithm and realize the TMDS encoding transmission of video image signal through FPGA logic.For the final display panel interface signal conversion,a hardware conversion method of DVI signal interface and EDP signal interface is proposed.Finally,the feasibility of the overall scheme is verified by logic on FPGA hardware platform.Using the real-time parallax adjustment technique of image translation,the binocular camera has no auxiliary stereoscopic display.
Keywords/Search Tags:binocular stereo imaging, Camera calibration, Three-dimensional fusion, Video signal encoding and decoding, No auxiliary stereoscopic display
PDF Full Text Request
Related items