Research On Video Processing Technology Of Omnidirectional 3D Image Sensor

Binocular 3D image sensor can only collect video images of stereo pairs in a single direction,but can not obtain all-round depth information.Therefore,this paper proposes an omnidirectional 3D image sensor,which can synchronously collect video images of stereo pairs in front,back,left and right directions.After processing by hardware logic algorithm,omnidirectional 3D image sensor can output video images of eight eyes in the same frame,It can also output naked eye 3D video image directly.The main work of this paper is as follows:(1)The spatial layout of omnidirectional 3D image sensor is planned.Four groups of binocular 3D image sensors are arranged in the front,back,left and right directions to form an omnidirectional 3D image sensor with omnidirectional field of vision.The video output format of the omnidirectional 3D image sensor is the left and right format of the same frame with eight eyes.(2)The hardware structure of omnidirectional 3D image sensor is determined.Using modular binocular 3D image sensor and FPGA chip as the main body,combined with DDR2 Memory and video output interface,the omnidirectional 3D image sensor hardware system is constructed,and the prototype of omnidirectional 3D image sensor is completed.(3)The logic algorithm of omnidirectional 3D image sensor is studied.The parallel operation of Verilog HDL is used to realize the synchronous acquisition of video image.The DDR2 IP core is called,and the eight channel and round sequence cache algorithm is used to solve the problem of eight channel video image cache.The eight eyes in the same frame algorithm is designed to realize the output display of eight eyes in the same frame video image,and the pixel rematch algorithm is designed to realize the output display of naked eye 3D video image.(4)The experimental research of omnidirectional 3D image sensor is carried out.In the static scene experiment,the omnidirectional 3D image sensor can accurately display eight eyes in the same frame video image or naked eye 3D video image,which verifies the correctness of the research on video processing technology;In the vehicle experiment,the omnidirectional 3D image sensor can also output eight eyes in the same frame video image,which verifies the stability of the omnidirectional 3D image sensor system.Omnidirectional 3D image sensor can synchronously collect stereo pair video images in front,back,left and right directions,which can play an important role in UAV aerial photography,video surveillance,vehicle navigation,scene modeling and other fields.In the future,it can further improve the video resolution and strive to give full play to the application value as soon as possible.