Research On Theory And Logic Algorithm Of Panoramic 3D Image Sensor

The naked-eye 3D technology is a photoelectric display technology that can watch stereoscopic images without wearing any visual aids,and can obtain a strong sense of realism and immersion.For 3D video acquisition and industrial application of naked-eye 3D technology,this paper proposes a panoramic 3D image sensor(also called "omnidirectional 3D image sensor")and conducts related technical research.The omnidirectional 3D sensor is designed according to the principle of human eye bionics.It has the functions of adjustable angle of focus and adjustable focal length.It can simultaneously acquire stereo pairs of parallax images in the four directions of front,back,left,and right.Framed video as output.The main tasks are:(1)Based on the principles of human eye bionics,establishing a 3D image sens or optical model.Analyzing the principle of human eyes to obtain stereo vision,based on which the paper is to build a panoramic 3D image sensor,Discuss the role of the angle adjustment structure when viewing 3D images at different distances and discuss the video output format of multi-eye 3D sensor.(2)An omnidirectional 3D image sensor hardware structure system was constructed to verify the validity of the design idea and logic algorithm of the omnidirectional 3D image sensor.According to the existing resources,the core board and expansion board are established as the system development platform,and the core board is used to process video data stream.The expansion board integrates four sets of binocular cameras,a VGA interface and a core board slot to capture images.According to the image resolution,the size of the acquisition bandwidth is calculated,and the appropriate model of the CMOS sensor and the model of the hardware such as memory are established.(3)Designing a logic algorithm for the panoramic 3D image sensor based on the system function requirements.The system is divided into different modules according to their functions,and the core algorithm of each functional module is designed,focusing on how to use FPGA to realize the synchronous control of high-frequency data streams and multi-image same-frameimage stitching algorithms.Specifically,the 3D sensor's synchronization control includes CMOS register configuration synchronization,image synchronization acquisition,and data synchronization transmission as the research contents.The control algorithms and the implementation process are explained.And then the advantages and disadvantages of the two eight-mesh same-frame image stitching algorithms are compared.Finally,the internal image stitching of the memory is selected as the generation method of the 3D video output format.The theory and logic algorithm of the panoramic 3D image sensor have important research significance.It also have potential application requirements in the fields of 3D video technology,3D monitoring,and 3D environment modeling.In this paper,the theory of the panoramic 3D sensor and the logic algorithm in it are studied in detail.At the same time,the feasibility and correctness of the algorithm are verified through experiments.