Design And Implementation Of Stereo Vision System Based On Panoramic Camera Group

The current VR(Virtual Reality)technology is developing rapidly,and it can be combined with many industries,such as shopping,video,games and so on.Most of the algorithms on the current market for making virtual reality scenes are based on the splicing algorithm.As the stitching algorithm applied to generate VR panoramic information requires a lot of hardware and software,it is costly to be used and the splicing algorithm will always produce some of the details of the failure of splicing scenes.Therefore,this article designs and implements the VR panorama ring stereoscopic vision video system to realize the video viewing experience,it is based on the panorama circular lens.The hardware used in this paper is two panorama annulus lenses.The stereo information is obtained by statically matching the two rectified annular images.The optimization algorithm speeds up the operation,utilize fast weighted filtering to optimize the stereoscopic information,and restores the other eye image.Based on all of these techniques above,we developed our VR visual scene system with panoramic stereoscopic view.The work of this paper mainly includes following parts:(1)Development of Video capture module:Using VS2013 development tools with Qt5 and the ring lens SDK to achieve the control of the ring lens,and make software for lens control.The basic functions of the software include connecting the lens,opening the lens to obtain images,stopping the lens to obtain images,screenshots,video recording,white balance,auto exposure,opening live,stopping the broadcast.(2)The design and implementation of image algorithm for image processing:This part realizes the rectification,stereo matching,filtering,remapping and complementing the holes after acquiring the ring image.Compared with the existing panoramic image acquisition method in the industry,We can get the depth image more quickly and accurately,and get the binocular vision image by remapping and get a good visual experience.(3)The design and implementation of terminal applications for receiving video:it achieves the function that watching panoramic video through live streaming by wearing virtual reality helmet 3D glasses which produced by 3Glasses company.The receiver application includes the production of the eye model,analysis of live streaming and 3G glasses SDK accessing,they work collaboratively for realizing the control of VR helmet to watch films,which can get the appropriate experience.(4)Testing the overall vision system:testing the system functional modules and system performance,verifying the robustness of the system function,and providing a prospect for future performance.In this paper,the stereo vision system based on panorama camera group is tested.The result shows that the system can display the 360° stereoscopic picture quickly and correctly.The system designed and implemented in this paper explores the new method of generating a three-dimensional panorama picture by using a double panorama lens,which is faster than the way of splicing the panorama and does not have the scene violation caused by splicing,takes a key step for the future panoramic ring lens broadcast scheme.