Multi-view 3D Image Acquisition System Based On Structured Light

Vision is the most important source of information for human beings. With advances in electronic and information technology, the importance of image acquisition and display technology in conveying information to our vision system is ever prominent. Image acquisition and display technology have greatly extended our vision, enabling people to see things that can’t be seen with naked eye, such as instant galaxy, micro world and the ability to see though our own body.However, the physical world that we are living in is a 3D world, while the traditional 2D image acquisition and display technology have limited our perception capability. The emerging 3D Imaging and 3D display technology break he limits of traditional 2D imaging and display technology, greatly enhance our ability in information acquisition and comprehension. 3D endoscope contains most of the 3D technology which represents the future medical technology trend.3D image acquisition and display technology are quite popular and they are an inseparable whole. 3D image’s acquisition is the major source of content for 3D display, while the acquired 3D images can’t be accurately presented without 3D display. We focused on multi-view 3D endoscope technology, firstly structured light is introduced and analyzed, secondly we introduce the 3D reconstruction technology based on multi-view image and show the result by studying the method of camera calibration and the principle of light field, finally we introduce a new design of multi-view 3D endoscope and realize 3D acquisition and display. We also launch a new type of endoscope magnetic guide control technology.We implement a multi view 3D endoscope system, including the design of micro structure light which suits for endoscope, camera intrinsic parameters and extrinsic parameters based on calibration of multi camera, multiple field of image acquisition, image matching algorithm based on SIFT, dense 3D point cloud generated by patch based multi view stereopsis, the display of light field picture or reconstruction result on volumetric 3D display system and multi-view light field display system, the magnetic guide system of endoscope.The system performed well in animal experiment including the performance of multi-view picture acquisition and 3D reconstruction, the controllability of control system. Some quality index even reaches the requirements of clinical medical which can provide effective reference for the 3D endoscope clinical trials. The system helps the future medical instrument and promote the replacement of 3D endoscope to original endoscope, even provides a reference for future VR surgery.