Research On Augmented Reality For Abdominal Minimally Invasive Surgery

As an emerging research direction, Augmented Reality(AR) is an interdiscipline integrated with computer science, communication, computer graphics and other disciplines. AR enables the users to see the real-world environment as well as other virtual information generated by computer at the same time. Surgeons can be able to see the position of the focus with the application of AR in abdominal minimally invasive surgery so that the surgery can be improved. The purpose of this paper is to build an AR system for abdominal minimally invasive surgery. The main work of this paper is as follows:In the aspect of image-guided surgery, different coordinate systems in the binocular vision system are analyzed. Taking the pinhole imaging model, illustrate the theories of endoscope calibration and distortion. As Open CV is used to finish the calibration, epipolar geometry is introduced. In the end, make a brief review of stereo display and make a comparison of different technologies.In terms of preoperative surgical plan, a brief introduction of 3D modeling and visualization is stated. Show the main steps to draw a virtual model in Open GL and make an analysis of model view transformation and projection transformation. After that, the procedure of adding some light in the environment to make a realistic model in the screen is discussed.The function of Human–Machine Interaction is designed to finish the registration and the preoperative information and the intraoperative images are blended to realize AR. An experiment table is built to simulate the image-guided abdominal minimally invasive surgery based on AR. Experiments are conducted on a liver model with the surgical instruments, and the results show that the AR system established here is efficient. The AR system established here can offer guidance for doctor in the abdominal minimally invasive surgery and lay a foundation for the later research.