Application Of Mixed Reality Holography In The Treatment Of Brain Tumors

Objective:Mixed Reality technology（Mixed Reality,MR）by introducing virtual objects in the real physical world and implement these objects and the interaction between the real world,the technology combined with Virtual Reality technology（Virtual Reality,VR）and Augmented Reality（Augmented Reality,AR）one of the many advantages,which has an attractive prospect in the field of medical^[1].At present,the application of Mixed Reality technology in neurosurgery is still in its infancy at home and abroad,and there are few reports on its application in the treatment of neurosurgical brain tumors.In this study,individualized 3D virtual models of tumors,blood vessels and brain tissues were displayed by Mixed Reality holographic technology for preoperative planning and intraoperative guidance﹑preoperative conversation﹑clinical teaching.Methods:Dicom image data of CT and MRI of brain tumor patients awaiting surgery in the department of neurosurgery of the Second Hospital of Hebei Medical University were collected.The 3D virtual models of tumors,blood vessels and brain tissues in the same coordinate were reconstructed by3D-slicer software,and the 3D virtual models were imported into the Mixed Reality equipment.We evaluated the value of Mixed Reality holography in guiding the treatment of brain tumors by displaying patients’3D virtual models with Mixed Reality holography.Results:The 3D virtual models of 10 patients with brain tumor were reconstructed by using 3D-slicer,and the reconstructed 3D virtual models were imported into the Mixed Reality equipment,and the holographic image of patients with brain tumor was successfully displayed by the Mixed Reality technology.The Mixed Reality hologram is used for preoperative planning and intraoperative guidance,as well as for preoperative conversation,so that the family members can intuitively understand the condition and the corresponding treatment measures,and also for clinical teaching,so that young doctors can better understand the cerebral vascular anatomy and surgical-related approaches.Conclusion:1.Individualized holographic images of patients can be displayed seamlessly and stereoscopically through Mixed Reality technology,which can be applied to preoperative planning and intraoperative guidance.Hololens can be worn by the operator to realize the interaction between virtual and real tumors.It is like having perspective function to have a comprehensive view of the tumors and their surrounding anatomical structures,so as to avoid risk,reduce the surgical complications.2.Mixed Reality hologram can be used for preoperative conversation,doctors and patients’family face to 3D virtual model of holographic image,observe the pathological changes and the surrounding anatomical structure,so that patients’family members can intuitively understand the patient’s condition,the corresponding treatment plan and the possible risks during the operation,effectively alleviate the anxiety of patients’family members,and improve the understanding of patients’family members about their condition and surgical procedures,increase the efficiency of communication between doctors and patients,thereby reducing the contradiction between doctors and patients.3.Mixed Reality hologram can be used in clinical teaching.It enables young doctors to observe the craniocerebral vessels,nerve movement and adjacent areas from multiple angles and stereoscopically.Teachers can intuitively explain the craniocerebral vascular anatomy and related surgical approaches with the help of hologram,so as to improve teaching efficiency and enhance the enthusiasm and initiative of young doctors.