Virtual Surgery System For Ultrasound Guided Tumor Microwave Ablation

Interventional thermal ablation technology has been widely used in clinical tumor treatment since the 1990s,and many microwave ablation surgical systems guided by ultrasound images and robots have emerged.However,there are still limitations in the clinical treatment of these systems that cannot be planned in a three-dimensional environment,and ultrasound imaging guidance is beyond the scope of the doctor's surgical vision,which limit the improvement of surgical quality.A virtual surgical system developed based on the rapid development of head-mounted virtual display devices will be a new solution to these problems.This article is based on the Microsoft HoloLens head-mounted virtual stereo display device.An ultrasound-guided microwave ablation virtual surgery system was developed using the Untiy3D software,and research was conducted on three-dimensional modeling of surgical lesions,ultrasound image transmission,and surgical path planning,and.In the three-dimensional modeling of lesions,Mimics,a mature medical modeling software,was used to accomplish the three-dimensional reconstruction of CT images based on threshold segmentation.The gray image adjustment and tissue segmentation were performed on the CT images.Several complete abdomen models of real liver,kidney and pancreas tumors suitable for microwave ablation treatment were established.In the aspect of ultrasound image transmission,the method of Socket programming and UDP communication protocol for network image data transmission was adopted.The integration of ultrasound guided images and surgical vision was realized in HoloLens,which improved the hand-eye coordination of doctors during intraoperative ultrasound guidance.In terms of surgical path planning,in the case of wearing a HoloLens device,a three-dimensional reconstruction model of a real tumor lesion is subjected to the planning of a microwave ablation surgical plan by means of gaze and gesture interaction,a puncture path and a needle insertion position are determined,and an immersive virtual surgery scene is established.