Research Of Surgical Scene Generation Technology Based Text-to-scene System

The research of surgical simulation has been raised under the background that the limitations of traditional surgical practice as well as the rapid development of modern computer and VR technology. It is a new-born cross-fields study which combined many subjects. The aim of this research is to relieve the constraints of traditional surgical practice and simulate and direct surgical process with computer science which can be applied to surgical exercise, teaching and skill training. Modern surgical simulation technology takes advantage of VR technology and various kinds of surgical simulation data to construct3d surgical environment, this can help surgeons to perform operations with messages from virtual environment and some facilities of medical force feedback to gain the vivid surgical experience and effect.The first step to realize surgical simulation is the modeling of scene, which would affect system performance and the effect of simulation directly, and it is also one of the most important and exhausting tasks in the process of surgical simulation. Although there exists many modeling software, yet modelers still waste time and effort to the tedious work. As to surgeons, the design work of three-dimensional scene is beyond their consideration. If they can simplify the modeling process or reduce some modeling difficulties with the help of relevant resources of knowledge, which can greatly accelerate the speed of modeling surgical scene and then influence the study and development of surgical simulation.The science of text to scene has began to take shape, even though it cannot achieve code switching randomly in a perfect way, yet it has the function of inputting infinite languages and outing the basic three-dimensional scene. Surgical manual is the instructor which contains abundant of description in surgical process. With the message in surgical manual, we can acquire the organs, surgical equipment and operation in the scene, which comprise the basic elements in surgical simulation scene. There exists possibility of three-dimensional modeling by the science of text to scene. Therefore, this thesis mainly focuses on putting the science of text to scene to the modeling of surgical scene. Three-dimensional describing document can be obtained by inputting the surgical scene contained in surgical manual, with a series process of nature language processing technology and scene planning. Then by converting to the Spring scene format to load Spring rendering to generate the surgery scene.Although the research on surgical simulation modeling and the science of text to scene both at home and broad have been in independent stages, while there is no relevant research of the combination. However, they are still having the possibility to combine, as for this assumption; therefore, the author of this thesis will make the first attempt in the application field of surgical scene generation with the science of text to scene.