| In the field of medical information,the medical image data is one of the most realistic information resources with largest amount of data,highest cost of production and usage.It is also the basis of diagnosis of numerous diseases in clinic,and medical researchers are persistently exploring its implicit information.In the era of mobile Internet of cloud computing and cloud storage,the people,including doctors,patients and researchers,are no longer content to process medical images and exchange opinions at the appointed time and place via dedicated equipment and dedicated network.However,Internet application of medical image data resources is often plagued by problems such as network transmission,client computing power,the compatibility of diversified Internet devices,and "fat clients",etc.Especially in the context of rapid development of imaging technology,the 3D volume data visualization and corresponding 2D projection generated by sectional medical images(SMIs)is becoming a much more important basis for expanding treatment and research work.Meanwhile,medical images produced by new digital imaging devices are also growing much bigger,e.g.,the data size of SMIs of one single patient is being increased from the hundreds-megabytes-level to thousands-megabytes-level.Big data and corresponding large computation cost is offsetting advances in network and equipment performance,the frequent upgrading of network infrastructure and Internet devices is always in a "catch-up" mode.On the other hand,mobile applications are characterized by non-private network environment and diversified purposes,which emphasize the "lightweight" features and "thin client" trends.Therefore,this study adopted the remote rendering mode to explore methods of post-processing technology of pseudo-3D webpage,which may meet the three features of the client's application: lightweight,similar to native user experience,and robustness,and highlight the information integrity and accuracy of interaction;to further establish a remote "hand to hand" synchronous communication mode to highlight the image details.On this basis,a number of representative SMIs in clinic and a data set of Chinese Visible Human(CVH)were used to carry out online sharing and interaction experiments,furthermore,a technical foundation of online 3D lightweight registration was built.Ultimately,this study formed a technical framework and corresponding Web prototype platform to support every people could rapidly access the remote volume data and discuss their details via any type of Internet terminals(without hardware and software environment restrictions)and pure web browsers(without any software/plug-ins installation)in the ordinary Internet.This paper has completed the following work:(1)to propose a Unbalanced Ratio Pyramid Structure(URPS)and Format Conversion Engine(FCE)responding mechanism,which meet the medical image browsing characteristics,achieve the purpose of rapid accessing and discussing for lossless 2D static high resolution images.(2)to use the remote rendering mode to achieve the purpose of browsing and interacting the pseudo-3D medical images via pure webpage.On this basis,to further design Master-Slave dual-channel 3D interaction mode and One-response-for-one-request behavior event auxiliary response mechanism,both were used to optimize client-side similar to native user experience and to lift server-side response efficiency.This work is a possible foundation to bring professional image workstation to the public.(3)to build 2D/pseudo-3D Image Processing Integration Middleware,and to further improve Behavior Event Relationship Storage Structure,thus the advantages of lossless sharing of 3D volume data and 2D static high resolution image were integrated.Ultimately,a Web2D/3D medical image visual interactive prototype platform was formed to realize the purpose of processing high-quality medical volume data in any place via any network and any Internet device between doctors and patients,which highlight the lightweight feature and similar to native user experience requirement for mobile application.Theoretically,this solution could be easily integrated into other medical cloud electronic health record or webapp environment with good data security.(4)On the basis of Web2D/3D prototype platform,to form a web post-processing technical framework of high expansibility.Through transplanting the self-established multimodal image 3D-3D fast registration method into the web post-processing technical framework,to realize the online registration of different modal image data.Experimental results showed that the Web Multimodal Image 3D Registration Method was adapted to the lightweight interactive features of mobile application and adapted to the normalized characteristics of existing clinical image datasets,it could play an assistant role to expand traditional medical imaging work mode and application objects,and serve the needs of universal observation and instant online communication in mobile health background.Furthermore,this work could be improved as a middleware of the registration module,which fit to other registration methods.(5)to import the high-quality CVH dataset into the Web2D/3D prototype platform,to achieve the purpose of cross-regional sharing at a low cost.This platform could support client to arbitrarily clip and view the internal anatomy structure of high-resolution 3D volume data via flexible 3D interactive operations,and could support clients to discuss with each other via "hand to hand" collaborative communication function.Furthermore,to use Web Multimodal Image 3D Registration Method to realize the lightweight registration and synchronous visualization interaction between CVH-2 true color image and CVH-2 CT images,this way could provide an innovative network technology platform for clinical image diagnosis and research,and maybe much safer for intellectual property protection.The experimental results showed that,via the Web2D/3D prototype platform,for sharing of hundreds-megabytes-level SMIs,any Internet devices could use general web browser to rapidly access high-quality 3D visualization image at 100 KBps client bandwidth,the access operation includes browsing,annotation and synchronous communication;for loseless sharing of multiplanar reconstruction result of thousands-megabytes-level CVH dataset,the ideal bandwidth is at 300 KBps;for multimodal image 3D-3D fast registration and corresponding synchronous visualization interaction,the ideal bandwidth is at 1 MBps.The performances,including imaging quality,native user experience and short loading time,all got a positive conclusion.The final result showed that this study greatly reduces the access threshold of software and hardware on client side,it could be conducive to expand the application scope of medical SMIs,and plays a good role in the protection of intellectual property.In conclusion,this study aimed to solve key technologies on rapidly sharing and processing medical SMIs over general web browsers in the mobile Internet,where all mobile applications are characterized by non-private network environment and diversified purposes.That means any authorized user could rapidly access the application via one URL hyperlink,the low cost of user access,the radiographic examination report may jump out of the static image restriction,and it is possible to obtain a work scene of what you want is what you get.Besides,as a supplementary solution,this study could be applied to regional health,telemedicine,and medical imaging education at a low cost,and could be helpful to expand traditional medical 3D volume rendering work mode and application scope,to provide a platform for clinical study of innovative diagnosis mode,and finally,to promote the development of technology for mobile health. |
PDF Full Text Request