The Research Of Tongue Objectiveness Based On Binocular Stereo Vision

Tongue diagnosis is an important part of the four diagnosis in Traditional Chinese Medicine(TCM),with the globalization and modernization of medical science,objective diagnosis technology of TCM has got rapid development in standardization and automation.However,based on two-dimensional images,the current objective research of tongue diagnosis of TCM can only provide information like color,shape and so on,but without three-dimensional information such as the pricks and crasks.Thus the establishment of three-Dimensional(3D)tongue is one of the development directions of objective tongue diagnosis.The objective research method of tongue diagnosis is proposed in this paper based on binocular stereo vision considering the features of tongue,and collecting system of three dimensional tongue is designed,further a thorough study into image preprocessing,stereo calibration,stereo matching,3D reconstruction and lingual judgment has been achieved.The experimental results show that the 3D reconstruction based on binocular stereo vision is applicable to real tongue with dynamic properties,at the same time,tongue shape can be successfully classified based on 3D tongue.The main work and innovations in this paperare are as follows:Firstly,acquisition system of 3D tongue is consist of the blackbox,binocular camera system and projector.The blackbox is used to provides a stable light source environment for acquisition,and the projector as the lighting equipment is used to artificially increase characteristics of the surface of the tongue.Calibration method of Zhang is used to calibrate the system.According to the characteristics of tongue which has the rich texture and continuous depth,the linear region growing method is adopted to realize stereo matching,and the parallax distance measuring method is adopted to achieve 3D reconstruction,it can effectively suppress noise by using new measure function NSSD which is obtained by combining the similarity measure function SSD with?_?(n).Firstly,the features of images are extracted by canny operator.Feature points are matched according to NSSD in two images,matched feature points are named seed points,and then linear region growing with seed points is done in order to get the disparity map of whole tongue body.Disparity map is smoothed by bilateral filtering.Uninteresting region such as the corner of mouth is included in tongue image,with significant depth differences between tongue and corner of the mouth,uninteresting region is removed by depth difference in disparity map.Finally,the parallax distance measuring method is adopted to calculate the 3D point clouds of tongue body with disparity map.A tongue shape diagnostic method based on 3D tongue is proposed,Geomagic stereo is used to fit 3D point cloud,to repaire tongue model and to calculate the volume of tongue.Fat or thin tongue is judged by the ratio of V(volume)and BSA(body surface area).Results showed that S had great performance.Clinical results show that the method can be convenient and fast to extract tongue information,which is beneficial to analysis the characteristics of tongue using multi-parameter,and a new method is explored for objective tongue diagnosis.