Research Of Feature Extraction And Clustering Algorithms Based On Inner Lip Contour

The research of lip-reading technology in laboratory has becoming mature gradually, but it still can't works well in noisy environment now, which become a hardback that let it can be used in the reality. As important information when communication, the visual-speech information has been adapt to try to solve these problems. With the lip-reading technology, the speech recognize system can be improved on the recognize rate. At the same time, the bright foreground of the assistant communication system for disabled people; and the wide application of the online teaching system combined with video information, all of which make the research of lip-reading and synthesis getting more and more focus.But there are still so many problems need to be solved on the way of being applied in reality, Such as the orientation of lip, how to make the lip reorganization system be real-time,and so on. Further more, how to represent the lip shape of the speaker, how to construct a streamlined lip database, should be emphasized on the research works.The representation of the lip shape and the construction of the lip database are studied in this paper. With the research of feature extraction, the system can represent and judged the lip shape of images correctly. In addition, the introduction of clustering algorithm will help to getting treamlined lip database, which will trim the images with similar lip shape. Through these work, the lip database can be well satisfied in the application which required lower storage.The follwing is the research content in the paper:(1) A feature extraction method is brought up, which combined lip area extraction, lip contour extraction with curve fitting. After having analyzed the methods of lip shape representation, we use the inner lip contour to represent the lip shape, which can eliminate the effects of lip difference. Meanwhile, the clustering algorithms are used in trimming the lip database, which can trim images with similar lip shape.(2) The chromatic color space and threshold trimming, which used to...