Research And Implementation Of Lip Motion Feature Extraction Algorithms

With the rapid development of the Internet,artificial intelligence technology has been applied to our daily life,such as speech recognition,emotional detection,identity recognition and so on.In these applications,lip features play a very important role.This paper summarizes and analyses the existing lip feature extraction schemes.Aiming at the existing problems of lip feature extraction,a lip feature extraction scheme is designed and constructed based on the dynamic change process of the speaker's lip.The scheme of lip feature extraction is studied and analyzed in detail.The main work includes the following aspects:(1)The existing problems of lip motion feature extraction schemes are analyzed and compared.On the basis of acquiring the speaker's video information,a lip motion feature extraction scheme is designed and implemented.The scheme includes three main parts: video information preprocessing,lip key point automatic calibration and lip movement feature extraction.(2)In the part of video information preprocessing,a video information preprocessing model is designed and constructed.The key modules of the model are video framing,lip detection,lip image extraction and so on.(3)In the part of lip key point automatic calibration,a model of lip key point automatic calibration is designed,and the algorithms of key modules such as candidate point calibration,reference point calibration and key point automatic adjustment are designed and implemented.(4)In the part of extracting lip movement feature,the task of extracting the change rule of the speaker's lip during speech is mainly completed.In order to extract lip movement features,this paper firstly filters key frames to reduce the amount of data processing.Then,according to the key points of the lip automatically calibrated,the curve fitting of the lip edge contour is carried out,the curvature change characteristics are extracted,the angle of the lip opening and closing degree is calculated,and the angle change characteristics are extracted.Finally,the two features are combined to construct the final lip movement features.(5)Finally,based on the lip movement feature extraction scheme proposed in this paper,an application example of identity recognition is constructed and designed.Through verification and analysis,it is proved that the lip movement feature extraction scheme proposed in this paper has certain practicability.