Face Modelin And The Realization Of 3-D Facial Animation Based On MPEG-4

The high development of multimedia technology requires that com- puters can communicate with human by rich behavior emotion. Although there is a strong resemblance among the facial features of individuals, human faces are actually distinct. Besides, faces survey most of the comprehensive information such as emotion and spirit condition, so human face has been an important research field in computer vision and computer graphics. The dissertation focuses on the following three aspects: MPEG-4-based facial action coding system, text driven facial animation and speech driven facial animation, which have always been challenges in computer vision andcomputer graphics.First of all, the background and content are given. Then related work, including face modeling, face animation, lip animation and MPEG-4 facial specification, is classified and compared. Issues on the merits and flaws of these approaches are followed.A facial action coding system based on FAPs of MPEG-4 is presented. The system is divided into three layers from top to bottom--MPA layer, FC layer, and FAP layer. Supposed that we have already gotten the 68 FAPs, FCs can be calculated from these FAPs. Each MPA is composed of several FCs. So a viseme can be described by a set of MPA parameters. During facial animation, B-spline interpolation is used to generate the immediate frames between key visemes, then the facial motion described by MPA sequences is converted to FAPs by the FACS engine, these FAPs are the ultimate parameters to animate the 3-dimension talking face.In order to obtain the static viseme library as the basis for facial animation, a clustering algorithm of visemes based on parametric lip model is designed. The lip is parameterized by superior and anterior bend for upper and lower lip, width of the mouth, weight of lips' radium. The experiment result shows that parametric lip model...