Face Pose Estimation And Tracking In Color Image Sequence

Face pose estimation and tracking is the method to estimate 3D pose parameters from image sequence with human face. As a important research topic in the field of intelligent human computer interaction and computer vision, face pose estimation and tracking is becoming more and more attractive. The technology of face pose estimation and tracking can be widely applied in face recognition, video conference, intelligent surveillance, fatigue detection, virtual reality, game and entertainments.Face pose estimation and tracking relates to the field of face detection, face tracking, face pose estimation and so on, The existing approaches for face pose estimation and tracking can be classified into two categories: property-based and model-based, this dissertation emphasizes on the model-based method. After analysing the existing arithmetic, this dissertation first establishes hybrid skin model to locate face, and extract the face ellipse. then utilizes the arithmetic of improved face feature location based on the color information to determine the eyes and mouth position. According to the relation of video inter-frame, the face features is tracked, on the basis of acquiring face features, utilizing the face ellipse profile and geometric relationship among face features, combining the information of fronto-parallel face, the algorithm of face rotation angles around the X, Y and Z-axis is presented, so the 3D face pose estimation and tracking is implemented. Finally, this dissertation deals with the case with the monocular head-and-shoulder image sequence, using Delphi and OpenGL to implement a system of real-time face pose estimation and tracking for examining the effectiveness of our approach, and putting forward the directions for further research.