Design And Implementation Of Human Face 3D Expression Animation Simulation For Mobile Platform

Facial expression recognition and animation simulation,as one of the core technologies of computer animation and human-computer emotional interaction systems,has always been a hot research field in the field of multimedia technology.Especially with the rapid development of robot technology and mobile Internet,people hope to get more and better interactive methods,richer forms of entertainment,such as video games,online teaching and virtual meeting rooms,or short videos effects that are particularly popular recently,live broadcast applications,and face animation technology all play a role.The purpose of face animation is to use the facial motion of the face in the animation to vividly express expressions and emotions to increase entertainment and interest.For the realization of face detection and tracking-driven three-dimensional expression animation,due to its huge demand for computing resources and rendering resources,the current main internal research and implementation is basically on the desktop platform,and high-end infrared devices are also used on the mobile platform.Face capture and drive animation program,but this method uses higher hardware costs and does not have the versatility on mobile devices.Based on the analysis and research of current mainstream algorithms,the present invention proposes a set of implementation schemes suitable for a universal mobile platform.Based on the video stream data captured by the cameras of mainstream mobile devices in the market,this thesis optimizes the implementation process and hotspot functions of the face detection and tracking algorithm under the premise of extracting and tracking the key feature points of the face to make it run on the mobile device in real time.This kind of efficient 3D facial expression animation simulation technology enriches emotional expression effects by fusing the position of key points on the face and the expression parameters of the 3D model,combined with cross-platform rendering technology.This subject is based on C++and OpenGL for program development,fully combining the advantages of the popular MVC(Model-View-Control)architecture in GUI(Graphical User Interface)programming,completely decoupling the two core modules of face tracking and model rendering,and realizes a complete set of real-time animation simulation technology on the universal mobile platform(Android/iOS).Experiments have proved that the method in this thesis can implement real-time face tracking-based 3D expression animation applications on the overall mainstream mobile platforms.Based on the realization of this result,it can be embedded in different scenes to facilitate the realization of mobile virtual social networking and virtualization.Live broadcast,mobile virtual meeting room,real-time expression animation short film generation and other applications.