Design And Implementation Of 3D Virtual Animation Instant Messaging System

At present,domestic and foreign research on instant messaging has made great progress,and communication between people has become more and more convenient.At the same time,people begin to think about some of the more novel and interesting experiences,such as real-time communication based on 3D virtual animation instead of based on real face,and the 3D virtual animation model is driven by the user's real expression.This topic combines face alignment based on deep learning,the virtual reality technology and instant messaging,and also combines human-computer interaction with video chat to design an interactive instant messaging system.This topic uses XMPP and openfire to realize an instant messaging system,which is more convenient to use and more expandable.The main job of the client is to implement the XMPP protocol,and to use the XMPP protocol to transmit data to the server and also receive data from the server.Openfire is built by the server.For the problem that the popular face alignment models have poor adaptability to complex environments,this topic adopts the method of deep learning to complete the design and implementation of the face alignment model.Through data preprocessing,model design and model training,the model has strong adaptability to complex environments and it can locate 68 key points of the face,and this topic complete the work of migrating the model to the mobile.Current video communications are always not smooth,therefore,this topic replace video stream data with face key points data for transmission to reduce the network pressure.This topic uses speech encoding and decoding,noise reduction,echo cancellation and so on to solve the problem of noise and echo interference in voice transmission.This paper also introduces the production,import and loading of 3D virtual models,and takes the key points of individual faces as an example to explain how to use the face key points to drive the 3D animation model,and also introduces how to make the drive smoother and more natural.This paper first introduces the summary design of the topic,and then introduces the detailed design and implementation of each module in the server and client.The related deployments of the server and the client are also introduced,as well as the function tests of each module or research content in the project.