3D Avatar-based Instant Messenger System

With the rapid development of the Internet, instant messenger systems are also springing up. Now there have been many instant messenger systems, such as QQ, Skype, and MSN messenger, which have become an indispensable communication tools on the Internet. The existing instant messenger systems mainly rely on text, audio, and video for remote user conversation and communication. Text chat is monotonous, and video chat only occurs when users install cameras (webcoms) and wish to see each other. Therefore, whether there is a compromise that can avoid monotonous text chat, and meanwhile, avoid eye contacts with strangers? Yes, the 3D avatar-based instant messenger system proposed in this dissertation solves the problem. By using the system, users only need to input their own 2D face images to generate 3D avatars, and chat with each other.This dissertation mainly addresses the following work in developing the 3D Avatar-based in instant messenger system; ① We have implemented 3D face synthesis with the CANDIDE-3 face model and single view-based face synthesis technique, and texture mapping; ②With the use of formant synthesis technology and the HMM model, we have completed the mapping from phonemes to visemes, and realized the text-to-visual speech engine; ② With the point to point communication mechanism and UDP transport protocol, we have realized synchronization of text, voice and animation through the multithreading technology; ④Finally, we have completed the development of the 3D avatar instant messenger system by personalizing the 3D avatar.