Study On Method And Technology Of Human-Computer Emotion Interaction

Affective computation is a new field that has received growing interest in harmonious human-computer interactive and artificial intelligence. It also is a new union spot of multi-disciplinary such as mathematics, information science, intelligent science, nerve science, physiology and psychology etc. The research of affective computation is attempts to found a computational system which has capable of perception, recognition and understand human's emotion and makes intelligently, keenly, friendly response aiming at huamn's emotion. Based on affective computation and artificial psychology, this thesis discusses in detail facial expression, affective modeling and expression animation and affords technique supports for harmonious human-computer interaction. The main contributions of this thsis include:(1) A new facial expression recognition method based on zernike moment and the minimum classification error (MCE) trained HMMs is presented. In the feature extraction problem, the method of moment invariants feature extraction based on local feature regions is adopted. First, eyes and mouths are segmented from the facial expression image and variant moments feature vectors of eyes and mouth are extracted. In the classification problem, by adopting a more realistic MCE definition, discriminative information contained in the training data could be used to improve the performance of HMM.(2) Emotion model is a key part for realizing a more effective human-computer interaction.in the prossess of building emotion computational model, a classification method which synthesizes dimension theory and basic emotion theory is presented and an emotion space is built. This thesis presents numerical description of some emotion ingredient such as personality, mood, and need and dynamic processing method of need. Moreover, the mapping relationship among various emotion ingredients is built. How to realize effective organization and coordination among each kind of emotion ingredient, as well as How to realize mapping from external environment and emotion states to emotion behavior are difficult question in the emotion modelling. In order to solve this problem, emotion computation model based on the emotion cognition appraisal theory is proposed. The model describes the shift of emotion states by Markov process, and builds the relation between emotion ingredients and emotion expression by the Markov decision processes.(3) In the expression synthesis, Candide model is adopted as facial model and Face animation code system is adopted to divide the of the face into 12 AUs (Action unite) which can synthesize most expressions. the thesis present a synthesis method of model adjusted that combining automation and interaction mode. First eigenpoints are extracted by deformable templates, which can be replaced by manual manipulation when the image' s quality is bad. Second the model is adapted globally and locally and the noneigenpoints is interpolated by RBF.In the thesis, an anthropopathic information consultation service system is built based on the models and approachs presented above and the correctness and validity of these models and approachs are proved by the system. Compared with other information consultation service system, the system is more intelligent and has anthropopathic characteristic.