The Phonetic Expression And Intermodal Perceptuality Of Interlocutors In Different Relationships

In the field of linguistics, the study of affects has two obvious features:On one hand, most studies have focused on the emotion, and very little on affects from the point of content; On the other hand, the research of Mandarin affects still lag far behind other languages, such as English, Japanese and French, etc. This paper focus on the study of perception and production of Mandarin affects.There are two research questions:(1) How the praising or blaming attitudes of speaker expressed transmit to listener, by multimodal expression, like vocal and facial expression in the case that the relationship between the talkers is friendly or unfriendly?(2) What is the difference on prosodic features between praising and blaming attitudes in the case that the relationship between the talkers is friendly or unfriendly?In this paper, we surveyed the first question through a listening experiments.12 subjects listened to the audio, video, and audio-video stimulus to judge the relationship between speakers and praising or blaming attitudes. The main results are as followed:(1) When talking to strangers, the hearer will generally take a more friendly tactics that he or she would tend to believe that the speaker is more friendly, rather than unfriendly, that the other side will be more in praise myself, instead of criticizing their own responsibility demoted.This is in line with the principles of verbal communication and cooperation principles of politeness.(2) The role of different modes in the transferring the relationship between talkers, will be different. When the hearer in identifying the speaker's friendly position, he requires a combination of each other's voices and facial expressions to judge, while opposing positions to identify the speaker, only you need to be able to make a judgment by the facial expression.(3) The role of different modalities in the transferring the speaker's praising and blaming will be different. Hearer can identify the speaker's praising attitude by a combination of voice and facial expressions to confirm each other and for criticism derogatory attitudes through facial expressions.(4) The relationship between the talkers is changed, the role of different modalities in the transferring of the praising and blaming will be different. When the hearer think the speaker is unfriendly positions, the judgement of praising or blaming will be more easily identified:He can judges praising only by voice or facial expression and judges the blaming attitudes by facial expressions.We examined the correlation between attitudes and prosodic features by speech Pnal analysis. This article extracted 17 related acoustic parameters, like fundamental frequency, duration, energy, voice quality by multivariate analysis of variance, to examine the different speaker relationships, different praising and blaming attitudes. The main results are:(1) Speaker in the expression of a friendly position, would use a higher fundamental frequency, the faster rate of speech, greater energy. This is because the higher fundamental frequency, the nicer the other feel. The faster, give each other more positive, happy to speak impression. The more energy, the tone will sound more resolute, sonorous.(2) Speakers in expressing the praising, will use a lower fundamental frequency, the faster rate of speech, less energy, more fundamental frequency jitter and harmonic noise ratio. Lower fundamental frequency, low voice to give each other a more honest impression of a faster rate of speech make each other feel more positive evaluation, not perfunctory. Smaller, huskier voice to give each other more polite and friendly feeling.(3) When the relations between the talkers is friendly, the speaker would express praising with a higher fundamental frequency, the faster rate of speech, when the relationship between the talkers is unfriendly, the speaker would express the praising with a lower frequency, slower rate of speech, greater energy. This shows that the relationship between the interlocutors will affect the expression appraise attitudes.This paper also extracted 17 acoustic parameters to reduce the dimension using factor analysis, and we found that six of the former common factor may comprise 80.32% of the original information. The use of six public factor to recognition of the relationship between speaker and appraise attitude determination, recognition rates were higher than the subjects of subjective judgment recognition rate.