A Study Of Cross-modal Audiovisual Emotion Priming Effects In Adolescents

It is well known that perceiving emotions in a variety of ways can enhance an individual’s perceptual sensitivity.This allows people to more accurately judge the emotional state of others during social activities,thus facilitating interpersonal communication.Current research has systematically examined single-modal and multi-modal emotion integration and prediction mechanisms.However,we found that the field of multi-modal emotion perception research has not yet explored the cross-modal initiation of body expressions and rhythms.Studies have shown that adolescents are emotionally sensitive,more influenced by negative emotions of others,and their interpersonal interactions are strongly correlated with aspects of emotion perception in real life,while audiovisual cross-modal emotion perception has important implications for interpersonal interactions.So,what are the mechanisms by which different emotions act on adolescents in cross-modal audiovisual priming?Therefore,we used event-related potentials(Event-related potential,ERP)to study the emotional congruence between dynamic visual and auditory information in adolescents to shed more light on how prior visual priming factors influence later auditory target processing.At the same time,our study used two types of emotion with different valence.Experiment 1 selected the happy stimulus and the angry stimulus with opposite emotional valence,and Experiment 2 selected the angry stimulus and the sadness stimulus with negative emotional valence,which explored the consistency effect of N100,P200.Experiment 1 used angry and happy emotional stimuli as experimental material in a 2(modality: body,voice)× 2(emotion: angry,happy)within-subjects design.The results showed that the amplitude of the N100 component was more enhanced in the incongruent condition compared to the congruent condition,however,when angry sound emotions were present,N100 amplitude appeared suppressed;P200 amplitude was more enhanced in the incongruent condition compared to the congruent condition,i.e.,the increased additional brain processing responded to competition between different modals,yet P200 amplitude appeared suppressed when happy sound emotions were present,possibly related to adolescents’ assessment of perceived specific emotional content and attention.Experiment 2 builds on Experiment 1,and the previous one used emotional stimuli of angry and sadness as experimental material in a 2(modality: body,voice)×2(emotion: angry,sadness)within-subjects design.It has found that for negative emotional stimuli with consistent valence,as in Experiment 1,the amplitude of the N100 component was enhanced in the incongruent condition compared to the congruent condition,while the N100 amplitude was suppressed in the presence of angry sound emotions.the amplitude of the P200 component was more enhanced in the incongruent condition compared to the congruent condition,while the P200 amplitude was suppressed in the presence of sad sound emotions.In addition,the P200 component did not show significant differences like the N100 component in the congruent condition,further suggesting that the P200 component responds to competition between different modals and is instead insensitive to the same stimulus.The findings of the study are as follows:1.Dynamic body expressions affect rhythmic processing in the early stages.2.The N100 component is involved in cross-modal predictive processing,and P200 component is associated with assessing the perceived specific emotional content,with a functional separation of the two components.3.Angry emotions have a role in facilitating audiovisual processing.4.During cross-modal perception,adolescents showed a greater sensitivity to happiness as well as sadness sounds that followed angry body expressions.5.The N100 component is attributable to specific emotional content rather than to different emotional valence perse.