Subject Background's Influence On Early Stage Processing Of Multimodal Features

Based on the theory of multimodal discourse analysis,through ERPs experiment technology,this thesis studies the cognitive mechanism of liberal arts and science students in the early stage processing of multimodal features of university logos,with a view to discovering the influence of subject background on the early processing of multimodal features.Multimodal discourse refers to a discourse in which linguistic language and other symbolic resources coexist and construct meaning together.Multimodal discourse analysis,which is based on social semiotics,takes verbal information and other non-verbal information as the research object.Multimodal discourse is always studied from the interaction between various symbolic resources,between symbolic resources and social culture.However,due to the differences in the researchers' personal knowledge structure,cultural background or interpretation motivation,and the lack of grammatical basis in grammatical analysis of multimodal discourse analysis,different opinions appears in the same multimodal discourse analysis,which leads to strong subjectivity of the analysis.In addition,most behavioral studies have proved that university students from different disciplines often have different behavioral performance,thinking style and reasoning ability,while some empirical studies have proved that there are no significant difference between their thinking style.Therefore,from the perspective of information receivers,this study explores the early stage processing of multimodal features between liberal arts and science students,with university logos used as stimulus materials.In this study,43 undergraduates from China University of Petroleum(Beijing)were selected as subjects,including 22 liberal arts students and 21 science students,using a 2(subjects: liberal arts and science)× 4(stimulus type: Flower,Whole logo,Name logo,Picture logo)× 4(brain location: O1/2,A1/2,T5/6,TP7/8)× 2(brain: left hemisphere and right hemisphere)multifactor mixed experiment design.In the experiment,passive perception paradigm was used and visual stimuli were presented to the subjects,at the same time,subjects were asked to count the gray squares that appeared during the experimental process.The experiment was programmed by E-Prime 3.0 software.EEG data generated in the experiment were collected and recorded by Neurolab digital amplifier.Then,the EEG data were further analyzed in Matlab and the results were input into SPSS 23.0 statistical software for a statistical analysis of peak amplitude and peak latency.This study found that there was no significant difference(Ps > 0.05)in the amplitude and latency of P100,N170 and P200 induced by early processing of single mode and multimodal features between liberal arts students and science students.This indicates that the corresponding cognitive style formed in the long-term thinking training of liberal arts and sciences has no significant influence on the multimodal early processing,and the influencing factors may be related to tasks and strategies adopted by the subjects.The results of this study support the previous view that there is no significant difference in the thinking styles of liberal arts and science students,which also provides an electrophysiological basis for the cognitive processing and thinking styles of liberal arts and sciences students.