Research On The Brain Mechanism Of Interface Metaphor Design Based On ERP

In the field of interface design,the concept of metaphor is interpreted as an activity when the user inspired by a certain element in the interface,then to extract representation,association and other processing in the brain,and finally match another certain element.Therefore,metaphorical cognitive thinking is closely related to the processing of human brain.At present,Linguistics,Cognitive science and other fields have begun to explore the deep connection between metaphor and brain by using EEG technology.However,in the field of interface design,metaphorical design has been widely used,and the study of interface metaphor is still in the initial stage of design theory construction,and the theoretical framework based on experimental maturity is not formed.Based on the metaphorical elements in the interface,this paper will use the theories of Design,Cognitive Psychology,Ergonomics,Linguistics and Biomedicine to study the mechanism of interface metaphor on the human brain,and make the research results widely applicable to the practical design.Firstly,this paper combines metaphor with interface design theory,and collate the four theories of interface metaphor design.Based on these theories,a multimodal design of interface metaphor is proposed.Secondly,from the perspective of cognitive psychology,this thesis discuss the interface metaphor and explore the psychological process of users' cognition of metaphorical elements in the interface.The ERP components,ERP paradigm and brain regions related to the interface metaphor are elaborated,which provides relevant evidence for the research of user brain mechanism based on ERP's interface metaphor.Thirdly,this thesis puts forward the construction mechanism of figure metaphor: Feature induction and Association.Based on this mechanism,the material of the behavior pretest is designed.The material includes GD(The collocation of the gestalt and direct synonym),GA(The collocation of gestalt and ambiguous words),GE(The collocation of gestalt and extended semantic words),CD(The collocation of characteristic figures and direct synonyms),CE(The collocation of characteristic figures and extended semantic words).GE,CD,CE are metaphorical collocations.According to the material behavior data in the behavior pretest to select materials for EEG experiments.Finally,this thesis use EEG technology to study human brain mechanism of interface graphic metaphor design.The graphical metaphors of behavioral and EEG data are used to compare the cognitive load of human brain in direct synonym and ambiguities,aslo the amplitude,latency of N400 components,hemispherical effects of different graphical metaphors are analyzed.The experimental results show that the overall cognitive load of three sets of metaphor collocations are between GD and GA.The order of cognitive load of three sets of metaphor collocations are: GE,CD,CE.In the metaphorical process of graphic semantics,the brain's feature induction is more than the cognitive load that the associative part of the word brings in the brain.When the subjects were aware of the graphic metaphors,the active brain regions were temporal lobe,posterior temporal lobe,occipital region and top area.There is no significant difference between left and right brain in figure metaphor processing.According to the combination of theory and experiment results,a relatively complete human brain cognition model of interface graph metaphor is established.The model is composed of two routes,which are respectively matched by gestalt or characteristic figures to extended semantics.The brain cognitive processing of the gestalt matches the direct semantic words after the brain carries out the internal representation and semantic encoding or the semantic encoding directly,then the extended semantic network is matched after the cross domain search.The characteristic figures are processed more than the gestalt(the processing of the direct synonym with characteristic figures and the direct synonym in the domain search).Besides,there may be jumps in the cognitive model of interface graphics(GE,CD,CE).This model provides a scientific design specification for the graphical metaphor of the interface from the cognitive perspective of the brain,and can be used to evaluate the cognitive load caused by a metaphorical figure and its semantic meaning to the user.