Experimental Research On Audiovisual Cognitive Brain Mechanism Based On Alarm Information Presentation

With the advent of big data era,multiple sources of massive information are all around us.As a terminal for computer information presentation,the user interface always focuses on the problem of "how to accurately and efficiently transfer data information".The method of information presentation in the interface directly affect the user's operational performance,which in turn affects the user's decision-making behavior.The presentation of multi-channel information allows users to use their visual,auditory and other sensory channels to obtain information more comprehensively and accurately.Based on previous studies,many scholars have verified that the cognitive efficiency of the dual-channel presentation of audiovisual information is much higher than that of the single channel,but there are few relevant studies on the presentation of audiovisual warning information on digital interfaces.Therefore,how to efficiently and reasonably design the information of the audiovisual channels to improve the efficiency of user operations is an important issue that needs to be studied urgently in digital interfaces.The article first introduces the cognitive processing theory of audiovisual information and the integration effect of audiovisual information,combs the basic cognitive model of audiovisual information and related user cognitive theories,introduces the audiovisual integration effect,pointing out the theoretical advantages of audiovisual synchronization.Then based on the relevant theories of visual and auditory information presentation,analyzed the presentation of visual information elements including text,colors,icons,and the auditory information elements including speech and non-speech.Based on the above research,the presentation methods and strategies of audiovisual information elements in the interface are put forward,which lays a theoretical foundation for experimental research.Then it introduces the brain imaging technology and compares each brain area to get the advantages of ERP in the usability evaluation of interface.Introduced related indicators commonly used in ERP analysis,such as latency and peak.According to the research purpose of this article,the N100 and P200 components related to the integration of audiovisual cognitive information are mainly discussed.The underlying laws of the brain's early cognitive processing of stimulus information are analyzed.The common experimental paradigms are introduced in detail and their research in this study related applications.Afterwards,the application of eventrelated potentials in the interface is summarized,mainly including the cognitive brain mechanism of interface information elements,the brain physiology evaluation method of information design and cognitive performance based on cognitive brain mechanism,and the brain physiology evaluation of the user's perception of interface decision to provide technical support and method guidance for the experiments.Finally,based on the research of audiovisual cognitive processing theory and presentation characteristics,this study designs an experimental paradigm of stimulus presentation,and uses event-related potential technology(ERP)to develop an experimental study of the simultaneous presentation of audiovisual warning information on the interface.The experimental task takes warning information as an example,and combines visual elements(text,icons,and colors)with auditory elements(speech and non-speech)to obtain six groups of audio-visual stimuli.After completing tasks in a quiet and noisy environment,the behavioral performance and brain physiology measurement methods are used to explore the cognitive laws of audiovisual warning information integration.Focus on comparing the cognitive differences of the audio-visual combination of alarm information in the same and different environments to obtain an audiovisual combination that is more in line with human cognitive origin,establish the mapping relationship between "audio-visual information and cognitive ",and propose a more scientific and efficient interface presentation method and interactive design strategy.The research results of this study show that:(1)In a quiet environment,using the combination of text and speech,color and non-speech is superior to other audio-visual combinations.(2)In a noisy environment,the audio-visual presentation of color and nonspeech,color and speech,text and speech combination is superior to other audio-visual combinations.(3)Compare the difference between noise environment and quiet environment,finds that in a noisy environment,subjects need more attention resources to complete the task,and the noise can interfere the information retrieval classification of the subjects,which consumes more cognitive resources.This is also the cause of the increase in N1 and P2 components.Therefore,when the environment is unstable or noisy,it is not recommended to use icons and non-speech,colors and speech in combination.The performance of these two groups in different environments is quite different.The combination of text and speech,color and non-speech have little difference in different environments,indicating that it is more suitable for complex environments.