The Influence Of Sensors Dominance Effects On The Coding Of Working Memory In Visual And Auditory Sensory Modalities

Sensory dominance effects refer to the fact that when information from different sensory modalities is presented at the same time,the brain does not give equal weight to each sensory modality.This may cause the information in a sensory modality to be processed preferentially and have a dominant effect.Current research focuses on the effect of redundancy in multisensory integration on the coding of working memory.However,the influence of sensory dominance in multisensory integration on working memory coding has not yet been paid attention.Therefore,Experiment 1 of this research adopted the "dual task" paradigm that combined the delayed matching-to-sample paradigm(DMS)in the working memory coding paradigm with the sensory dominance effects paradigm.By manipulating the sensory modality that presented the stimulus and the memory retrieval modality,the influence of the sensory dominance effect in the audiovisual integration on the coding of working memory is investigated.It was found that visual modal dominance effect and auditory modal dominance effect can affect the working memory coding of different sensory modality information.Specifically,when the audiovisual bimodal stimulus was presented,the memory retrieval of visual stimuli was better than the memory retrieval of auditory stimuli,but there were differences in the memory retrieval of visual and auditory stimuli under the dominance of visual modality and auditory modality.Under the dominance of auditory modalities,the memory retrieval of visual stimuli was relatively worse,while the memory retrieval of auditory stimuli was relatively better.This shows that in the process of integrating visual information and auditory information in the central executive system of the working memory model,visual information has a stable priority integration characteristic.In order to further explore whether auditory information can be integrated preferentially in the coding process of working memory,experiment 2 manipulated the attention modality on the basis of Experiment 1 to investigate how the modality dominance in audiovisual integration affects the coding of working memory when attention is allocated to visual and auditory modality.The reason why attention was manipulated was that previous studies had found that attention can promote the integration of information from multisensory modality,and the selective effect of attention can also inhibit or eliminate the interference of irrelevant information,so that effective information can be processed in the working memory system.The results of Experiment 2 found that the distribution of attention can affect the process of working memory coding under the dominance effects in audiovisual integration.When attention was directed to the auditory modality,the coding advantage under the dominance of the visual modality disappeared.In summary,we found that sensory dominance effects can affect the coding process of working memory in different degrees.When the subjects were presented with audiovisual bimodal stimuli,the coding of the visual modal stimulus had an advantage,but when the attention was directed to the auditory modal,the coding advantage led by the visual modal disappeared.On the one hand,the research shows that in the process of working memory coding,the central executive system has priority in integrating the information stored in the visual sketchpad and the phonological loop,that is,compared with the auditory information in the phonological loop,the central executive system will prioritize the integration of visual information in the visuo-spatial ketchpad.On the other hand,it can also be explained that in the working memory system,the visuo-spatial ketchpad and the phonological loop are relatively independent when storing information.