Cross-modal Audiovisual Integration Research On Influencing Factors

Information integration of multi sensory channels can be defined as a process in which the brain processes,conducts and integrates the information presented by different sensory channels(such as vision,hearing,touch,etc.).We live in the world with objective scenes,acquiring a large amount of scene information processing.Although most of the external information obtained by human comes from the input of visual sensory channels,accordingly,the information input of other sensory channels can also enhance human’s complete information perception of the scenes effectively.The relationship between multimodal information integration and consciousness is not unified at present,while the relationship between auditory integration and consciousness is one of the most common ways of multimodal integration,so a deep study of which will be able to help to further study the multi-type cross-modal information integration.Most of the researches on audiovisual integration under consciousness use the start-up paradigm to study audiovisual numbers,and it proves that the integration of audiovisual numbers under consciousness requires training.However,there is less research on natural scenes,although it has been proved that subconscious audiovisual integration can effectively promote the human brain’s perception of natural scenes.However,in this type of audiovisual integration research,the scene is too single,and the cognitive processing mechanism of the time and space dimensions of the unconscious audiovisual integration has not been further explained.The research in this article is based on the complex audiovisual scene integration.On the basis of training,we explored the conscious and subconscious integration influencing factors,and compared the two,and studied the neural processing mechanism of conscious and subconscious processing through consistency,start-up time,target type,etc.Similarities and differences,the use of continuous flicker suppression paradigm to the brain processing natural scene audio-visual integration conditions.In order to strengthen the feasibility of the experimental stimulus materials,this article uses the SHIN toolbox to perform10,000 iterations of the image processing,and uniformizes the underlying information(brightness,color,etc.)of the image.At the same time,the collection frequency and loudness of the voice information are processed.A uniform treatment.This paper studies the relationship between consciousness and audio-visual integration through conscious audio-visual experiment(Experiment 1)and subconscious audio-visual experiment(Experiment 2).The aim of this paper is to further explain the cognitive neural processing mechanism of subconscious audio-visual integration,and the results indicate that audio-visual integration is not only affected by consistency,but also by the time course of audio-visual appearance.And through the global neuron workspace,the consciousness model explains the neural processing mechanism under consciousness.Analyze the coding principles of multi-modal information gathering,integration and interaction in the brain,and establish multi-modal information integration calculation theory based on behavioral data...