Audiovisual Synesthesia Design In Audio-visual Interaction

Interaction between sound and image refers to the process of interaction between hearing and vision,which is often called sound visualization.The interaction and synchronization of vision and hearing is widely used in the field of science and art design.This paper focuses on design and art,and uses synaesthesia in modern cognitive psychology to design.At the same time,the research combines the two theories of "mapping" and "criticality" to provide a demonstration for synaesthesia to intervene in audio-visual interaction,and shift the focus of audio-visual interaction from technical presentation to aesthetic experience.At the same time,the research tries to put forward the solution of "homogenization" in the field of audio-visual interaction design.Finally,this paper uses "pierce Semiotics" to analyze the process of synaesthesia intervention design.From the theoretical point of view,this paper analyzes the inference assumption,and puts forward the advantages and precautions of this intervention method.Synaesthesia has been widely used in design activities abroad.There are two innovations in this paper: one is to study the relationship between different ways of interaction and synaesthesia through the classification of audio-visual interaction,It is always a global observation based on technical conditions,forms of expression and synesthesia generation as a whole;The second is the combination of modern semiotics,the audio-visual interaction in the process of the phenomenon of theoretical interpretation,and put forward the possibility of future audio-visual interaction creative practice direction.