Research And Design Practice Of Dual-Channel Data Interaction Display Based On The Audio-visual Synaesthesia Theory

With a high information coverage and good memory effect,the audio-visual synaesthesia accords with human physiological and psychological characteristics.Therefore,when transmitting audio-visual information,it is necessary to improve the transmission effect of dual-channel information with the design guidance of synaesthesia theory.With the development of society and the progress of science and technology,the audio-visual world has gradually become an important part of people's lifestyle,and the information transmission form of audio-visual combination is gradually applied in different aspects of social life.Dual-channel information transmission based on the audio-visual synaesthesia theory is conducive to reducing the dependence on a single channel,improving the richness of information acquisition and the effect of information transmission.Therefore,it is of certain research and practical value in the field of data display.However,there are little systematic researches on the interactive display of audio-visual dual-channel data nowadays.Also,the data display mode today is still mainly based on data visualization of single-channel interaction.Therefore,this paper has carried out research and design practice of dual-channel data interaction display based on the audio-visual synaesthesia theory with the hope to expand and practice relevant design theories and application methods.First,this paper analyzes the limitations of single-channel data visualization,the value of the audio-visual dual-channel combination and its value for dual-channel data interactive display through literature research and case study.Then,the dual-channel mapping relationship based on audio-visual synaesthesia and the visualized and audible coding dimensions are combed and deduced.Next,based on the results of theoretical research,the design process of interactive display of audio-visual dual-channel data is proposed,that is,display scene evaluation,design element screening,audio-visual mapping design and interactive design;and various design methods are summarized,such as the selection principle of audible design elements,the cooperative mode of audio-visual dual-channel,audio-visual mapping design method and interactive design principle.Finally,the design practice of dual-channel data interactive display is carried out by using the proposed design process and methods,and the dual-channel data interactive display board is produced as a material for evaluating the display effect.The experimental results show that,compared with single-channel data visualization board,the dual-channel data interactive display board has higher overall scores in three aspects:perceived attractiveness,usability and user satisfaction,and better information transmission effect.