An Experimental Study Of Sound Visualization Mediated By Emotional Experience

In sensory experience,people are more sensitive to visual than auditory,and the addition of visuals can make the output as a whole form a more integrated aesthetic experience,and can also assist in the communication of sound information,leaving a more profound impression.With the development of modern technology,the methods of realizing sound visualization have been diversified.Computers can make visual output according to the structural characteristics of music,but the realized effect is easily homogenized,which will weaken the emotional expression of sound and the effect of audio-visual association.It is the goal of researchers to explore more emotionally effective sound visualization methods.This paper focuses on the transformation of the emotional experience of sound into visual design from the perspective of fluency experience and psycho-emotional response.First,it composes the basic theories related to audiovisual and the developmental changes of sound visualization,and elaborates on the realization and experience of sound visualization,concluding that the sound visualization attributes can be divided into three layers,the bottom physical attributes are more direct data presentation,the middle oriented attributes are subjective use of objective influence to complete the design work,while the communication of the upper emotional attributes requires stronger subjective and dynamic intervention,using a comprehensive The communication of high-level emotional attributes requires stronger subjective initiative and the use of integrated methods to convey emotions in a multi-sensory linkage.Second,the relationship between the respective characteristics of audio-visual and emotion is analyzed,the variables of the experiment are extracted,and the three levels of image semantics are used as the underlying framework of the audio-visual design model.Among them,timbre is one of the features of sound that is most closely related to emotion,and physical attributes such as speed,strength and regularity of sound can also have a fundamental impact on emotion.Also sound can symbolize certain things and produce psychological and emotional associations and experiences,all of which affect people’s judgment and experience of musical emotion.Then,two audiovisual experiments related to psychological effects were established on this basis.The first experiment is used to verify that emotions can be mediated by sound and vision,and the second experiment clarifies the visual tendencies of different emotions by collecting data results of the experiments,which are used to construct the visual characteristics of the model.The meaning conveyed by the constituent images is also analyzed from a semiotic perspective.Through the integrated experience of audiovisual stimuli,people form abstract emotional semantics for sound visualizations,thus forming an emotion-oriented sound visualization design model from visual features to object composition and then to emotional experience.Finally,based on the actual application of the scene,the analysis is refined from two major directions: artistic expression class and functional application class,and the model in different scenes will have preferences and differences in visual features,object composition,and final output from the application,thus improving the overall audiovisual design model and having a more practical guiding effect on the scene application.This paper synthesizes the above theoretical analysis and the conclusion of experimental output to construct a sound visualization design model mediated by emotions,which makes the overall experience of design works more humane and allows people to better understand the emotions of vocal music.It also makes the sound visualization works more attractive to achieve a better cross-sensory experience effect.The findings of the study have some reference significance for audiovisual psychological assessment and provide a design model idea for sound visualization that is more in line with the ambient effect.