Research On Immersive Visualization Of Sound Emotional Information

Sound is one of the common ways of information transmission in our daily life,and plays an important role in emotional transmission and expression.When human beings receive the characteristic signals from the sound itself,everyone has different emotional responses to the sound,and the characteristic information received in the brain is also different,and the results are also reflected in different psychological feelings.With the advent of the era of big data,the importance of sound emotional information is becoming more and more known.By extracting the characteristic data of sound and recognizing emotion,the hidden information in the sound can be displayed,the music experience can be improved,and it can play a role in the fields of art,medical treatment,education and training.In order to make it easier for users to understand the emotional information hidden in sound,and to use more accurate and efficient graphics or images to transmit the emotional information of sound,sound emotional visualization,which can simply,intelligently and clearly summarize and represent data,came into being.How to make use of different platforms,different technologies and different tasks to realize sound emotion visualization,so as to enhance users' understanding and empathy ability of emotion,is the most important research in the field of sound emotion visualization.In view of the above problems,this thesis aims to display sound emotion information based on immersive technology(this thesis mainly uses virtual reality technology),and realize the visualization of immersive sound emotion information with the basic characteristics of immersion,interactivity and imagination.The visualization of sound emotion information in the immersive environment makes the sound emotion information data no longer exist in a 2D plane,but become a tangible scene and interactive visual information in the immersive environment,thus helping users to understand and feel sound emotion more easily.Based on sound visualization and emotional visualization,this thesis briefly introduces the physical characteristics of sound.Explore the formation process of sound signal and the technology of sound emotion recognition,and then analyze the visualization of sound emotion from three aspects: marks,channels and interactive design.Discusses the effectiveness ranking of channels,and summarizes a set of visual coding design scheme suitable for sound emotion visualization.Finally,a virtual reality interactive work,Whale's Meaning,is designed and developed,in which the design and implementation of immersive sound emotion visualization is completed.Based on system practice and user survey,the effectiveness,feasibility and superiority of sound emotion visualization in immersive environment are proved.This thesis explores the realization process of immersive visualization of voice emotion information,and combs the whole process from data collection and sorting,voice emotion analysis and recognition to emotion visualization scheme design and realization of immersive voice emotion visualization,aiming at providing ideas for emotion visualization workers and helping practitioners or other researchers interested in voice emotion data visualization and visual analysis to understand and realize the immersive visualization system of voice emotion information.