Design And Implementation Of Panoramic Audio Processing Software

With the development of virtual reality technology,image acquisition technology has been developed to different degrees in two major areas,film and consumer level,but it is still at a relatively low level to create immersion through sound.To perfectly combine panoramic sound with panoramic video,traditional recording devices and techniques can not satisfy.This paper designs and implements a panoramic sound processing software that is used in conjunction with a panoramic sound collection device.After the sound with directional information is collected,it can be previewed,angle adjusted,quality processed and mainstream format converted,which accurately restores sounds scene and creates a more intense immersion experience.The panoramic sound processing software designed in this paper adopts a hierarchical design scheme:encapsulates the underlying algorithm into SDK,improves the flexibility and reusability of the algorithm while reducing the coupling with the upper layer.The software mainly includes four main function modules:main interface,panoramic sound preview and processing,and algorithm SDK.The author independently designed and implemented the four modules:(1)The main interface module includes functions such as user login,new version checking,Chinese/English switching,UUID management,preview mode switching,and other business logics such as interface design.(2)Panoramic sound preview module:provides the user with a preview of the head model,a panoramic video preview,an audio player function,and a visualization of the arrival direction,head angle adjustment,and angle adjustment of the sound field.(3)Panoramic sound pre-processing module:the audio file process and audio process in video file are supported,the panoramic sound noise reduction processing and equalizer processing are implemented.(4)Panorama sound algorithm SDK:A-Format,B Format,Stereo,Quad Binaural and 5.1 format transformation provided for upper-level function realization are realized through HRTF and Ambisonic rendering.The panoramic sound processing software has reached the functional requirements of the release version,and through the feedback and suggestions from users during crowd funding,the functional details are further optimized.