Research On Simulation Training System Of Sound Signal Processing And Interactive Technology

Simulation training system can solve many of the limitations and drawbacks in the traditional military training and exercises.At home and abroad have put it as an important means of increasing the military strength,and it has been rapid development and widespread application.Virtual reality system is an important solution for simulation training system.Human-Computer interaction is an important content of virtual reality technology.In the simulation system,the user can interact naturally with the virtual world through a series of methods and interactive device.Different from the traditional Human-Computer interaction methods,interact by using voice information can provide additional auditory feedback channel,enable rich user interactive experience,this will fill the blank of the virtual reality system input method.Unity3D is an integrated game engine,it can create three-dimensional video games,architectural visualization,real-time three-dimensional animation and other interactive content type,but it doesn't have advanced Human-Computer voice interactive function.Kinect is a peripheral device for use with the Xbox360 game console,which built-in four-element linear asymmetric microphone array.According to the microphones to receive the sound signal delay difference,calculate the sound source azimuth and angle.From the development of simulation training system involved in the virtual reality technology,Human-Computer interaction technology,voice signal processing technology including sound source localization technology and voice enhancement technology,focus on the sound positioning input technology,which breaks through the limitation of the traditional virtual reality system input method and fills in the gap of the simulation training system input,and realizes the design of the sound signal processing and interaction technology in the simulation training system.Using the Unity3 D engine,a virtual terrain training system simulating shooting gun battle is developed.After Kinect somatosensory microphone array equipment collect the sound,the system can distinguish the direction of the sound source,at the same time,using the two-channel noise cancellation technology,filtering and removal the noise of the acquisition data,thereby enhancing the positioning performance andaccuracy.The dynamic link library DLL is designed,and the interface and data fusion of Unity3 D engine and Kinect are realized.