Application Research On Somatosensory Interaction Technology Base On Unity3D And Kinect

Virtual reality,as an emerging industry,is a technology in the research frontiers of human-computer interaction,collection of multimedia,computer graphics,network,sensors and other technologies.Having strong visual impact and rich interactive,virtual reality system is widely applied in industrial simulation,virtual roaming,and video games,medical,military,aerospace and other fields.At present most of the virtual roaming system is still use external wearable sensor device such as virtual glasses,helmet,and gloves to interact,while the application of natural interaction is less mentioned.This paper carried on a research of Unity3 D virtual reality engine and Kinect somatosensory equipment,thereby designed and implemented a virtual roaming system based on somatosensory technology.This paper mainly completed the following contents:Firstly,this paper studies on the human body gesture capture way,analyzes the function of the Kinect somatosensory equipment and the architecture of Kinect for Windows SDK in Windows platform Software Development Kit.Through the Unity3 D virtual reality platform,successful access to the user's depth image data and skeletal tracking data,and then do the data preprocessing,thereby puts forward a method which combined Unity3 D with Kinect somatosensory equipment by identifying the user defined position to complete the virtual scene interaction.Secondly,in the creation of virtual roaming scenery,combined with Unity3 D virtual reality engine,DEM system,visual modeling software and so on,realized the method of quickly create real terrain in virtual roaming scenarios.This method has a certain amount of generality,and it can be used in many fields such as the industrial simulation,building visualization,virtual driving.In the created virtual roaming scenarios,do the research of somatosensory interactive control,by the methods of interactive logic design,skeleton data acquisition and space vector mathematical modeling calculation,combined with the development of Playmaker,a plugin for Unity3 D,therefor success achieved the somatosensory control of the first person perspective in virtual roaming scene.Finally,by presentation of two-dimensional and three-dimensional ways,release and test the virtual scene somatosensory system,achieved an interactive system design idea for interacted naturally with virtual reality system.In the process of the system implementation,accumulated rich theoretical knowledge and research experience;In the process of the system test,it not only have a good interactive,practicability and extensibility,but also has a good reference on the development of virtual reality technology and the use of the somatosensory technology.