Research And Application Of Realsense Technology In Car Exhibition And Virtual Driving

With the rapid development of computer technology,great changes have taken place in human-computer interaction.After the mouse,keyboard,touch and other interactive ways,As a natural huma-computer interaction,somatosensory interaction has attracted more and more attention.Intel RealSense technology can use Intel RealSense 3D camera to output the real-time depth data.And the Intel RealSense SDK provides a series of computer vision algorithms,such as gesture recognition,facial interaction,scene perception etc,achieving high-precision gesture tracking,facial analysis,speech recognition and other perceptual computing.This subject investigated and analyzed the application and research status of automobile display,virtual driving and somatosensory technology.The advantages of applying somatosensory technology to vehicle display and virtual driving were analyzed.After contrasting the current mainstream somatosensory camera,Intel RealSense technology was used to research and develop this application at last.And the principle of Intel RealSense technology was analyzed.In the early stage,the system’s functions were designed and planed from the user’s demands.Firstly,pictures and audio resources were processed by multimedia editing software,and 3D models were created and optimized by 3ds Max.Secondly,the resources were integrated and the platform was created in Unity engine.Next,Intel RealSense 3D camera which was the hardware foundation,combined Intel RealSense SDK and C#script to realize the perceptual control function.Finally,the car exhibition and virtual driving system was compeled which can be controlled through the gestures.This application includes three subsystems:automobile exhibition hall system,automobile exhibition system and virtual driving system,and the three systems are interrelated with each other.Users can switch the scene,roam in the hall,rotate and scale the car,switch the cars’ color and so on.Users also can watch the cars’ interior views using the face.Besides,in order to avoid confusion of excessive gestures,keyboards and mouse operation was used,optimizing the interactive of the system.Somatosensory interaction depends on the perception of advanced hardware and software technology.It has combined virtual platforms with reality through a variety of technology,subverting the traditional mode of interaction and implementing virtual control in the natural environment.Users can control the objects by natural gestures from a distance.This new way of human-computer interaction can give users a fun interactive experience,and enhance the interest of the application.