Development Of Driving Simulation System Based On Motion Capture And Gesture Interaction

The driving simulation system is a closed-loop simulation system under the condition of human and vehicle roads,including virtual visual display system,vehicle dynamics simulation system,somatosensory simulation system,human-computer interaction system,which can simulate driver's visual,tactile,somatosensory and other external perceptions in a safe environment.It can be used for driver behavior analysis,human-computer interaction analysis,vehicle performance analysis,etc.Road traffic system simulation analysis and other fields.The traditional driving simulation system visual display system has a rough display screen and a fixed driver's perspective,which may cause driving immersion and lack of experience.Moreover,in order to facilitate the driver's driving behavior analysis,the car's internal structure optimization,human-machine research,It is necessary to capture the motion data of the driver during driving;With the intelligentization of the car,the current driving simulation system also needs an intelligent interaction mode to verify the rationality and safety of the interaction.Based on the above factors,a driving simulation system based on motion capture and gesture interaction has been developed.The specific work is as follows:(1)Virtual reality scene display system is built by virtual physical simulation engine Unity 3D and virtual reality(VR)device--HTC Vive.Then VR head display is used to capture the driver's head movement to achieve a 360° spatial perspective and binocular stereoscopic display of the driver.(2)Analyze the movement of the human body,then use the active laser positioning technology to collect the HTC head display and the five Tracker to collect the driver's head,limbs,and waist motion data,and combine the cosine analysis method with the CCD numerical method to achieve the capture of the driver's body.Finally,the hand movement capture is completed based on the MiiGlove,and the two capture actions are combined by coordinate transformation to realize the complete capture of the driver's body movement.(4)The movement data of palm and fingertip are collected in real time by using binocular infrared depth sensor Leap Motion to realized the four kinds of static gestures such as thumb,scissors,OK,six and three kinds of dynamic gestures such as left-slip,right-slip and palm-opening.Then the recognition period and static duration are set to ensure the accuracy of gesture recognition.Finally,through the gesture interaction,the automotive window control,automotive light control,music playback,video playback during the driving process under VR are completed.(5)On the basis of the laboratory,combined with the vehicle dynamics simulation system,VR visual display system,somatosensory simulation system,human-computer interaction system,motion capture system to build a complete driving simulation system,and complete the communication between the various systems and the overall system Cosimulation.