Research On The Pleasure Testing And Evaluation Methods And Guidance Of In-vehicle Multi-Modal Perception And Human-Machine Interaction For Safe Driving

For ordinary users of automobiles,especially for drivers,the human-machine interaction system in the cockpit(e.g.vehicle information system),the main interactive object between the driver's primary and secondary tasks,has an important impact on driving safety.Existing research results can't meet the needs of the comprehensive testing and evaluation on in-vehicle human-machine interaction for safe driving,and help manufacture the products with innovative designs.For the reasons above,this Ph.D.thesis proposes a method of in-vehicle HMI perception-human-machine interaction pleasure testing and pleasure guidance for safety driving based on user's(driver's)brain cognitive representation,in order to provide a reference for product innovation.The thesis,relying on the scientific and technologic supports from the related subjects like the National Natural Science Foundation and the "Twelfth Five-Year Plan",taking the HMI in the cockpit as the research object,explores the brain cognitive mechanism and rules of driver-oriented multi-modal human-machine interaction(HMI)in driver-vehicle-road system driven by the secondary tasks,and the methods and techniques of testing and evaluating HMI perception-human-machine interaction pleasure and pleasure guidance.The main research content of the thesis is as follows:(1)Research on the brain cognition model with in-vehicle multi-modal perception-human-machine interaction for safe driving.The perceptive feature vectors of in-vehicle multi-modal human-machine interaction are extracted and identified for safe driving.The thesis investigates the pleasure modeling technology of HMI brain cognitive representation for safe driving and analyzes its influencing factors.An in-vehicle multi-modal perception-human-machine interaction and brain cognition model for safe driving is established.(2)Research on key technologies of pleasure testing and evaluation with in-vehicle HMI for safe driving.A pleasure evaluation model for safe driving under in-vehicle multi-modal human-machine interaction is constructed.The pleasure testing methods and data processing technologies by using in-vehicle HMI of multi-modal human-machine interaction are studied.The core algorithms such as feature extraction,statistics,denoising and pleasure evaluation based on GA-BP neural network are established.A method of calculating the pleasure degree of safe driving and a quantitative evaluation criterion for in-vehicle multi-modal human-machine interaction are established.(3)Research on pleasure guidance method of in-vehicle multi-modal human-machine interaction for safe driving.The mapping association relationship between low driving pleasure and perceived feature of HMI is studied.A pleasure guidance strategy of in-vehicle HMI sensible feature vectors for safe driving is established.(4)A case study.With the support of the theoretical method and the key technology of the thesis,the thesis takes the HMI of the on-board information system in EV300 as an example to carry out the evaluation and guidance of the in-vehicle multi-modal human-machine interaction pleasure testing for safe driving.The application of the guidance method verifies the effectiveness of the method.