Research Of Perceiving The Unusual Action Of Coach Passengers Based On Fusion Of Heterogeneous Information

Based on the information obtained from coach, the paper study the technical problem of detecting coach passengers abnormal movements. Car audio and video system as the carrier,the paper put forward anomaly detection algorithm of audio and video information suitable for embedded platform,and fused some other heterogeneous information from the coach to assist improve sensitivity of the passengers’ abnormal motion detection.The main research results are as follows:1. Coach passengers image detection was realized on the platform of Android by using JNI technology and cross platform computer vision library OpenCV.2. Passenger movement detection and the brightness of the image anomaly detection was realized on the platform of Android3. WAV audio format was researched, it was analysed successfully on the platform of Android.The audio frequency and loudness was detected successfully on the platform of Android, and according the result, the anomaly detection algorithm of single threshold was raised, which is suitable for embedded platform, and at last judged whether there is vehicle audio anomaly.4.Dynamic D-S fusion algorithm was proposed, due to the heterogeneous information of vehicle. According the fusion result of auxiliary information to distinguish and classify vehicle running scene, then integrate the audio and video heterogeneous information for the detection result by using different basic probability assignment function in D-S evidence reasoning method in different scenarios. Finally realize reliable coach passengers abnormal motion detection system.Experiments show that/the dynamic multi-source heterogeneous information fusion technology the paper put forward can be more effective and reliable to detect passengers’ abnormal motion. So it can help the driver monitor the passengers, alarm to the driver after detected abnormal motion, and remind the driver of the necessary processing. Improve the vehicle running safety, as much as possible to protect life and property safety of passengers.