Research Of The Real-time System For Driver Fatigue Detection Based On Vision

The increasing number of traffic accidents due to a driver's fatigue has become a scrious problem for the society.With the background, developing a system for monitoring the driver's level of vigilance and alerting the driver when he fatigues is essential.This paper chooses computer vision based method as the study target to build a real-time detection system of driver fatigue.The system has a CCD camera which collecting videos of driver's upper-body to a computer,and uses some algorithm of computer vision to compute the percentage of eyelid closure and lip features,and then,estimates the level of driver fatigue.The core content of this paper is that realizing and improving algorithm such as face location,eye location,eye information extraction ,lips information extraction and fatigue level calculation.In order to detect frontal face,a method which combined skin color detection and validated spatial facial features scope is presented.The distribution and characteristic of skin color is firstly studied in color space to establish effective skin color model and to use it in image segmentation.Then,some unseemliness regions in segmentation are eliminated according to moment features.At last,we locate the facial features based on the acquired skin color,and to validate whether this face region contains face or not according to the relative location among features.The experiment results show that this method decrease false detection rates enormously.In order to locate eyes on the face, a Cascade Classifier based on Haar-Like features is used to search all existing eyes in the face region in different scale. Fourthly, Kalman filtering and mean shift algorithm based eye tracking method which can track close eyes and change size of eyes is proposed.In order to get eye information extraction,some relative researches have been analyzed,before a novel method,named as iris's external rectangle based method,is proposed to calculate the percentage of eyelid closure.The principle of the iris's external rectangle based algorithm is that: bind the iris region by using an external rectangle,use the ratio of the width and height of the rectangle to estimate the percentage of eyelid closure.This method can represents eye states more precisely than others relative method.In order to compute percentage of eyelid closure, eye information and lip features is used to evaluate the fatigue level of driver.The results of tests based on PC show good ability of this research.