Wen-Bing Horng This email address is being protected from spambots. You need JavaScript enabled to view it.1 and Chih-Yuan Chen1

1Department of Computer Science and Information Engineering, Tamkang University, Tamsui, Taiwan 251, R.O.C.


Received: December 29, 2006
Accepted: July 25, 2007
Publication Date: March 1, 2008

Download Citation: ||https://doi.org/10.6180/jase.2008.11.1.09  


This paper presents a vision-based real-time driver fatigue detection system for driving safety. Based on skin colors, the driver’s face is located from a color video captured in a car. Then, edge detection is employed to locate the regions of the driver’s eyes, which are used as the templates for eye tracking in subsequent frames. Finally, the tracked eyes’ images are used for fatigue detection in order to generate warning alarms for driving safety. The proposed system was tested on a Pentium M 1.4G notebook with 512 MB RAM. The experimental results seemed quite encouraging and promising. The system could reach more than 30 frames per second for eye tracking, and the average correct rate for eye location and tracking could achieve 96.0% on five test videos. Though the average precision rate of fatigue detection was 89.3%, the correct detection rate could achieve 100% on the test videos.

Keywords: Intelligent Transportation System, Driver Fatigue Detection, Eye Detection, Face Detection, Template Matching


  1. [1] Shinar, D., Psychology on the Road, John Wiley & Sons, Danvers, MA, U.S.A. (1979).
  2. [2] Recarte, M. A. and Nunes, L. M., “Effects of Verbal and Spatial-Imagery Tasks on Eye Fixations While Driving,” Journal of Experimental Psychology: Applied, Vol. 6, pp. 3143 (2000).
  3. [3] Cho, K. J., Roy, B., Mascaro, S. and Asada, H. H., “A Vast DOF Robotic Car Seat Using SMA Actuators with a Matrix Drive System,” Proc. IEEE Robotics and Automation, New Orleans, LA, U.S.A., Vol. 4, pp. 36473652 (2004).
  4. [4] Chieh, T. C., Mustafa, M. M., Hussain, A., Zahedi, E. and Majlis, B. Y., “Driver Fatigue Detection Using Steering Grip Force,” Proc. IEEE Student Conference on Research and Development, Putrajaya, Malaysia, pp. 4548 (2003).
  5. [5] Wilson, B. J. and Bracewell, T. D., “Alertness Monitor Using Neural Networks for EEG Analysis,” Proc. IEEE Signal Processing Society Workshop on Neural Networks for Signal Processing, Sydney, Australia, Vol. 2, pp. 814820 (2000).
  6. [6] Vuckovic, A., Popovic, D. and Radivojevic, V., “Artificial Neural Network for Detecting Drowsiness from EEG Recordings,” Proc. IEEE Seminar on Neural Network Applications in Electrical Engineering, Belgrade, Yugoslavia, pp. 155158 (2002).
  7. [7] Gonzalez, R. C. and Woods, R. E., Digital Image Processing, Second Edition, Prentice Hall, Upper Saddle River, NJ, U.S.A. (2002).
  8. [8] Davies, E. R., Machine Vision: Theory, Algorithms, Practicalities, Third Edition, Elsevier, Oxford, UK (2005).
  9. [9] Forsyth, D. A. and Ponce, J., Computer Vision: A Modern Approach, Prentice Hall, Upper Saddle River, NJ, U.S.A. (2003).
  10. [10] Gu, H., Ji, Q. and Zhu, Z., “Active Facial Tracking for Fatigue Detection,” Proc. IEEE Workshop on Applications of Computer Vision, Orlando, FL., U.S.A., pp. 137142 (2002).
  11. [11] Ji, Q., Zhu, Z. and Lan, P., “Real-Time Nonintrusive Monitoring and Prediction of Driver Fatigue,” IEEE Transactions on Vehicular Technology, Vol. 53, pp. 10521068 (2004).
  12. [12] Zhu, Z. and Ji, Q., “Real-Time and Non-intrusive Driver Fatigue Monitoring,” Proc. IEEE Intelligent Transportation Systems, Washington, D.C., U.S.A., pp. 657662 (2004).
  13. [13] Gu, H. and Ji, Q., “An Automated Face Reader for Fatigue Detection,” Proc. IEEE Automatic Face and Gesture Recognition, Seoul, Korea, pp. 111116 (2004).
  14. [14] Ito, T., Mita, S., Kozuka, K., Nakano, T. and Yamamoto, S., “Driver Blink Measurement by the Motion Picture Processing and its Application to Drowsiness Detection,” Proc. IEEE Intelligent Transportation Systems, Singapore, pp. 168173 (2002).
  15. [15] Eriksson, M. and Papanikolopoulos, N. P., “EyeTracking for Detection of Driver Fatigue,” Proc. IEEE Intelligent Transportation Systems,Boston, MA, U.S.A., pp. 314319 (1997).
  16. [16] Singh, S. and Papanikolopoulos, N. P., “Monitoring Driver Fatigue Using Facial Analysis Techniques,” Proc. IEEE Intelligent Transportation Systems, Tokyo, Japan, pp. 314318 (1999).
  17. [17] Wang, R., Guo, K., Shi, S. and Chu, J., “A Monitoring Method of Driver Fatigue Behavior Based on Machine Vision,” Proc. IEEE Intelligent Vehicles Symposium, Columbus, Ohio, U.S.A., pp. 110113 (2003).
  18. [18] Wang, R., Guo, L., Tong, B., and Jin, L., “Monitoring Mouth Movement for Driver Fatigue or Distraction with One Camera,” Proc. IEEE Intelligent Transportation Systems, Washington, D.C., U.S.A., pp. 314 319 (2004).
  19. [19] Dong, W. and Wu, X., “Driver Fatigue Detection Based on the Distance of Eyelid,” Proc. IEEE VLSI Design and Video Technology, Suzhou, China, pp. 365 368 (2005).