Skip to main content
SpringerLink
Log in

Real-Time Vision Based Driver Drowsiness Detection Using Partial Least Squares Analysis

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Robust eye state classification in real-time is very crucial for automatic driver drowsiness detection to avoid road accidents. In this paper, we propose partial least squares (PLS) analysis based eye state classification method and its real-time implementation on resource constraint digital video processor platform, to monitor the eye state during all time driving conditions. The drowsiness is detected using percentage of eye closure (PERCLOS) metric. In this approach, face in the infrared (IR) image is detected using Haar features based cascaded classifier and within the face, eye is detected. For binary eye state classification, PLS analysis is applied to obtain the low dimensional discriminative subspace, within which simple PLS regression score based classifier is used to classify test vector into open and closed. We compared our algorithm to recent methods on challenging test sequences and the result shows superior performance. The results obtained during on-vehicle testing show that the proposed system achieves significant improvement in classification accuracy at nearly 3 frames per second.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. 2014 Traffic safety culture index (2015). AAA Foundation for Traffic Safety, Washington.

  2. Liu, C., & Subramanian, R. (2009). Factors related to fatal single-vehicle run-off-road crashes. National Highway Traffic Safety Administration, DOT HS, 811, 232.

    Google Scholar 

  3. Gupta, S., Kar., S., & Routray, A. (2010). Fatigue in human drivers: A study using ocular, psychometric, physiological signals. Proceedings of IEEE. Students Technology Symposium, 234–240..

  4. Liu, C., Hosking, S. G., & Lenn, M. G. (2009). Predicting driver drowsiness using vehicle measures: recent insights and future challenges. Journal of Safety Research, 40(4), 239–245.

    Article  Google Scholar 

  5. Patel, M., Lal, S. L., Kavanagh, D., & Rossitier, P. (2011). Applying neural network analysis on heart rate variability data to assess driver fatigue. Journal of Expert Systems with Applications, 38(6), 7235–7242.

    Article  Google Scholar 

  6. Tran, Y., Craig, A., Wijesuriya, N., & Nguyen, H. (2010). Improving classification rates for use in fatigue countermeasure devices using brain activity. In Proceedings of IEEE international conference on engineering in medicine and biology society (pp. 1887–1892).

    Google Scholar 

  7. Shuyan, H., & Gangtie, Z. (2009). Driver drowsiness detection with eyelid related parameters by support vector machine. Journal of Expert Systems with Applications, 36(4), 7651–7658.

    Article  Google Scholar 

  8. Rongben, W., Lie, G., Bingliang, T., & Lisheng, J. (2004). Monitoring mouth movement for driver fatigue or distraction with one camera. In Proceedings of IEEE international conference on intelligent transportation systems (pp. 314–319).

    Google Scholar 

  9. Vural, E., Cetin, M., Ercil, A., Littlewort, G., Bartlett, M., & Movellan, J. (2007). Drowsy driver detection through facial movement analysis. Lecture Notes in Computer Science, 4796, 6–18.

    Article  Google Scholar 

  10. Dongwook, L., Seungwon, O., Seongkook, H., & Minsoo, H. (2008). Drowsy driving detection based on the driver’s head movement using infrared sensors (pp. 231–236). Communication: International Symposium on Universal.

    Google Scholar 

  11. Dasgupta, A., George, A., Happy ,& S. L., Routray, A. (2013). A vision-based system for monitoring loss of attention in automotive drivers. IEEE Transactions on Intelligent Transportation Systems, 14(4), 1825–1838.

  12. Jo, J., Lee, S. J., Park, K. R., Kim, I., & Kim, J. (2014). Detection driver drowsiness using feature-level fusion and user-specific classification. Journal of Expert Systems with Applications, 41(4), 1139–1152.

    Article  Google Scholar 

  13. Jo, J., Lee, S. J., Jung, H. G., Park, K. R., Kim, I., & Kim, J. (2011). A vision-based method for detecting driver’s drowsiness and distraction in driver monitoring system. Optical Engineering, 50(11), 1–24.

  14. Kisacanin, B., & Nikolic, Z. (2010). Algorithmic and software techniques for embedded vision on programmable processors. Signal Processing: Image Communication, 25(5), 352–362.

    Google Scholar 

  15. Yang, M. H., Kriegman, D. J., & Ahuja, N. (2002). Detecting faces in images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), 34–58.

    Article  Google Scholar 

  16. Zhang, C., & Zhang, Z. Y. (2010). A survey in recent advances in face detection. Technical Report, 66, Microsoft Research.

  17. Rowley, H. A., Balija, S., & Kanade., T. (1998). Neural network based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(1), 23–38.

    Article  Google Scholar 

  18. Chai, D., & Ngan, K. N. (1999). Face segmentation using skin color map in videophone applications. IEEE Trans. On Circuits and Systems for Video Technology, 9(4), 551–564.

    Article  Google Scholar 

  19. Viola, P., & Jones, M. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2), 137–154.

    Article  Google Scholar 

  20. Wang, Q., Wu, J., Long, C., & Li, B. (2013). P-FAD: real time face detection scheme on embedded smart cameras. IEEE Journal on Emerging and Selected Topics in Circuits and Systems, 3(2), 210–222.

    Article  Google Scholar 

  21. Zhiwei, Z., & Qiang, J. (2005). Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Computer Vision and Image Understanding, 98(1), 124–154.

    Article  Google Scholar 

  22. Ojala, T., Pietikainen, M., & Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary pattern. IEEE Trans. On Pattern Analysis and Machine Intelligence, 24(7), 971–987.

    Article  MATH  Google Scholar 

  23. Vapnik, V. (1999). An overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5), 988–999.

    Article  Google Scholar 

  24. Schwartz, W. R., Kembavi, A., Harwood, D., & Davis, L. S. (2009). Human detection using partial least squares analysis. In Proceedings of international conference on computer vision (pp. 24–31).

    Google Scholar 

  25. Kembhavi, A., Harwood, D., & Davis, L. S. (2011). Vehicle detection using partial least squares. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(6), 1250–1265.

    Article  Google Scholar 

  26. Wang, Q., Chen, F., Xu, W., & Yang, M. (2012). Object tracking via partial least squares analysis. IEEE Transactions on Image Processing, 21(10), 4454–4465.

    Article  MathSciNet  Google Scholar 

  27. William, R. S., Huimin, G., Jonghyun, C., & Larry, S. D. (2012). Face identification using large feature sets. IEEE Transactions on Image Processing, 21(4), 2245–2255.

    Article  MathSciNet  Google Scholar 

  28. SPRAAI7B (2008). Understanding the DaVinci Resizer. Texas Instruments.

  29. Castrillon, M., Deniz, O., Guerra, C., & Hernandez, M. (2007). ENCARA2: real-time detection of multiple faces at different resolutions in video streams. Journal of Visual Communication and Image Representation, 18(2), 130–140.

    Article  Google Scholar 

  30. Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: application to face recognition. IEEE Trans. On Pattern Analysis and Machine Intelligence, 28(12), 2037–2041.

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Instrumentation and Control Systems Engineering, PSG College of Technology, Coimbatore, Tamilnadu, 641004, India

    K. Selvakumar & Jovitha Jerome

  2. Robert Bosch Engineering and Business Solutions Limited, Bangalore, India

    Kumar Rajamani

  3. Lensbricks Technology Private Ltd, Bangalore, India

    Nishanth Shankar

Authors
  1. K. Selvakumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jovitha Jerome
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kumar Rajamani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nishanth Shankar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Selvakumar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Selvakumar, K., Jerome, J., Rajamani, K. et al. Real-Time Vision Based Driver Drowsiness Detection Using Partial Least Squares Analysis. J Sign Process Syst 85, 263–274 (2016). https://doi.org/10.1007/s11265-015-1075-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-015-1075-4

Keywords

Search

Navigation