Skip to main content

Real Time Driver Drowsiness Detection Based on Driver’s Face Image Behavior Using a System of Human Computer Interaction Implemented in a Smartphone

  • Conference paper
  • First Online:
Proceedings of the International Conference on Information Technology & Systems (ICITS 2018) (ICITS 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 721))

Included in the following conference series:

Abstract

The main reason for motor vehicular accidents is the driver drowsiness. This work shows a surveillance system developed to detect and alert the vehicle driver about the presence of drowsiness. It is used a smartphone like small computer with a mobile application using Android operating system to implement the Human Computer Interaction System. For the detection of drowsiness, the most relevant visual indicators that reflect the driver’s condition are the behavior of the eyes, the lateral and frontal assent of the head and the yawn. The system works adequately under natural lighting conditions and no matter the use of driver accessories like glasses, hearing aids or a cap. Due to a large number of traffic accidents when driver has fallen asleep this proposal was developed in order to prevent them by providing a non-invasive system, easy to use and without the necessity of purchasing specialized devices. The method gets 93.37% of drowsiness detections.

This work was supported by the Universidad de las Fuerzas Armadas, Sangolquí – Ecuador. Eddie E. Galarza (IEEE member), Franklin M. Silva, Paola M. Velasco and Eddie D. Galarza work at the University of the Fuerzas Armadas at the campus in Latacunga City. Fabricio D. Egas is an Electronic Engineer graduated in that university.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. World Health Organization. Road Safety: Basic Facts (2016). http://www.who.int/violence_injury_prevention/publications/road_traffic/Road_safety_media_brief_full_document.pdf

  2. Ji, Q., Yang, X.: Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real Time Imaging 8(5), 357–377 (2002)

    Article  Google Scholar 

  3. Lee, B.G., Chung, W.Y.: A smartphone-based driver safety monitoring system using data fusion. Sensors 12(12), 17536–17552 (2012)

    Article  Google Scholar 

  4. He, J., Roberson, S., Fields, B., Peng, J., Cielocha, S., Coltea, J.: Fatigue detection using smartphones. J. Ergon. 3(3), 1–7 (2013)

    Google Scholar 

  5. Chang, K., Oh, B.H., Hong, K.S.: An implementation of smartphone-based driver assistance system using front and rear camera. In: 2014 IEEE International Conference on Consumer Electronics (ICCE), pp. 280–281. IEEE (2014)

    Google Scholar 

  6. Xu, L., Li, S., Bian, K., Zhao, T., Yan, W.: Sober-Drive: a smartphone-assisted drowsy driving detection system. In: 2014 International Conference on Computing, Networking and Communications (ICNC), pp. 398–402. IEEE (2014)

    Google Scholar 

  7. Li, G., Chung, W.Y.: Detection of driver drowsiness using wavelet analysis of heart rate variability and a support vector machine classifier. Sensors 13(12), 16494–16511 (2013)

    Article  Google Scholar 

  8. Smirnov, A.V., Kashevnik, A., Lashkov, I., Baraniuc, O., Parfenov, V.: Smartphone-based identification of dangerous driving situations: algorithms and implementation. In: FRUCT, pp. 306–313 (2016)

    Google Scholar 

  9. Singh, H., Bhatia, J.S., Kaur, J.: Eye tracking based driver fatigue monitoring and warning system. In: 2010 India International Conference on Power Electronics (IICPE), pp. 1–6. IEEE (2011)

    Google Scholar 

  10. Grace, R., Byrne, V.E., Bierman, D.M., Legrand, J.M., Gricourt, D., Davis, B.K., Staszewski, J.J., Carnahan, B.: A drowsy driver detection system for heavy vehicles. In: Proceedings of the 17th AIAA/IEEE/SAE Digital Avionics Systems Conference, DASC, vol. 2, pp. I36/1–I36/8. IEEE (1998)

    Google Scholar 

  11. Grace, R., Steward, S.: Drowsy driver monitor and warning system. In: International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, vol. 8, pp. 201–208 (2001)

    Google Scholar 

  12. Kozak, K., Pohl, J., Birk, W., Greenberg, J., Artz, B., Blommer, M., Cathey, L., Curry, R.: Evaluation of lane departure warnings for drowsy drivers. Proc. Hum. Factors Ergon. Soc. Annu. Meet. 50(22), 2400–2404 (2006). Sage Publications, Los Angeles, CA

    Article  Google Scholar 

  13. Garcia, I., Bronte, S., Bergasa, L.M., Almazán, J., Yebes, J.: Vision-based drowsiness detector for real driving conditions. In: IEEE Intelligent Vehicles Symposium (IV), pp. 618–623. IEEE (2012)

    Google Scholar 

  14. Harshul, G., Tanupriya, C., Praveen, K.: Comparison between significance of usability and security in HCI. In: 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT), Ghaziabad, India, pp. 1–4. IEEE (2017)

    Google Scholar 

  15. Xu, Z., Qiu, X., He, J.: A novel multimedia human-computer interaction (HCI) system based on kinect and depth image understanding. In: International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India, pp. 1–6. IEEE (2017)

    Google Scholar 

  16. Fernandez Montenegro, J., Argyriou, V.: Gaze estimation using EEG signals for HCI in augmented and virtual reality headsets. In: 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico. IEEE (2016)

    Google Scholar 

  17. El-Shazly, E., Abdelwahab, M., Shimada, A.: Real time algorithm for efficient HCI employing features obtained from MYO sensor. In: 2016 IEEE 59th International Midwest Symposium on Circuits and Systems (MWSCAS), Abu Dhabi, United Arab Emirates, pp. 1–4. IEEE (2016)

    Google Scholar 

  18. Itkarkar, R.R., Nandi, A.V.: A survey of 2D and 3D imaging used in hand gesture recognition for human-computer interaction (HCI). In: 2016 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE), Pune, India, pp. 188–193. IEEE (2016)

    Google Scholar 

  19. Zuo, H.: Implementation of HCI software interface based on image identification and segmentation algorithms. In: 2016 Online International Conference on Green Engineering and Technologies (IC-GET), Coimbatore, India, pp. 1–6. IEEE (2016)

    Google Scholar 

  20. Gabrielli, L., Bussolotto, M., Squartini, S.: Reducing the latency in live music transmission with the BeagleBoard xM through resampling. In: 2014 6th European Embedded Design in Education and Research Conference (EDERC), Milano, Italy, pp. 302–306. IEEE (2014)

    Google Scholar 

  21. Leboeuf-Pasquier, J., Villa, A.G., Burgos, K.H., Carr-Finch, D.: Implementation of an embedded system on a TS7800 board for robot control. In: 2014 International Conference on Electronics, Communications and Computers (CONIELECOMP), Cholula, Mexico, pp. 135–141. IEEE (2014)

    Google Scholar 

  22. Toshniwal, K., Conrad, J.M.: A web-based sensor monitoring system on a Linux-based single board computer platform. In: Proceedings of the IEEE SoutheastCon 2010 (SoutheastCon), Concord, NC, USA, pp. 371–374. IEEE (2010)

    Google Scholar 

  23. Jaziri, I., Chaarabi, L., Jelassi, K.: A remote DC motor control using embedded Linux and FPGA. In: 2015 7th International Conference on Modelling, Identification and Control (ICMIC), Sousse, Tunisia, pp. 1–5. IEEE (2015)

    Google Scholar 

  24. Kang, P., Wei, Y., Wei, Z.: Control system for granary ventilation based on embedded networking and Qt technology. In: 2017 29th Chinese Control and Decision Conference (CCDC), Chongqing, China, pp. 2275–2280. IEEE (2017)

    Google Scholar 

  25. Degada, A., Savani, V.: Design and implementation of low cost, portable telemedicine system: an embedded technology and ICT approach. In: 2015 5th Nirma University International Conference on Engineering (NUICONE), Ahmedabad, India, pp. 1–6. IEEE (2015)

    Google Scholar 

  26. Stutts, J.C., Wilkins, J.W., Vaugh, B.V.: Why do people have drowsy driving crashes? Input from drivers who just did. AAA Foundation for Traffic Safety, Washington, DC (1999)

    Google Scholar 

  27. Verwey, W.B., Zaidel, D.M.: Preventing drowsiness accidents by an alertness maintenance device. Accid. Anal. Prev. 31(3), 199–211 (1999)

    Article  Google Scholar 

  28. Flores, M.J., Armingol, J.M., De la Escalera, A.: Sistema avanzado de asistencia a la conducción para la detección de la somnolencia. Rev. Iberoam. Autom. e Inform. Ind. RIAI 8(3), 216–228 (2011)

    Article  Google Scholar 

  29. Fuletra, J.D., Bosamiya, D.: A survey on driver’s drowsiness detection techniques. Int. J. Recent Innov. Trends Comput. Commun. 1(11), 816–819 (2013)

    Google Scholar 

  30. Dinges, D.F., Grace, R.: PERCLOS: a valid psychophysiological measure of alertness as assessed by psychomotor vigilance. US Department of Transportation, Federal Highway Administration, Publication Number FHWA-MCRT-98-006 (1998)

    Google Scholar 

  31. Jo, J., Lee, S.J., Jung, H.G., Park, K.R., Kim, J.: Vision-based method for detecting driver drowsiness and distraction in driver monitoring system. Opt. Eng. 50(12), 127202 (2011)

    Article  Google Scholar 

  32. Joyce, G., Lilley, M., Barker, T., Jefferies, A.: Mobile application tutorials: perception of usefulness from an HCI expert perspective. In: International Conference on Human-Computer Interaction, pp. 302–308. Springer International Publishing, Cham (2016)

    Google Scholar 

  33. https://www.sitepoint.com/mobile/app-development/. Accessed 10 Sep 2017

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eddie E. Galarza .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Galarza, E.E., Egas, F.D., Silva, F.M., Velasco, P.M., Galarza, E.D. (2018). Real Time Driver Drowsiness Detection Based on Driver’s Face Image Behavior Using a System of Human Computer Interaction Implemented in a Smartphone. In: Rocha, Á., Guarda, T. (eds) Proceedings of the International Conference on Information Technology & Systems (ICITS 2018). ICITS 2018. Advances in Intelligent Systems and Computing, vol 721. Springer, Cham. https://doi.org/10.1007/978-3-319-73450-7_53

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73450-7_53

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73449-1

  • Online ISBN: 978-3-319-73450-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics