skip to main content
10.1145/3427423.3427433acmotherconferencesArticle/Chapter ViewAbstractPublication PagessietConference Proceedingsconference-collections
research-article

Micro-sleep detection using combination of haar cascade and convolutional neural network

Published:28 December 2020Publication History

ABSTRACT

The level of traffic accidents is increasing every day. One of the factors causing traffic accidents is the condition of drivers who are tired and feeling drowsy. Referring to that problem, we propose an early warning system for detecting micro-sleep based on the image processing analysis using NUC processing. Micro-sleep is a condition when someone falls asleep but only a few seconds, usually between three seconds. A camera is used as a sensor that receiving an input image for obtaining information on the state of the eyes in the drowsy condition or not. An indication of a driver being sleepy or in the micro-sleep condition can be analyzed from the amount of blinking in his eyes. The combination of Haar Cascade and Convolution Neural Network is proposed. Haar Cascade will detect the face area and mark the eye region for the beginning of the program. Moreover, Convolutional Neural Network (CNN) is used to detect open and closed eyes. Detection of micro-sleep using a combination between Haar Cascade and Convolution Neural Network has an average accuracy of 97.23% when the condition of the user is 30--50 cm in front of the camera. In this system, the average computation time is obtained 0.2075 s.

References

  1. T. Vesselenyi, et al. 2017. "Driver Drowsiness Detection Using ANN Image Processing". IOP Conf. Series: Materials Science and Engineering 252 012097.Google ScholarGoogle ScholarCross RefCross Ref
  2. C. Huda, H. Tolle and F. Utaminingrum. 2020. "Mobile-based Driver Sleepness Detection using Facial Landmarks and Analysis of EAR values". International Journal of Electrical and Computer Engineering, 2020Google ScholarGoogle Scholar
  3. S. Park, F. Pan, S. Kang and C. Yoo. 2016. "Driver Drowsiness Detection System Based on Feature Representation Learning Using Various Deep Networks". Asian Conference on Computer Vision, pp 154--164Google ScholarGoogle Scholar
  4. Rajneesh, A. Goraya and G. Singh. 2018. "Real Time Drivers Drowsiness Detection and Alert System by Measuring EAR". International Journal of Computer Applications, Volume 181 No. 25Google ScholarGoogle Scholar
  5. K. Harris. 2019. Micro-sleep Prevention Guide. Available online at https://www.sleepadvisor.org/micro-sleep/Google ScholarGoogle Scholar
  6. M. Awais, M. Badruddin and M. Drieberg. 2017. "A Hybrid Approach to Detect Drivers Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability". Sensors, Volume 17Google ScholarGoogle Scholar
  7. M. Ngxande, J.R. Tapamo and M. Burke. 2019. "Detecting Inter-Sectional Accuracy Differences in Driver Drowsiness Detection Algorithms".Google ScholarGoogle Scholar
  8. K.W. Kim, H.G. Hong, G.P Nam and K.R. Park. 2017. "A Study of Deep CNN-Based Classification of Open and Closed Eyes Using a Visible Light Camera Sensor". Sensors, Volume 17 Isuue 7Google ScholarGoogle Scholar
  9. M.S.. Uddin and A.Y. Akhi. 2016. "Horse Detection Using Haar Like Features". International Journal of Computer Theory and Engineering, Volume 8 No. 5.Google ScholarGoogle Scholar
  10. F. Utaminingrum, R. Primaswara and Y.A. Sari. 2017. "Image Processing for Rapidly Eye Detection based on Robust Haar Sliding Window". International Journal of Electrical and Computer Engineering, Volume 7 No. 2.Google ScholarGoogle Scholar
  11. G. Facciolo, N. Limare and E. Meinhardt. 2014. "Integral Image for Block Matching". Image Processing On Line, pp. 344--369Google ScholarGoogle Scholar
  12. L. Geng, Z.Q. Hu and Z.T. Xiao. 2019. "Real-Time Fatigue Driving Recognition System Based on Deep Learning and Embedded Platform". American Scientific Research Journal for Engineering, Tchnology and Sciences, Volume 53 No. 1Google ScholarGoogle Scholar
  13. C.K. Dewa, A.L. Fadhilah, Afiahayati. 2018. "Convolutional Neural Networks for Handwritten Javanese Character Recognition". Indonesian Journal of Computing and Cybernetics Systems, Volume 12 No. 1Google ScholarGoogle ScholarCross RefCross Ref
  14. Stanford, 2018. Introduction to Convolutional Neural Network. Available online at https://web.stanford.edu/class/cs231a/lectures/intro_cnn.pdfGoogle ScholarGoogle Scholar

Index Terms

  1. Micro-sleep detection using combination of haar cascade and convolutional neural network

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      SIET '20: Proceedings of the 5th International Conference on Sustainable Information Engineering and Technology
      November 2020
      277 pages
      ISBN:9781450376051
      DOI:10.1145/3427423

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 December 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      SIET '20 Paper Acceptance Rate45of57submissions,79%Overall Acceptance Rate45of57submissions,79%
    • Article Metrics

      • Downloads (Last 12 months)13
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader