Abstract
How to extract effective features of fatigue in images and videos is important for many applications. This paper introduces a face image descriptor that can be used for discriminating driver fatigue in static frames. In this method, first, each facial image in the sequence is represented by a pyramid whose levels are divided into non-overlapping blocks of the same size, and hybrid image descriptor are employed to extract features in all blocks. Then the obtained descriptor is filtered out using feature selection. Finally, non-linear Support Vector Machines is applied to predict the drowsiness state of the subject in the image. The proposed method was tested on the public dataset NTH Drowsy Driver Detection (NTHUDDD). This dataset includes a wide range of human subjects of different genders, poses, and illuminations in real-life fatigue conditions. Experimental results show the effectiveness of the proposed method. These results show that the proposed hand-crafted feature compare favorably with several approaches based on the use of deep Convolutional Neural Nets.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Azim, T., Jaffar, M.A., Mirza, A.M.: Fully automated real time fatigue detection of drivers through fuzzy expert systems. Appl. Soft Comput. 18, 25–28 (2014)
Colic, A., Marques, O., Furht, B.: Driver Drowsiness Detection: Systems and Solutions. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-319-11535-1
Sigari, M., Pourshahabi, M., Soryani, M., Fathy, M.: A review on driver face monitoring systems for fatigue and distraction detection. Int. J. Adv. Sci. Technol. 64 (2014)
Awais, M., Badruddin, N., Drieberg, M.: A hybrid approach to detect driver drowsiness utilizing physiological signals to improve system performance and wearability. Sensors 17 (2017)
Sigari, M.H.: Driver hypo-vigilance detection based on eyelid behavior. In: International Conference on Advances in Pattern Recognition (2009)
Omidyeganeh, M., et al.: Yawning detection using embedded smart cameras. IEEE Trans. Instrum. Meas. 65, 579–582 (2016)
Vesselenyi, T., Moca, S., Rus, A., Mitran, T., Tataru, B.: Driver drowsiness detection using ANN image processing. In: IOP Conference Series: Materials Science and Engineering, vol. 252 (2017)
Zhu, W., Yang, H., Jin, Y., Liu, B.: A method for recognizing fatigue driving based on Dempster-Shafer theory and fuzzy neural network. Math. Probl. Eng. (2017)
Kumar, N., Barwar, N.: Detection of eye blinking and yawning for monitoring driver’s drowsiness in real time. Int. J. Appl. Innov. Eng. Manag. 3 (2014)
Alioua, N., Amine, A., Rziza, M.: Drivers fatigue detection based on yawning extraction. Int. J. Veh. Technol. (2014)
Bandara, I., Hudson, C.: Detection and tracking of eye blink to identify driver fatigue and napping. In: 20th British HCI Group Conference in Co-operation with ACM, HCI 2006: ENGAGE (2006)
Dasgupta, A., George, A., Happy, S., Routray, A.: A vision-based system for monitoring the loss of attention in automotive drivers. IEEE Trans. Intell. Transp. Syst. 14, 1825–1838 (2013)
Teyeb, I., Jemai, O., Zaied, M., Ben Amar, C.: A drowsy driver detection system based on a new method of head posture estimation. In: Corchado, E., Lozano, J.A., Quintián, H., Yin, H. (eds.) IDEAL 2014. LNCS, vol. 8669, pp. 362–369. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10840-7_44
Choi, I.H., Hong, S.K., Kim, Y.G.: Real-time categorization of driver’s gaze zone using the deep learning techniques. In: International Conference on Big Data and Smart Computing (BigComp) (2016)
Arashloo, S., Kittler, J.: Dynamic texture recognition using multiscale binarized statistical image features. IEEE Trans. Multimedia 16, 2099–2109 (2014)
Päivärinta, J., Rahtu, E., Heikkilä, J.: Volume local phase quantization for blur-insensitive dynamic texture classification. In: Heyden, A., Kahl, F. (eds.) SCIA 2011. LNCS, vol. 6688, pp. 360–369. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21227-7_34
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29, 915–928 (2007)
Niu, G., Wang, C.: Driver fatigue features extraction. Math. Probl. Eng. (2014)
Donahue, J., et al.: Long-term recurrent convolutional networks for visual recognition and description. In: CVPR (2015)
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (2014)
Tuzel, O., Porikli, F., Meer, P.: A fast descriptor for detection and classification. In: European Conference on Computer Vision, pp. 589–600 (2006)
Szeliski, R.: Computer Vision Algorithms and Applications. Springer, London (2011). https://doi.org/10.1007/978-1-84882-935-0
Park, S., Pan, F., Kang, S., Yoo, C.D.: Driver drowsiness detection system based on feature representation learning using various deep networks. In: Asian Conference on Computer Vision Workshops (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Dornaika, F., Khattar, F., Reta, J., Arganda-Carreras, I., Hernandez, M., Ruichek, Y. (2019). Image-Based Driver Drowsiness Detection. In: Bai, X., et al. Video Analytics. Face and Facial Expression Recognition. FFER DLPR 2018 2018. Lecture Notes in Computer Science(), vol 11264. Springer, Cham. https://doi.org/10.1007/978-3-030-12177-8_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-12177-8_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-12176-1
Online ISBN: 978-3-030-12177-8
eBook Packages: Computer ScienceComputer Science (R0)