Amina Guettas
ABSTRACT
Abstract. Eye state recognition has been the subject of many studies due to its importance in many fields especially drowsy driver detection, which is crucial task that must be done in real time and mostly using limited hardware. These restrictions make resource consuming learning techniques such as deep learning difficult to use. Deep mobile learning seems to be a viable solution to solving this issue. In this paper, we propose a real time system based on deep mobile learning to classify the eye state, and compare its performance with classical machine learning methods. The experimental results on the Closed Eyes in the Wild (CEW) and MRL Eye Datasets show that the proposed approach outperformed the other machine learning techniques in terms of accuracy and execution time. In addition, we evaluated our system on a video dataset to demonstrate its reliability and robustness.
- Drowsy Driving, https://www.nhtsa.gov/risky-driving/drowsy-driving, last accessed 2021/03/02.Google Scholar
- Guettas, A., Ayad, S., Kazar, O.: Driver State Monitoring System: A Review. In: Proceedings of the 4th International Conference on Big Data and Internet of Things. pp. 1–7 (2019).Google Scholar
- Zhang, F., Su, J., Geng, L., Xiao, Z.: Driver fatigue detection based on eye state recognition. In: 2017 International Conference on Machine Vision and Information Technology (CMVIT). pp. 105–110 (2017).Google ScholarCross Ref
- Zhao, L., Wang, Z., Zhang, G., Qi, Y., Wang, X.: Eye state recognition based on deep integrated neural network and transfer learning. Multimed. Tools Appl. 77, 19415–19438 (2018).Google Scholar
- Ji, Y., Wang, S., Lu, Y., Wei, J., Zhao, Y.: Eye and mouth state detection algorithm based on contour feature extraction. J. Electron. Imaging. 27, 51205 (2018).Google ScholarCross Ref
- Gou, C., Wu, Y., Wang, K., Wang, K., Wang, F.-Y., Ji, Q.: A joint cascaded framework for simultaneous eye detection and eye state estimation. Pattern Recognition. 67, 23–31 (2017).Google ScholarCross Ref
- Alorf, A., Abbott, A.L.: In defense of low-level structural features and SVMs for facial attribute classification: Application to detection of eye state, Mouth State, and eyeglasses in the wild. In: 2017 IEEE International Joint Conference on Biometrics (IJCB). pp. 599–607 (2017).Google ScholarDigital Library
- Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001. pp. I–I (2001).Google Scholar
- Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 1867–1874 (2014).Google ScholarDigital Library
- Facial point annotations, https://ibug.doc.ic.ac.uk/resources/facial-point-annotations/, last accessed 2021/03/02.Google Scholar
- Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size. arXiv Prepr. arXiv1602.07360. (2016).Google Scholar
- 12. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv Prepr. arXiv1704.04861. (2017).Google Scholar
- Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems. pp. 1097–1105 (2012).Google Scholar
- Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. pp. 248–255 (2009).Google ScholarCross Ref
- Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv Prepr. arXiv1409.1556. (2014).Google Scholar
- Song, F., Tan, X., Liu, X., Chen, S.: Eyes closeness detection from still images with multi-scale histograms of principal oriented gradients. Pattern Recognit. 47, 2825–2838 (2014).Google ScholarCross Ref
- Fusek, R.: Pupil localization using geodesic distance. Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics). 11241 LNCS, 433–444 (2018). https://doi.org/10.1007/978-3-030-03801-4_38.Google Scholar
- Byrnes, A., Sturton, C.: On Using Drivers’ Eyes to Predict Accident-Causing Drowsines Levels. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC). pp. 2092–2097 (2018).Google Scholar
- Soukupová, T., Cech, J.: Eye blink detection using facial landmarks. In: 21st computer vision winter workshop, Rimske Toplice, Slovenia (2016).Google Scholar
Recommendations
Eye state recognition based on deep integrated neural network and transfer learning
Eye state recognition is widely used in many fields, such as driver drowsiness recognition, facial expression classification, and human---computer interface technology. This study proposes a novel framework based on the deep learning method to classify ...
Real-time eye state recognition using dual convolutional neural network ensemble
AbstractAutomatic recognition of the eye states is essential for diverse computer vision applications related to drowsiness detection, facial emotion recognition (FER), human–computer interaction (HCI), etc. Existing solutions for eye state detection are ...
Discussion on Machine Learning and Deep Learning based Makeup Considered Eye Status Recognition for Driver Drowsiness
AbstractDriver drowsiness is a primary causes of traffic accidents, may bring great economic and physical harm not only to divers but also to traffic accident victim(s) and their families. Several systems have been developed for detecting the drivers ...
Comments