Abstract
In the human race, Fatigue may contribute to a decline in efficiency. Fatigue is a risk factor for health and a component of quality degradation. The effects of Fatigue include sleep disorders, depression, and worry, all of which can lead to life-threatening issues. This project uses machine learning and deep learning techniques to identify a person’s degree of Fatigue and its effects. The developed deep learning network can accurately distinguish between normal and exhausted states. This detection device uses physiological characteristics to guarantee high detection rates and accuracy. The project aims to recognize fatigue levels by examining the features extracted from the batch of images and classifying them into their respective class labels, such as Alert, Non-Vigilant, and Fatigued. To implement the detection procedures using deep structured learning that will yield very accurate image recognition and classification results, a large-scale image dataset is transported through efficient algorithm strategies and is processed to transform the data by labelling the patterns, tracking the correlations, and producing supreme results. The images will be diagnosed by employing the pre-trained models of the Convolutional Neural Networks (CNN), convolving through the hidden layers, applying the filters, and sharing the weights. Alex Net, Resnet50, and MobilenetV2 are the potential classifiers that will expand, filter, train, compress, and test through the neurons of the subjects. The layers and the non-linear functionalities are designed in the wake of the structured embedding of the model to deliver efficient metrics. The proposal offers the best accuracy for the established MobilenetV2 model with 99.8% accuracy and validates it with high-performance results.















Similar content being viewed by others
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
References
Shi, J., & Wang, K. (2023). Fatigue driving detection method based on time-space-frequency features of multimodal signals. Biomedical Signal Processing and Control, 84, 104744. https://doi.org/10.1016/j.bspc.2023.104744
Liu, Z., Peng, Y., & Wenjin, Hu. (2020). Driver fatigue detection based on deeply-learned facial expression representation. Journal of Visual Communication and Image Representation, 71, 102723. https://doi.org/10.1016/j.jvcir.2019.102723
Wang, F., Shichao, Wu., Zhang, W., Zongfeng, Xu., Zhang, Y., & Chu, H. (2020). Multiple nonlinear features fusion based driving fatigue detection. Biomedical Signal Processing, and Control, 62, 102075. https://doi.org/10.1016/j.bspc.2020.102075
Jia, H., Xiao, Z., & Ji, P. (2022). Real-time fatigue driving detection system based on multi-module fusion. Computers & Graphics, 108, 22–33. https://doi.org/10.1016/j.cag.2022.09.001
Jia, H., Xiao, Z., & Ji, P. (2023). End-to-end fatigue driving EEG signal detection model based on improved temporal-graph convolution network. Computers in Biology and Medicine, 152, 106431. https://doi.org/10.1016/j.compbiomed.2022.106431
Antwi-Afari, M. F., Anwer, S., Umer, W., Mi, H. Y., Yu, Y., Moon, S., & Hossain, M. U. (2023). Machine learning-based identification and classification of physical fatigue levels: A novel method based on a wearable insole device. International Journal of Industrial Ergonomics, 93, 103404. https://doi.org/10.1016/j.ergon.2022.103404
Zhao, L., Li, M., He, Z., Ye, S., Qin, H., Zhu, X., & Dai, Z. (2022). Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals. Measurement, 201, 111648. https://doi.org/10.1016/j.measurement.2022.111648
Helwing, R., Hülsbusch, D., & Walther, Frank. (2022). Deep learning method for analysis and segmentation of fatigue damage in X-ray computed tomography data for fiber-reinforced polymers. Composites Science and Technology, 230, 109781. https://doi.org/10.1016/j.compscitech.2022.109781
Yin, C., Zhou, X., Zhao, Y., Zheng, Y., Shi, Y., Yan, X., & Guo, X. (2022). Diagnosis of exercise-induced cardiac fatigue based on deep learning and heart sounds. Applied Acoustics, 197, 108900. https://doi.org/10.1016/j.apacoust.2022.108900
Zheng, Y., Ma, Y., Cammon, J., Zhang, S., Zhang, J., & Zhang, Y. (2022). A new feature selection approach for driving fatigue EEG detection with a modified machine learning algorithm. Computers in Biology and Medicine, 147, 105718. https://doi.org/10.1016/j.compbiomed.2022.105718
Ye, C., Yin, Z., Zhao, M., Tian, Y., & Sun, Z. (2022). Identification of mental fatigue levels in a language understanding task based on multi-domain EEG features and an ensemble convolutional neural network. Biomedical Signal Processing and Control, 72, 103360. https://doi.org/10.1016/j.bspc.2021.103360
Zhang, Y., Guo, H., Zhou, Y., Chengji, X., & Liao, Yang. (2023). Recognising drivers’ mental fatigue based on EEG multi-dimensional feature selection and fusion. Biomedical Signal Processing and Control, 79, 104237. https://doi.org/10.1016/j.bspc.2022.104237
Escobar-Linero, E., & Domínguez-Morales, M. (2022). José Luis Sevillano, Worker’s physical fatigue classification using neural networks. Expert Systems with Applications, 198, 116784. https://doi.org/10.1016/j.eswa.2022.116784
Li, R., Gao, R., & Suganthan, P. N. (2023). A decomposition-based hybrid ensemble CNN framework for driver fatigue recognition. Information Sciences, 624, 833–848. https://doi.org/10.1016/j.ins.2022.12.088
Karthick, P. A., Ghosh, D. M., & Ramakrishnan, S. (2018). Surface electromyography-based muscle fatigue detection using high-resolution time-frequency methods and machine learning algorithms. Computer Methods and Programs in Biomedicine, 154, 45–56. https://doi.org/10.1016/j.cmpb.2017.10.024
Min, J., Xiong, C., Zhang, Y., & Cai, M. (2021). Driver fatigue detection based on prefrontal EEG using multi-entropy measures and hybrid model. Biomedical Signal Processing and Control, 69, 102857. https://doi.org/10.1016/j.bspc.2021.102857
Allam, J. P., Samantray, S., Behara, C., Kurkute, K. K., & Sinha, V. K. (2022). 8 - Customized deep learning algorithm for drowsiness detection using single-channel EEG signal. In V. Bajaj & G. R. Sinha (Eds.), Artificial intelligence-based brain-computer interface. Academic Press.
Bekhouche, S. E., Ruichek, Y., & Dornaika, F. (2022). Driver drowsiness detection in video sequences using a hybrid selection of deep features. Knowledge-Based Systems, 252, 109436. https://doi.org/10.1016/j.knosys.2022.109436
Das, A. K., Kumar, P., & Halder, S. (2023). Complexity analysis of ocular signal for detection of human fatigue using small datasets. Procedia Computer Science, 218, 858–866. https://doi.org/10.1016/j.procs.2023.01.066
Ansari, S., Haiping, Du., Naghdy, F., & Stirling, D. (2022). Automatic driver cognitive fatigue detection based on upper body posture variations. Expert Systems with Applications, 203, 117568. https://doi.org/10.1016/j.eswa.2022.117568
He, H., Xiaoyong Zhang, F., Jiang, C. W., Yang, Y., Liu, W., & Peng, Jun. (2020). A real-time driver fatigue detection method based on two-stage convolutional neural network. IFAC-PapersOnLine, 53(2), 15374–15379. https://doi.org/10.1016/j.ifacol.2020.12.2357
Chen, J., Wang, S., He, E., Wang, H., & Wang, L. (2021). Recognizing drowsiness in young men during real driving based on electroencephalography using an end-to-end deep learning approach. Biomedical Signal Processing and Control, 69, 102792. https://doi.org/10.1016/j.bspc.2021.102792
Puttagunta, M., Subban, R., & Nelson Kennedy Babu, C. (2022). A novel COVID-19 detection model based on DCGAN and deep transfer learning. Procedia Computer Science, 204, 65–72. https://doi.org/10.1016/j.procs.2022.08.008
Abhishek, A., Jha, R. K., Sinha, R., & Jha, K. (2023). Automated detection and classification of leukemia on a subject-independent test dataset using deep transfer learning supported by Grad-CAM visualization. Biomedical Signal Processing and Control, 83, 104722. https://doi.org/10.1016/j.bspc.2023.104722
Gan, L., Hao, Wu., & Zhong, Z. (2022). Fatigue life prediction considering mean stress effect based on random forests and kernel extreme learning machine. International Journal of Fatigue, 158, 106761. https://doi.org/10.1016/j.ijfatigue.2022.106761
Liu, Y., Lan, Z., Cui, J., Sourina, O., & Müller-Wittig, W. (2020). Inter-subject transfer learning for EEG-based mental fatigue recognition. Advanced Engineering Informatics, 46, 101157. https://doi.org/10.1016/j.aei.2020.101157
Yin, Z., & Zhang, J. (2018). Task-generic mental fatigue recognition based on neurophysiological signals and dynamical deep extreme learning machine. Neurocomputing, 283, 266–281. https://doi.org/10.1016/j.neucom.2017.12.062
Hooda, R., Joshi, V., & Shah, M. (2021). A comprehensive review of approaches to detect fatigue using machine learning techniques. Chronic Diseases and Translational Medicine. https://doi.org/10.1016/j.cdtm.2021.07.002
Rahman, A., Hriday, M. B. H., & Khan, R. (2022). Computer vision-based approach to detect fatigue driving and face mask for an edge computing device. Heliyon, 8(10), e11204. https://doi.org/10.1016/j.heliyon.2022.e11204
Arqub, O. A., & Abo-Hammour, Z. (2014). Numerical solution of systems of second-order boundary value problems using continuous genetic algorithm. Information sciences, 279, 396–415.
Abu Arqub, O., Singh, J., Maayah, B., & Alhodaly, M. (2023). Reproducing kernel approach for numerical solutions of fuzzy fractional initial value problems under the Mittag-Leffler kernel differential operator. Mathematical Methods in the Applied Sciences, 46(7), 7965–7986.
Arqub, A., Omar, J. S., & Alhodaly, M. (2023). Adaptation of kernel functions-based approach with Atangana–Baleanu–Caputo distributed order derivative for solutions of fuzzy fractional Volterra and Fredholm integrodifferential equations. Mathematical Methods in the Applied Sciences, 46(7), 7807–7834.
Arqub, O. A., & Maayah, B. (2023). Adaptive the Dirichlet model of mobile/immobile advection/dispersion in a time-fractional sense with the reproducing kernel computational approach: Formulations and approximations. International Journal of Modern Physics B, 37(18), 2350179.
Raghavendran, P. S., Ragul, S., Asokan, R., Loganathan, A. K., Muthusamy, S., Mishra, O. P., Ramamoorthi, P., & Sundararajan, S. C. M. (2023). A new method for chest X-ray images categorization using transfer learning and CovidNet_2020 employing convolution neural network. Soft Computing, 27(19), 14241–14251. https://doi.org/10.1007/s00500-023-08874-7
Sinnaswamy, R. A., Palanisamy, N., Subramaniam, K., Muthusamy, S., Lamba, R., & Sekaran, S. (2023). An extensive review on deep learning and machine learning intervention in prediction and classification of types of aneurysms. Wireless Personal Communications, 131(3), 2055–2080. https://doi.org/10.1007/s11277-023-10532-y
Subramaniam, K., Palanisamy, N., Sinnaswamy, R. A., Muthusamy, S., Mishra, O. P., Loganathan, A. K., Ramamoorthi, P., Gnanakkan, C. A. R. C., Thangavel, G., & Sundararajan, S. C. M. (2023). A comprehensive review of analyzing the chest X-ray images to detect COVID-19 infections using deep learning techniques. Soft Computing, 27(19), 14219–14240. https://doi.org/10.1007/s00500-023-08561-7
Thangavel, K., Palanisamy, N., Muthusamy, S., Mishra, O. P., Sundararajan, S. C. M., Panchal, H., Loganathan, A. K., & Ramamoorthi, P. (2023). A novel method for image captioning using multimodal feature fusion employing mask RNN and LSTM models. Soft Computing, 27(19), 14205–14218. https://doi.org/10.1007/s00500-023-08448-7
Gnanadesigan, N. S., Dhanasegar, N., Ramasamy, M. D., Muthusamy, S., Mishra, O. P., Pugalendhi, G. K., Sundararajan, S. C. M., & Ravindaran, A. (2023). An integrated network topology and deep learning model for prediction of Alzheimer disease candidate genes. Soft Computing, 27(19), 14189–14203. https://doi.org/10.1007/s00500-023-08390-8
Krishnasamy, K. G., Periasamy, S., Periasamy, K., Prasanna Moorthy, V., Thangavel, G., Lamba, R., & Muthusamy, S. (2023). A pair-task heuristic for scheduling tasks in heterogeneous multi-cloud environment. Wireless Personal Communications, 131(2), 773–804.
Periyasamy, K., Rathinam, V., Ganesan, K., Ramachandran, M., Muthusamy, S., Lamba, R., Panchal, H., Shanmugam, M., Jalajakumari, S. P. S. N., & Kottapalli, R. (2023). A novel method for analyzing the performance of free space optical communication in WDM using EDFA. Wireless Personal Communications, 131(1), 679–707.
Batcha, B. B. C., Singaravelu, R., Ramachandran, M., Muthusamy, S., Panchal, H., Thangaraj, K., & Ravindaran, A. (2023). A novel security algorithm RPBB31 for securing the social media analyzed data using machine learning algorithms. Wireless Personal Communications, 131(1), 581–608.
Rakkiannan, T., Ekambaram, G., Palanisamy, N., Ramasamy, R. R., Muthusamy, S., Loganathan, A. K., Panchal, H., Thangaraj, K., & Ravindaran, A. (2023). An automated network slicing at edge with software defined networking and network function virtualization: a federated learning approach. Wireless Personal Communications, 131(1), 639–658.
Bennet, M. A., Mishra, O. P., & Muthusamy, S. (2023). Modeling of upper limb and prediction of various yoga postures using artificial neural networks. In 2023 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS), pp. 503–508. IEEE.
Wang, Y., Huang, R., & Guo, L. (2019). Eye gaze pattern analysis for fatigue detection based on GP-BCNN with ESM. Pattern Recognition Letters, 123, 61–74. https://doi.org/10.1016/j.patrec.2019.03.013
Zhao, C., Gao, Z., Wang, Q., Xiao, K., Zijia Mo, M., & Deen, J. (2023). FedSup: A communication-efficient federated learning fatigue driving behaviors supervision approach. Future Generation Computer Systems, 138, 52–60. https://doi.org/10.1016/j.future.2022.08.009
Tuncer, T., Dogan, S., & Subasi, A. (2021). EEG-based driving fatigue detection using multilevel feature extraction and iterative hybrid feature selection. Biomedical Signal Processing and Control, 68, 102591. https://doi.org/10.1016/j.bspc.2021.102591
Phan, A.-C., Trieu, T.-N., & Phan, T.-C. (2023). Driver drowsiness detection and smart alerting using deep learning and IoT. Internet of Things, 22, 100705. https://doi.org/10.1016/j.iot.2023.100705
Liu, F., Chen, D., Zhou, J., & Feng, Xu. (2022). A review of driver fatigue detection and its advances on the use of RGB-D camera and deep learning. Engineering Applications of Artificial Intelligence, 116, 105399. https://doi.org/10.1016/j.engappai.2022.105399
Lin, Z., Qiu, T., Liu, P., Zhang, L., Zhang, S., & Zhendong, Mu. (2021). Fatigue driving recognition based on deep learning and graph neural network. Biomedical Signal Processing and Control, 68, 102598. https://doi.org/10.1016/j.bspc.2021.102598
Funding
This work was supported by the Qatar National Research Fund under the grant number MME03-1226- 210042. The statements made herein are solely the responsibility of the authors.
Author information
Authors and Affiliations
Contributions
All authors contributed equally for the preparation of the manuscript. Naveen Sundar Gnanadesigan, Grace Angela Abraham Lincoln—Study conception and design. Narmadha Dhanasegar,Suresh Muthusamy—Data collection and analysis. Deeba Kannan, Surendiran Balasubramanian—Interpretation of results and manuscript preparation. Nebojsa Bacanin, Kishor Kumar Sadasivuni—Overall supervision of the work.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical Approval
This material is the authors’ own original work, which has not been previously published elsewhere. The paper is not currently being considered for publication elsewhere. The paper reflects the authors’ own research and analysis in a truthful and complete manner.
Consent to Participate
I have been informed of the risks and benefits involved, and all my questions have been answered to my satisfaction. Furthermore, I have been assured that any future questions I may have will also be answered by a member of the research team. I voluntarily agree to take part in this study
Consent to Publish
Individuals may consent to participate in a study, but object to having their data published in a journal article
Human and Animal Rights
The authors hereby assure that this research does not involves any human participants or animals
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gnanadesigan, N.S., Lincoln, G.A.A., Dhanasegar, N. et al. A New Method for Detecting the Fatigue Using Automated Deep Learning Techniques for Medical Imaging Applications. Wireless Pers Commun 135, 1009–1034 (2024). https://doi.org/10.1007/s11277-024-11102-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-024-11102-6