Abstract
The COVID-19 pandemic, which affected over 400 million people worldwide and caused nearly 6 million deaths, has become a nightmare. Along with vaccination, self-testing, and physical distancing, wearing a well-fitted mask can help protect people by reducing the chance of spreading the virus. Unfortunately, researchers indicate that most people do not wear masks correctly, with their nose, mouth, or chin uncovered. This issue makes masks a useless tool against the virus. Recent studies have attempted to use deep learning technology to recognize wrong mask usage behavior. However, current solutions either tackle the mask/non-mask classification problem or require heavy computational resources that are infeasible for a computational-limited system. We focus on constructing a deep learning model that achieves high-performance results with low processing time to fill the gap in recent research. As a result, we propose a framework to identify mask behaviors in real-time benchmarked on a low-cost, credit-card-sized embedded system, Raspberry Pi 4. By leveraging transfer learning, with only 4–6 h of the training session on approximately 5,000 images, we achieve a model with accuracy ranging from 98 to 99% accuracy with the minimum of 0.1 s needed to process an image frame. Our proposed framework enables organizations and schools to implement cost-effective correct face mask usage detection on constrained devices.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Dong, E., Du, H., Gardner, L.: An interactive web-based dashboard to track covid-19 in real time. Lancet Infect. Dis. 20(5), 533–534 (2020)
Mathieu, E., et al.: A global database of covid-19 vaccinations. Nat. Human Behav. 5(7), 947–953 (2021)
Esmaeilzadeh, P.: Public concerns and burdens associated with face mask-wearing: lessons learned from the covid-19 pandemic. Prog. Disast. Sci. 13, 100215 (2022). https://www.sciencedirect.com/science/article/pii/S2590061722000023
Ganczak, M., Pasek, O., Duda-Duma, Ł, Świstara, D., Korzeń, M.: Use of masks in public places in Poland during sars-cov-2 epidemic: a covert observational study. BMC Public Health 21(1), 1–10 (2021)
Liu, W., et al.: SSD: single shot multibox detector. CoRR, vol. abs/1512.02325 (2015). http://arxiv.org/abs/1512.02325
Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. CoRR, vol. abs/1804.02767 (2018). http://arxiv.org/abs/1804.02767
Bochkovskiy, A., Wang, C., Liao, H.M.: Yolov4: optimal speed and accuracy of object detection. CoRR, vol. abs/2004.10934 (2020). https://arxiv.org/abs/2004.10934
Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection. CoRR, vol. abs/1506.02640 (2015). http://arxiv.org/abs/1506.02640
Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. CoRR, vol. abs/1612.08242 (2016). http://arxiv.org/abs/1612.08242
Fan, X., Jiang, M.: Retinafacemask: a single stage face mask detector for assisting control of the covid-19 pandemic. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 832–837. IEEE (2021)
Ejaz, M.S., Islam, M.R., Sifatullah, M., Sarker, A.: Implementation of principal component analysis on masked and non-masked face recognition. In: 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), pp. 1–5 (2019)
Viola, P., Jones, M.: Robust real-time object detection. Int. J. Comput. Vision 57, 137–154 (2001)
Enriquez, K.: Faster face detection using convolutional neural networks & the viola-jones algorithm (2018)
Yang, S., Luo, P., Loy, C.C., Tang, X.: Wider face: a face detection benchmark. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: convolutional block attention module. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 3–19 (2018)
Szegedy, C., et al.: Going deeper with convolutions. CoRR, vol. abs/1409.4842 (2014). http://arxiv.org/abs/1409.4842
Joshi, A.S., Joshi, S.S., Kanahasabai, G., Kapil, R., Gupta, S.: Deep learning framework to detect face masks from video footage. In: 2020 12th International Conference on Computational Intelligence and Communication Networks (CICN), pp. 435–440 (2020)
Zamir, A.R., Sax, A., Shen, W., Guibas, L.J., Malik, J., Savarese, S.: Taskonomy: disentangling task transfer learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3712–3722 (2018)
Cabani, A., Hammoudi, K., Benhabiles, H., Melkemi, M.: Maskedface-net-a dataset of correctly/incorrectly masked face images in the context of covid-19. Smart Health 19, 100144 (2021)
Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adversarial networks. CoRR, vol. abs/1812.04948 (2018). http://arxiv.org/abs/1812.04948
Howard, A.G., et al.: Mobilenets: efficient convolutional neural networks for mobile vision applications. CoRR, vol. abs/1704.04861 (2017). http://arxiv.org/abs/1704.04861
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. CoRR, vol. abs/1512.03385 (2015). http://arxiv.org/abs/1512.03385
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Hoang Pham, M., Van Nguyen, S., Le, T., Tien Nguyen, H., Duy Le, T., Trawinski, B. (2022). A Correct Face Mask Usage Detection Framework by AIoT. In: Nguyen, N.T., Tran, T.K., Tukayev, U., Hong, TP., Trawiński, B., Szczerbicki, E. (eds) Intelligent Information and Database Systems. ACIIDS 2022. Lecture Notes in Computer Science(), vol 13758. Springer, Cham. https://doi.org/10.1007/978-3-031-21967-2_32
Download citation
DOI: https://doi.org/10.1007/978-3-031-21967-2_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-21966-5
Online ISBN: 978-3-031-21967-2
eBook Packages: Computer ScienceComputer Science (R0)