Skip to main content
Springer Nature Link
Log in

Drowning behavior detection in swimming pool based on deep learning

  • Original Article
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

In order to quickly help lifesavers judge whether people are drowning in the swimming pool, this paper proposes one efficient behavior recognition approach by means of video sequences of underwater. First, by analyzing the spatial distribution of swimming pool when swimmers are normally swimming, the data labeling and swimmer detection methods are determined. Second, a behavior recognition framework of swimmers on the basis of YOLOv4 algorithm (BR-YOLOv4) is proposed in this paper. The spatial relationship between the location information of the target and swimming/drowning area of swimming pool is analyzed to further determine the swimmer’s drowning or swimming behavior. This paper compares the detection accuracy of different detection algorithms and analyzes the detection effect of different pool angles and different swimmer densities. Test results show that the mean precision rate of drowning is 94.62%, the mean false rate is 1.43% , and the mean missing rate is 3.57%. The mean precision rate of swimming is 97.86%, the mean false rate is 7.93%, the mean missing rate is 5.93% , and the average frame rate is 33f/s. All the results show that the method proposed in this paper meets the real-time detection requirements and does well in swimmer behavior recognition and provides technical support for reducing drowning accidents in public swimming pools.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Meddings, D., Altieri, E., Bierens, J., Cassell, E., Gissing, A., Guevarra, J.: Preventing Drowning: An Implementation Guide. World Health Organization, Oxford (2017)

    Google Scholar 

  2. Chan, J., Ng, M., Ng, Y.: Drowning in swimming pools: clinical features and safety recommendations based on a study of descriptive records by emergency medical services attending to 995 calls. Singapore Med. J. 59(1), 44–49 (2017)

    Article  Google Scholar 

  3. Ajil R., Srinivasan, K.: A novel drowning detection method for safety of swimmers. In: 2018 20th National Power Systems Conference (NPSC), pp. 1–6. IEEE (2018)

  4. Eng, H.L., Wang, J., Kam, A.H., Yau, W.Y.: Novel region-based modeling for human detection within highly dynamic aquatic environment. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR (2004)

  5. Bierens, J., Scapigliati, A.: Drowning in swimming pools. Microchem. J. 113, 53–58 (2014)

    Article  Google Scholar 

  6. Salehi, N., Keyvanara, M., Monadjemmi, S.A.: An automatic video-based drowning detection system for swimming pools using active contours. Int. J. Image Gr. Signal Process. 8(8), 1–8 (2016)

    Google Scholar 

  7. Hou, J., Li, B.: Swimming target detection and tracking technology in video image processing. Microprocessors Microsyst. 80(3), 103535 (2021)

    Article  Google Scholar 

  8. Hayat, M.A., Yang, G., Iqbal, A., Saleem, A., Mateen, M.: The swimmers motion detection using improved vibe algorithm. In: 2019 International Conference on Robotics and Automation in Industry (ICRAI) (2019)

  9. Fei, L., Wang, X., Chen, D.: Drowning detection based on background subtraction. In: 2009 International Conference on Embedded Software and Systems (2009)

  10. Huafu, D.J., Cheng, T., Liu, B., Cheng, Z.S.: Research on iron surface crack detection algorithm based on improved yolov4 network. J. Phys. Conf. Ser. 9, 1098 (2020)

    Google Scholar 

  11. Li, Y., Wang, H., Dang, L.M., Han, D., Moon, H.: A deep learning-based hybrid framework for object detection and recognition in autonomous driving. In: IEEE Access (2020)

  12. Yang, A., Huang, H., Zheng, B., Li, S., Xue, Y.: An automatic recognition framework for sow daily behaviours based on motion and image analyses. Biosys. Eng. 192, 56–71 (2020)

    Article  Google Scholar 

  13. Kharrat, M., Wakuda, Y., Koshizuka, N., Sakamura, K.: Near drowning pattern recognition using neural network and wearable pressure and inertial sensors attached at swimmer’s chest level. In: Mechatronics and Machine Vision in Practice (M2VIP), 2012 19th International Conference (2012)

  14. Abdel, I.N., Alshbatat, S.A., Shamsa, A., Salama, A., Wadhha, A.: Automated vision-based surveillance system to detect drowning incidents in swimming pools. In: 2020 Advances in Science and Engineering Technology International Conferences (ASET), pp. 1–5 (2020)

  15. Claesson, A., Schierbeck, S., Hollenberg, J., Forsberg, S., Nord, A.: The use of drones and a machine-learning model for recognition of simulated drowning victims-a feasibility study. Resuscitation 156, 108 (2020)

    Article  Google Scholar 

  16. Alotaibi, A.: Automated and intelligent system for monitoring swimming pool safety based on the IoT and transfer learning (2020)

  17. Morten, B., Jensen, R.G., Thomas, B.: Moeslund swimming pool occupancy analysis using deep learning on low quality video. In: Proceedings of the 1st International Workshop on Multimedia Content Analysis in Sports (2018)

  18. Wang, F., Ai, Y., Zhang, W.: Detection of early dangerous state in deep water of indoor swimming pool based on surveillance video (2021)

  19. Bochkovskiy, A., Wang, C.Y., Hym L.: Yolov4: optimal speed and accuracy of object detection (2020)

  20. Redmon, J., Farhadi, A.: Yolov3: an incremental improvement. arXiv e-prints (2018)

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, China

    Fei Lei, Hengyu Zhu, Feifei Tang & Xinyuan Wang

Authors
  1. Fei Lei
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Hengyu Zhu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Feifei Tang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Xinyuan Wang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Hengyu Zhu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lei, F., Zhu, H., Tang, F. et al. Drowning behavior detection in swimming pool based on deep learning. SIViP 16, 1683–1690 (2022). https://doi.org/10.1007/s11760-021-02124-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-021-02124-9

Keywords