Skip to main content
SpringerLink
Log in

A video system based on convolutional autoencoder for drowning detection

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Computer vision combined with deep learning technologies is widely used in video surveillance. In this paper, it is applied to drowning detection video systems. Traditional drowning detection methods detect drowning mainly by monitoring the physiological condition, the time and motion of swimmers in the water. But these methods are not applicable to detect early quiet drowning phenomena. Some researchers realize supervised classification by simulative drowning features. But real drowning events are difficult to truly simulate, so these methods are not reliable. In this paper, a drowning detection video system with edge computing is proposed, and it can detect drowning events in swimming pools without any wearable devices. According to the characteristics of drowning people, the strategies for underwater near-vertical human detection are proposed, providing a reliable basis for drowning detection. A lightweight drowning detection convolutional autoencoder is proposed to achieve unsupervised drowning detection, solving the lack of drowning videos and the inauthenticity of simulative videos. Then, an edge device is designed for detecting drowning in real time at the edge. Finally, for training and experimental evaluation, a pool dataset including many pool underwater video sequences is produced. The experimental results show that the proposed drowning detection method has a good comprehensive performance. The system is feasible and valuable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Organization WH, Bloomberg LP (2014) Global report on drowning: preventing a leading killer

  2. UNICEF, Bank W, Division UP (2014) Levels and trends in child mortality 2013. Lancet 243(6288):317

  3. Organization WH (2017) Preventing drowning: an implementation guide

  4. Laxton V, Crundall D (2018) The effect of lifeguard experience upon the detection of drowning victims in a realistic dynamic visual search task. Appl Cogn Psychol 32:14–23

    Article  Google Scholar 

  5. John SN, Godswill I, Osemwegie O, Onyiagha G, Okopujie K (2019) Design of a drowning rescue alert system

  6. Kulkarni A, Lakhani K, Lokhande S (2016) A sensor based low cost drowning detection system for human life safety. In: 2016 5th international conference on reliability, Infocom technologies and optimization (trends and future directions) (ICRITO), pp 301–306

  7. Roy A, Srinivasan K (2018) A novel drowning detection method for safety of swimmers. In: 2018 20th national power systems conference (NPSC). IEEE, pp 1–6

  8. Yong L, Minghao C, Tianran S, Wenrui L, Wensha G, Yong Q (2018) Application of Beidou navigation satellite system in anti-drowning system

  9. Ramani JG, Gayathri J, Aswanth R, Gunasekaran M (2019) Automatic prevention of drowning by inflatable wrist band system. In: 2019 5th international conference on advanced computing and communication systems (ICACCS), 346–349

  10. Dehbashi F, Ahmed N, Mehra M, Wang J, Abari O (2019) Swimtrack: drowning detection using rfid. In: Proceedings of the ACM SIGCOMM 2019 conference posters and demos, pp 161–162

  11. Drowning detection system (2019) Int J Recent Technol Eng

  12. Sneha M (2021) An automatic drowning detection and rescue system. Int J Res Appl Sci Eng Technol 9:1021–1028

    Article  Google Scholar 

  13. Yang D, Cao Y, Feng Y, Lai X, Pan Z (2021) Drowning detection algorithm for intelligent lifebuoy. In: 2021 IEEE international conference on unmanned systems (ICUS), pp 512–519

  14. Prakash BD (2018) Near-drowning early prediction technique using novel equations (neptune) for swimming pools. ArXiv:abs/1805.02530

  15. Kam AH, Lu W, Yau W-Y (2002) A video-based drowning detection system. In: ECCV

  16. Lu W, Tan Y-P (2002) Swimmer motion analysis with application to drowning detection. In: 2002 IEEE international symposium on circuits and systems. Proceedings (Cat. No.02CH37353) 2

  17. Lu W, Tan Y-P (2002) A camera-based system for early detection of drowning incidents. In: Proceedings of the international conference on image processing, vol 3. IEEE

  18. Eng H-L, Toh K-A, Kam AH, Wang J, Yau W-Y (2003) An automatic drowning detection surveillance system for challenging outdoor pool environments. In: Proceedings ninth IEEE international conference on computer vision, pp 532–5391

  19. Lu W, Tan Y-P (2004) A vision-based approach to early detection of drowning incidents in swimming pools. IEEE Trans Circuits Syst Video Technol 14:159–178

    Article  Google Scholar 

  20. Eng H-L, Toh K-A, Yau W-Y, Wang J (2008) Dews: a live visual surveillance system for early drowning detection at pool. IEEE Trans Circuits Syst Video Technol 18(2):196–210

    Article  Google Scholar 

  21. Fei L, Xueli W, Chen D (2009) Drowning detection based on background subtraction. In: 2009 International conference on embedded software and systems, pp 341–343

  22. Zhang C, Li X, Lei F (2015) A novel camera-based drowning detection algorithm. In: IGTA

  23. Salehi N, Keyvanara M, Monadjemmi SA (2016) An automatic video-based drowning detection system for swimming pools using active contours. Int J Image Graph Signal Process 8(8):1–8

    Article  Google Scholar 

  24. Hayat MA, Yang G, Iqbal A, Saleem A, Mateen MA (2019) Comprehensive and comparative study of drowning person detection and rescue systems. In: 2019 8th international conference on information and communication technologies (ICICT), pp 66–71

  25. Hou J, Li B (2021) Swimming target detection and tracking technology in video image processing. Microprocess Microsyst 80:103535

    Article  Google Scholar 

  26. Pavithra P, Nandini S, Nanthana A, Aslam NT, Kumar P (2021) Video based drowning detection system. In: 2021 International conference on design innovations for 3Cs compute communicate control (ICDI3C). IEEE, pp 203–206

  27. Chan J, Ng M, Ng Y (2017) Drowning in swimming pools: clinical features and safety recommendations based on a study of descriptive records by emergency medical services attending to 995 calls. Singapore Med J 59(1):44–49

    Article  Google Scholar 

  28. Li K (2021) Construction method of swimming pool intelligent assisted drowning detection model based on computer feature pyramid networks. J Phys Conf Ser 2137:012065

    Article  Google Scholar 

  29. Lei F, Zhu H, Tang F, Wang X (2022) Drowning behavior detection in swimming pool based on deep learning. Signal Image Video Process 16:1–8

    Article  Google Scholar 

  30. Kharrat M, Wakuda Y, Koshizuka N, Sakamura K (2012) Near drowning pattern detection using neural network and pressure information measured at swimmer’s head level. In: WUWNet ’12

  31. Shiuuee K, Rezaei F (2019) A presentation of drowning detection system on coastal lines using image processing techniques and neural network. J Injury Violence Res 11:18

    Google Scholar 

  32. Hasan S, Joy J, Ahsan F, Khambaty H, Agarwal M, Mounsef J (2021) A water behavior dataset for an image-based drowning solution. In: 2021 IEEE green energy and smart systems conference (IGESSC), pp 1–5

  33. Ms MR, Ali M, N, P, G, NE, Ali S, MYK (2018) An early drowning detection system for internet of things (iot) applications. TELKOMNIKA Telecommun Comput Electron Control

  34. Chan Y-T, Hou T-W, Huang Y-L, Lan W-H, Wang P-C, Lai C-T (2020) Implementation of deep-learning-based edge computing for preventing drowning

  35. Liu W, Luo W, Lian D, Gao S (2018) Future frame prediction for anomaly detection—a new baseline. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6536–6545

  36. Hasan M, Choi J, Neumann J, Roy-Chowdhury AK, Davis LS (2016) Learning temporal regularity in video sequences. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 733–742

  37. Chong YS, Tay YH (2017) Abnormal event detection in videos using spatiotemporal autoencoder. In: International symposium on neural networks. Springer, pp 189–196

  38. Park H, Noh J, Ham B (2020) Learning memory-guided normality for anomaly detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 14372–14381

  39. LV H, Chen C, Cui Z, Xu C, Li Y, Yang J (2021) Learning normal dynamics in videos with meta prototype network. In: The IEEE conference on computer vision and pattern recognition (CVPR)

  40. Liu Z, Nie Y, Long C, Zhang Q, Li G (2021) A hybrid video anomaly detection framework via memory-augmented flow reconstruction and flow-guided frame prediction. In: Proceedings of the IEEE international conference on computer vision

  41. Kharrat M, Wakuda Y, Koshizuka N, Sakamura K (2012) Near drowning pattern recognition using neural network and wearable pressure and inertial sensors attached at swimmer’s chest level. In: 2012 19th international conference on mechatronics and machine vision in practice (M2VIP). IEEE, pp 281–284

  42. John SN, Ukpabio IG, Omoruyi O, Onyiagha G, Noma-Osaghae E, Okokpujie KO (2019) Design of a drowning rescue alert system. Int J Mech Eng Technol (IJMET) 10(1):1987–1995

    Google Scholar 

  43. Monish P, Darshan R, Ponvalavan K, Bharathi M (2021) Drowning alert system using rf communication and gprs/gsm. J Phys Conf Ser 1997:012044

    Article  Google Scholar 

  44. Meniere J (2000) System for monitoring a swimming pool to prevent drowning accidents. Google Patents. US Patent 6,133,838

  45. Reza AM (2004) Realization of the contrast limited adaptive histogram equalization (clahe) for real-time image enhancement. J VLSI Signal Process Syst Signal Image Video Technol 38(1):35–44

    Article  Google Scholar 

  46. Jocher G, Stoken A, Chaurasia A, Borovec J, NanoCode012, TaoXie, Kwon Y, Michael K, Changyu L, Fang JVA, Laughing, tkianai, yxNONG, Skalski, P, Hogan A, Nadar J, imyhxy, Mammana L, AlexWang1900, Fati C, Montes D, Hajek J, Diaconu L, Minh MT, Marc, albinxavi, fatih, oleg, wanghaoyang0106: ultralytics/yolov5: V6.0 - YOLOv5n ’Nano’ Models, Roboflow Integration, TensorFlow Export, OpenCV DNN Support. https://doi.org/10.5281/zenodo.5563715

  47. Rezatofighi SH, Tsoi N, Gwak J, Sadeghian A, Reid I, Savarese S (2019) Generalized intersection over union: a metric and a loss for bounding box regression. In: 2019 IEEE/CVF conference on computer vision and pattern recognition (CVPR), pp 658–666

  48. Ma N, Zhang X, Zheng H-T, Sun J (2018) Shufflenet v2: practical guidelines for efficient cnn architecture design. In: Proceedings of the European conference on computer vision (ECCV), pp 116–131

  49. Ulyanov D, Vedaldi A, Lempitsky V (2016) Instance normalization: the missing ingredient for fast stylization. arXiv:1607.08022

  50. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv:1412.6980

Download references

Acknowledgements

The authors would like to thank the National Natural Science Foundation of China (62271425) and the Great Science & Technology  Projects of Xiamen (3502Z20231008).

Author information

Authors and Affiliations

  1. The School of Information, Xiamen University, Xiamen, China

    Xinyu He, Fei Yuan, Tingzhuang Liu & Yi Zhu

Authors
  1. Xinyu He
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fei Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tingzhuang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yi Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fei Yuan.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest in this research work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, X., Yuan, F., Liu, T. et al. A video system based on convolutional autoencoder for drowning detection. Neural Comput & Applic 35, 15791–15803 (2023). https://doi.org/10.1007/s00521-023-08526-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-08526-9

Keywords

Search

Navigation