Skip to main content

Advertisement

SpringerLink
Log in

Robust human detection system in flood related images with data augmentation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Floods are one of the major natural disasters that are very common in monsoon countries like India. They cause enormous damage, both to properties and to human lives. It is very essential to detect humans in flooded environments, which plays an important role in rescue management, disaster management, flood assessment, etc. Detection in a flooded environment is particularly challenging due to the weather conditions, which affect the efficiency of the detection system. The limited availability of proper datasets with natural weather changes also affects the robustness of human object detection in flooded images. In this paper, data augmentation techniques are introduced in order to mimic the changing weather conditions such as rainy, cloudy, and foggy days during flood times, and a HOG-based Robust Human Object Detection (HOG_based_RHOD) algorithm is proposed and has been demonstrated on the augmented dataset. The proposed HOG_based_RHOD algorithm detects human objects in flood-related images, demonstrating its robustness in a variety of challenging weather conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

Data availability

The datasets generated and analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Aarthy KP, Ramesh K, Venkatesh VPP, Chitrakala S, Bhatt CM (2021, 2022) Social media analysis for flood nuggests extraction using relevant posts filtration. Int Conf Comput Intell Data Eng – ICCIDE 2021. https://doi.org/10.1007/978-981-16-7182-1_17

  2. Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167

    Article  Google Scholar 

  3. Chaudhary P, D'Aronco S, de Vitry MM, Leitão JP, Wegner JD (2019) Flood-water level estimation from social media images. ISPRS annals of the photogrammetry. Remote Sensing Spatial Inform Sci 2:5–12. https://doi.org/10.5194/isprs-annals-IV-2-W5-5-2019

    Article  Google Scholar 

  4. Chen HT, Liu CH, Tsai WJ (2018) Data augmentation for Cnn-based people detection in aerial images. IEEE international conference on Multimedia & Expo Workshops (ICMEW) 1-6. https://doi.org/10.1109/ICMEW.2018.8551501

  5. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 1:886–893. https://doi.org/10.1109/CVPR.2005.177

  6. Degrossi LC, de AlbuquerqueJP, Fava MC, Mendiondo EM (2014) Flood Citizen Observatory: a crowdsourcing-based approach for flood risk management in Brazil. SEKE 570–575. https://ksiresearch.org/seke/seke14paper/seke14paper_74.pdf

  7. Feng Y, Brenner C, Sester M (2020) Flood severity mapping from volunteered geographic information by interpreting water level from images containing people: a case study of hurricane Harvey. ISPRS J Photogramm Remote Sens 169:301–319. https://doi.org/10.1016/j.isprsjprs.2020.09.011

    Article  Google Scholar 

  8. Fujimoto Y, Fujita K (2019) Depth-based human detection considering postural diversity and depth missing in office environment. IEEE Access 7:12206–12219. https://doi.org/10.1109/ACCESS.2019.2892197

    Article  Google Scholar 

  9. Geetha M, Megha Manoj ASS, Mohan M, Rao SN (2017) Detection and estimation of the extent of flood from crowd sourced images. Int Conf Commun Signal Process (ICCSP) 0603–0608. https://doi.org/10.1109/ICCSP.2017.8286429

  10. Giannakeris P, Avgerinakis K, Karakostas A, Vrochidis S, Kompatsiaris I (2018) People and vehicles in danger-A fire and flood detection system in social media. IEEE 13th Image, Video, Multidimen Signal Process Workshop (IVMSP), 1–5. https://doi.org/10.1109/IVMSPW.2018.8448732

  11. Gong M, Zhao J, Liu J, Miao Q, Jiao L (2015) Change detection in synthetic aperture radar images based on deep neural networks. IEEE Trans Neural Networks Learn Syst 27(1):125–138. https://doi.org/10.1109/TNNLS.2015.2435783

    Article  MathSciNet  Google Scholar 

  12. Keerthana T and Kala L (2019) A real time YOLO human detection in flood affected areas based on video content analysis. Int Res J Eng Technol(IRJET). 06(06): https://www.irjet.net/archives/V6/i6/IRJET-V6I6539.pdf

  13. Liu T, Fu HY, Wen Q, Zhang DK, Li LF (2018) Extended faster R-CNN for long distance human detection: finding pedestrians in UAV images. IEEE Int Conf Consumer Electron (ICCE):1-2. https://doi.org/10.1109/ICCE.2018.8326306

  14. Mittal P, Sharma A, Singh R (2020) Deep learning-based object detection in low-altitude UAV datasets: A survey Image and Vision Computing 104046. https://doi.org/10.1016/j.imavis.2020.104046

  15. Nasim M, Ramaraju GV (2019) Finding Survivors In Flood Affected Areas During Response Operations By Deep Learning Approach. Int J Eng Adv Technol (IJEAT). 4(8):2249–8958. https://www.ijeat.org/wp-content/uploads/papers/v8i4/D6115048419.pdf

  16. Nguyen DT, Li W, Ogunbona PO (2016) Human detection from images and videos: a survey. Pattern Recogn 51:148–175. https://doi.org/10.1016/j.patcog.2015.08.027

    Article  Google Scholar 

  17. Nikouei SY, Chen Y, Song S, Xu R, Choi BY, Faughnan TR (2018) Real-time human detection as an edge service enabled by a lightweight cnn. IEEE Int Conference on EDGE computing (EDGE):125-129. https://doi.org/10.48550/arXiv.1805.00330

  18. Okafor E, Schomaker L, Wiering MA (2018) An analysis of rotation matrix and colour constancy data augmentation in classifying images of animals. J Inform Telecommun 2(4):465–491. https://doi.org/10.1080/24751839.2018.1479932

    Article  Google Scholar 

  19. Pang Y, Yuan Y, Li X, Pan J (2011) Efficient HOG human detection. Signal Process 4:773–781. https://doi.org/10.1016/j.sigpro.2010.08.010

    Article  MATH  Google Scholar 

  20. Quan K-A C, Nguyen V-T, Nguyen T-C, Nguyen TV, Tran M-T (2020) Flood level prediction via human pose estimation from social media images. In Proceedings of the 2020 International Conference on Multimedia Retrieval, ICMR ‘20, 479–485. https://doi.org/10.1145/3372278.3390704

  21. Salehinejad H, Valaee S, Dowdell T, Barfett J (2018) Image augmentation using radial transform for training deep neural networks. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): 3016–3020. https://doi.org/10.1109/ICASSP.2018.8462241

  22. Smith L, Liang Q, James P, Lin W (2017) Assessing the utility of social media as a data source for flood risk management using a real-time modelling framework. Journal of Flood Risk Management 3(10):370–380. https://doi.org/10.1111/jfr3.12154

    Article  Google Scholar 

  23. Vallimeena, P., Bhavana BN, Rao SN (2018) Machine vision based flood depth estimation using crowdsourced images of humans. IEEE Int Conf Comput Intell Comput Res (ICCIC) 1–4. https://doi.org/10.1109/ICCIC.2018.8782363

  24. Wang R-Q, Mao H, Wang Y, Rae C, Shaw W (2018) Hyper-resolution monitoring of urban flooding with social media and crowdsourcing data. Comput Geosci 111:139–147. https://doi.org/10.1016/j.cageo.2017.11.008

    Article  Google Scholar 

  25. Yu X, Wu X, Luo C, Ren P (2017) Deep learning in remote sensing scene classification: a data augmentation enhanced convolutional neural network framework. GI Sci Remote Sensing 54(5):741–758. https://doi.org/10.1080/15481603.2017.1323377

    Article  Google Scholar 

  26. Zacharie M, Fuji S, Minori S (2018) Rapid human body detection in disaster sites using image processing from unmanned aerial vehicle (UAV) cameras. Int Conf Intell Inform Biomed Sci (ICIIBMS) 3:230–235. https://doi.org/10.1109/ICIIBMS.2018.8549955

    Article  Google Scholar 

  27. Zhu J, Yuan Z, Zhang C, Chi W, Ling Y (2020) Crowded Human Detection via an Anchor-pair Network. IEEE Winter Conf Appl CompVision. 1391–1399. https://doi.org/10.1109/WACV45572.2020.9093280

Download references

Funding

This work has been supported by the RESPOND project funded by the Indian Space Research Organization (ISRO-IIRS 007) under Grant No: RES/4/676/19–20″.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Anna University, Chennai, Tamilnadu, India

    Dhanushree M & Chitrakala S

  2. Disaster Management Studies, Indian Institute of Remote Sensing, Dehradun, India

    Bhatt C.M.

Authors
  1. Dhanushree M
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chitrakala S
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bhatt C.M.
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dhanushree M.

Ethics declarations

Conflict of interest

The authors have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

M, D., S, C. & C.M., B. Robust human detection system in flood related images with data augmentation. Multimed Tools Appl 82, 10661–10679 (2023). https://doi.org/10.1007/s11042-022-13760-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13760-9

Keywords

Search

Navigation