skip to main content
10.1145/3573910.3573913acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicraiConference Proceedingsconference-collections
research-article
Open access

Novel Mobile Robot Concept for Human Detection in Fire Smoke Indoor Environments using Deep Learning

Published: 20 January 2023 Publication History

Abstract

Human victim detection in smoky indoor environments during search and rescue missions is still challenging. This situation is due to the fact that fire fighters are on the one hand exposed to thermal radiation and unstable building structures. On the other hand, their cognitive fatigue, due to long search and rescue missions, reduce the efficient victim detection in such hazardous environments with limited visibility. In this paper, a novel concept of a remote-controlled and heat protected unmanned ground vehicle with victim detection system is presented, which detects missing victims in real time in smoky indoor environments and display its localization with detection rate to an operator outside the danger zone. The victim detection system, based on a trained deep learning model, is designed to address the specific properties of victims, which are for instance characterised by a lying position. The novel concept provides a framework for the design and the validation of the mobile robot with the victim detection system.

References

[1]
CTIF. Retrieved July 28, 2022 from https://www.ctif.org/sites/default/files/2021-06/CTIF_Report26_0.pdf
[2]
Jennifer Casper and Robin R. Murphy. Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center. 33, 3 (June 2003), 367–385. https://doi.org/10.1109/TSMCB.2003.811794
[3]
Robin R. Murphy and Jennifer L. Burke. Up from the Rubble: Lessons Learned about HRI from Search and Rescue. 49, 3 (September 2005), 437–441. https://doi.org/10.1177/154193120504900347
[4]
John Coleman. 2011. Searching smarter: Fire Engineering Books
[5]
Yogeshwar S. Dadwhal, Satish Kumar and H. K. Sardana. Data-Driven Skin Detection in Cluttered Search and Rescue Environments. 20, 7 (April 2020), 3697–3708. https://doi.org/10.1109/JSEN.2019.2959787
[6]
Grzegorz Wilk-Jakubowski, Radoslaw Harabin and Stanislav Ivanov. Robotics in crisis management: A review. Technology in Society 68 (February 2022), 101935. https://doi.org/10.1016/j.techsoc.2022.101935
[7]
Pengcheng Liu, Hongnian Yu, Shuang Cang and Luige Vladareanu. 2016. Robot-assisted smart firefighting and interdisciplinary perspectives. In Proceedings of the 2016 22nd International Conference on Automation and Computing (ICAC). Colchester UK. 395-401. https://doi.org/10.1109/IConAC.2016.7604952
[8]
Maki K. Habib and Yvan Baudoin. Robot-assisted risky intervention, search, rescue and environmental surveillance. 7, 1 (March 2010), 10. https://doi.org/10.5772/7249
[9]
Carlos Castillo and Carolina Chang. 2005. A method to detect victims in search and rescue operations using template matching. In Proceedings of the IEEE International Safety, Security and Rescue Robotics (SSRR), Workshop. Kobe Japan. 201–206. https://doi.org/10.1109/SSRR.2005.1501256
[10]
Marina Ivašić-Kos, Mate Krišto and Miran Pobar. 2019. Human Detection in Thermal Imaging Using YOLO. In Proceedings of the 2019 5th International Conference on Computer and Technology Applications. Istanbul Turkey. 20–24. https://doi.org/10.1145/3323933.3324076
[11]
Farah B. Jaradat and Damian Valles. 2020. A victims detection approach for burning building sites using convolutional neural networks. In Proceedings of the 2020 10th Annual Computing and Communication Workshop and Conference (CCWC). Las Vegas NV USA. 280–286. https://doi.org/10.1109/CCWC47524.2020.9031275
[12]
Christyan Cruz Ulloa, Guillermo Prieto Sánchez, Antonio Barrientos and Jaime Del Cerro. Autonomous Thermal Vision Robotic System for Victims Recognition in Search and Rescue Missions. Sensors 21, 21 (November 2021), 7346. https://doi.org/10.3390/s21217346
[13]
W. Hoshino, J. Seo and Y. Yamazaki. 2021. A study for detecting disaster victims using multi-copter drone with a thermographic camera and image object recognition by SSD. In Proceedings of the 2021 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM). Delft Netherlands. 162–167. https://doi.org/10.1109/AIM46487.2021.9517524
[14]
Muhammad I. Perdana, Anhar Risnumawan and Indra A. Sulistijono. 2020. Automatic Aerial Victim Detection on Low-Cost Thermal Camera Using Convolutional Neural Network. In Proceedings of the 2020 International Symposium on Community-centric Systems (CcS). Tokyo Japan. 1–5. https://doi.org/10.1109/CcS49175.2020.9231433
[15]
Pei-Fen Tsai, Chia-Hung Liao and Shyan-Ming Yuan. Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios. Sensors 22, 14 (July 2022), 5351. https://doi.org/10.3390/s22145351
[16]
T. AlHaza, A. Alsadoon, Z. Alhusinan, M. Jarwali and K. Alsaif. New Concept for Indoor Fire Fighting Robot. Procedia - Social and Behavioral Sciences 195 (July 2015), 2343–2352. https://doi.org/10.1016/j.sbspro.2015.06.191
[17]
Lucian Ș. Grigore, Amado Ștefan, Ionica Oncioiu, Cristian Molder, Damian Gorgoteanu, Daniel Constantin, 2021. Aspects Regarding of a UGV Fire Fighting Thermal Shield. In Proceedings of the 8th International Symposium on Sensor Science. Dresden Germany. https://doi.org/10.3390/i3s2021dresden-10082
[18]
Dweepna Garg, Parth Goel, Sharnil Pandya, Amit Ganatra and Ketan Kotecha. 2018. A Deep Learning Approach for Face Detection using YOLO. In Proceedings of the 2018 IEEE Punecon. Pune India. 1–4. https://doi.org/10.1109/PUNECON.2018.8745376
[19]
Yonglong Tian, Ping Luo, Xiaogang Wang and Xiaoou Tang. 2015. Pedestrian Detection Aided by Deep Learning Semantic Tasks. In Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston MA USA. https://doi.org/10.48550/arXiv.1412.0069
[20]
Paul Fritsche, Björn Zeise, Patrick Hemme and Bernardo Wagner. 2017. Fusion of radar, LiDAR and thermal information for hazard detection in low visibility environments. In Proceedings of the 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR). Shanghai China. 96–101. https://doi.org/10.1109/SSRR.2017.8088146

Cited By

View all
  • (2024)Using the Burning of Polymer Compounds to Determine the Applicability of the Acoustic Method in Fire ExtinguishingPolymers10.3390/polym1623341316:23(3413)Online publication date: 4-Dec-2024
  • (2024)Application of Low-Frequency Acoustic Waves to Extinguish Flames on the Basis of Selected Experimental AttemptsApplied Sciences10.3390/app1419887214:19(8872)Online publication date: 2-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICRAI '22: Proceedings of the 8th International Conference on Robotics and Artificial Intelligence
November 2022
89 pages
ISBN:9781450397544
DOI:10.1145/3573910
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 January 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Computer Vision
  2. SSD
  3. deep learning
  4. mobile robot
  5. multi-sensor
  6. optical camera
  7. real time
  8. smoky environment
  9. thermal camera
  10. thermal insulation
  11. unmanned ground vehicle
  12. victim detection

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICRAI 2022

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)72
  • Downloads (Last 6 weeks)26
Reflects downloads up to 25 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Using the Burning of Polymer Compounds to Determine the Applicability of the Acoustic Method in Fire ExtinguishingPolymers10.3390/polym1623341316:23(3413)Online publication date: 4-Dec-2024
  • (2024)Application of Low-Frequency Acoustic Waves to Extinguish Flames on the Basis of Selected Experimental AttemptsApplied Sciences10.3390/app1419887214:19(8872)Online publication date: 2-Oct-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media