research-article

Open access

Novel Mobile Robot Concept for Human Detection in Fire Smoke Indoor Environments using Deep Learning

Author:

Sebastian GelfertAuthors Info & Claims

ICRAI '22: Proceedings of the 8th International Conference on Robotics and Artificial Intelligence

Pages 13 - 19

https://doi.org/10.1145/3573910.3573913

Published: 20 January 2023 Publication History

All formats PDF

ICRAI '22: Proceedings of the 8th International Conference on Robotics and Artificial Intelligence

Novel Mobile Robot Concept for Human Detection in Fire Smoke Indoor Environments using Deep Learning

Pages 13 - 19

Abstract
References

Abstract

Human victim detection in smoky indoor environments during search and rescue missions is still challenging. This situation is due to the fact that fire fighters are on the one hand exposed to thermal radiation and unstable building structures. On the other hand, their cognitive fatigue, due to long search and rescue missions, reduce the efficient victim detection in such hazardous environments with limited visibility. In this paper, a novel concept of a remote-controlled and heat protected unmanned ground vehicle with victim detection system is presented, which detects missing victims in real time in smoky indoor environments and display its localization with detection rate to an operator outside the danger zone. The victim detection system, based on a trained deep learning model, is designed to address the specific properties of victims, which are for instance characterised by a lying position. The novel concept provides a framework for the design and the validation of the mobile robot with the victim detection system.

References

[1]

CTIF. Retrieved July 28, 2022 from https://www.ctif.org/sites/default/files/2021-06/CTIF_Report26_0.pdf

[2]

Jennifer Casper and Robin R. Murphy. Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center. 33, 3 (June 2003), 367–385. https://doi.org/10.1109/TSMCB.2003.811794

Digital Library

[3]

Robin R. Murphy and Jennifer L. Burke. Up from the Rubble: Lessons Learned about HRI from Search and Rescue. 49, 3 (September 2005), 437–441. https://doi.org/10.1177/154193120504900347

[4]

John Coleman. 2011. Searching smarter: Fire Engineering Books

[5]

Yogeshwar S. Dadwhal, Satish Kumar and H. K. Sardana. Data-Driven Skin Detection in Cluttered Search and Rescue Environments. 20, 7 (April 2020), 3697–3708. https://doi.org/10.1109/JSEN.2019.2959787

[6]

Grzegorz Wilk-Jakubowski, Radoslaw Harabin and Stanislav Ivanov. Robotics in crisis management: A review. Technology in Society 68 (February 2022), 101935. https://doi.org/10.1016/j.techsoc.2022.101935

[7]

Pengcheng Liu, Hongnian Yu, Shuang Cang and Luige Vladareanu. 2016. Robot-assisted smart firefighting and interdisciplinary perspectives. In Proceedings of the 2016 22nd International Conference on Automation and Computing (ICAC). Colchester UK. 395-401. https://doi.org/10.1109/IConAC.2016.7604952

[8]

Maki K. Habib and Yvan Baudoin. Robot-assisted risky intervention, search, rescue and environmental surveillance. 7, 1 (March 2010), 10. https://doi.org/10.5772/7249

[9]

Carlos Castillo and Carolina Chang. 2005. A method to detect victims in search and rescue operations using template matching. In Proceedings of the IEEE International Safety, Security and Rescue Robotics (SSRR), Workshop. Kobe Japan. 201–206. https://doi.org/10.1109/SSRR.2005.1501256

[10]

Marina Ivašić-Kos, Mate Krišto and Miran Pobar. 2019. Human Detection in Thermal Imaging Using YOLO. In Proceedings of the 2019 5th International Conference on Computer and Technology Applications. Istanbul Turkey. 20–24. https://doi.org/10.1145/3323933.3324076

Digital Library

[11]

Farah B. Jaradat and Damian Valles. 2020. A victims detection approach for burning building sites using convolutional neural networks. In Proceedings of the 2020 10th Annual Computing and Communication Workshop and Conference (CCWC). Las Vegas NV USA. 280–286. https://doi.org/10.1109/CCWC47524.2020.9031275

[12]

Christyan Cruz Ulloa, Guillermo Prieto Sánchez, Antonio Barrientos and Jaime Del Cerro. Autonomous Thermal Vision Robotic System for Victims Recognition in Search and Rescue Missions. Sensors 21, 21 (November 2021), 7346. https://doi.org/10.3390/s21217346

[13]

W. Hoshino, J. Seo and Y. Yamazaki. 2021. A study for detecting disaster victims using multi-copter drone with a thermographic camera and image object recognition by SSD. In Proceedings of the 2021 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM). Delft Netherlands. 162–167. https://doi.org/10.1109/AIM46487.2021.9517524

Digital Library

[14]

Muhammad I. Perdana, Anhar Risnumawan and Indra A. Sulistijono. 2020. Automatic Aerial Victim Detection on Low-Cost Thermal Camera Using Convolutional Neural Network. In Proceedings of the 2020 International Symposium on Community-centric Systems (CcS). Tokyo Japan. 1–5. https://doi.org/10.1109/CcS49175.2020.9231433

[15]

Pei-Fen Tsai, Chia-Hung Liao and Shyan-Ming Yuan. Using Deep Learning with Thermal Imaging for Human Detection in Heavy Smoke Scenarios. Sensors 22, 14 (July 2022), 5351. https://doi.org/10.3390/s22145351

[16]

T. AlHaza, A. Alsadoon, Z. Alhusinan, M. Jarwali and K. Alsaif. New Concept for Indoor Fire Fighting Robot. Procedia - Social and Behavioral Sciences 195 (July 2015), 2343–2352. https://doi.org/10.1016/j.sbspro.2015.06.191

[17]

Lucian Ș. Grigore, Amado Ștefan, Ionica Oncioiu, Cristian Molder, Damian Gorgoteanu, Daniel Constantin, 2021. Aspects Regarding of a UGV Fire Fighting Thermal Shield. In Proceedings of the 8th International Symposium on Sensor Science. Dresden Germany. https://doi.org/10.3390/i3s2021dresden-10082

[18]

Dweepna Garg, Parth Goel, Sharnil Pandya, Amit Ganatra and Ketan Kotecha. 2018. A Deep Learning Approach for Face Detection using YOLO. In Proceedings of the 2018 IEEE Punecon. Pune India. 1–4. https://doi.org/10.1109/PUNECON.2018.8745376

[19]

Yonglong Tian, Ping Luo, Xiaogang Wang and Xiaoou Tang. 2015. Pedestrian Detection Aided by Deep Learning Semantic Tasks. In Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston MA USA. https://doi.org/10.48550/arXiv.1412.0069

[20]

Paul Fritsche, Björn Zeise, Patrick Hemme and Bernardo Wagner. 2017. Fusion of radar, LiDAR and thermal information for hazard detection in low visibility environments. In Proceedings of the 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR). Shanghai China. 96–101. https://doi.org/10.1109/SSRR.2017.8088146

Digital Library

Cited By

Loboichenko VWilk-Jakubowski JLevterov AWilk-Jakubowski GStatyvka YShevchenko O(2024)Using the Burning of Polymer Compounds to Determine the Applicability of the Acoustic Method in Fire ExtinguishingPolymers10.3390/polym1623341316:23(3413)Online publication date: 4-Dec-2024
https://doi.org/10.3390/polym16233413
Loboichenko VWilk-Jakubowski GWilk-Jakubowski JCiosmak J(2024)Application of Low-Frequency Acoustic Waves to Extinguish Flames on the Basis of Selected Experimental AttemptsApplied Sciences10.3390/app1419887214:19(8872)Online publication date: 2-Oct-2024
https://doi.org/10.3390/app14198872

Index Terms

Novel Mobile Robot Concept for Human Detection in Fire Smoke Indoor Environments using Deep Learning
1. Computer systems organization
  1. Embedded and cyber-physical systems
    1. Robotics
      1. Robotic autonomy
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Object detection
  2. Machine learning
    1. Learning paradigms
      1. Reinforcement learning
    2. Machine learning approaches
      1. Neural networks

Index terms have been assigned to the content through auto-classification.

Recommendations

Unmanned Aerial Vehicle (UAV) Based Disaster Detection and Crowd Sensing Using Deep Learning Models
ICDCN '25: Proceedings of the 26th International Conference on Distributed Computing and Networking
Natural disasters, such as earthquakes, floods, fires, and hurricanes, result in extensive damage and challenge effective disaster management and rescue efforts. Timely detection of disaster zones and accurate crowd density estimation are essential for ...
A novel tree trunk detection method for oil-palm plantation navigation

A novel tree trunk detection method for oil palm plantations is proposed.A combination of colour images and depth information is used for detection.The proposed method produced a 97.8% tree trunk detection rate in field tests. This paper presents a ...
Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments

The DARPA PerceptOR program has implemented a rigorous evaluative test program which fosters the development of field relevant outdoor mobile robots. Autonomous ground vehicles were deployed on diverse test courses throughout the USA and quantitatively ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICRAI '22: Proceedings of the 8th International Conference on Robotics and Artificial Intelligence

November 2022

89 pages

ISBN:9781450397544

DOI:10.1145/3573910

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 January 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICRAI 2022

ICRAI 2022: 2022 8th International Conference on Robotics and Artificial Intelligence

November 18 - 20, 2022

Singapore, Singapore

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
127
Total Downloads

Downloads (Last 12 months)72
Downloads (Last 6 weeks)26

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Loboichenko VWilk-Jakubowski JLevterov AWilk-Jakubowski GStatyvka YShevchenko O(2024)Using the Burning of Polymer Compounds to Determine the Applicability of the Acoustic Method in Fire ExtinguishingPolymers10.3390/polym1623341316:23(3413)Online publication date: 4-Dec-2024
https://doi.org/10.3390/polym16233413
Loboichenko VWilk-Jakubowski GWilk-Jakubowski JCiosmak J(2024)Application of Low-Frequency Acoustic Waves to Extinguish Flames on the Basis of Selected Experimental AttemptsApplied Sciences10.3390/app1419887214:19(8872)Online publication date: 2-Oct-2024
https://doi.org/10.3390/app14198872

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten