skip to main content
10.1145/3570361.3613305acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

RF-Search: Searching Unconscious Victim in Smoke Scenes with RF-enabled Drone

Published: 02 October 2023 Publication History

Abstract

Toxic gases inhalation is the most common cause of death in fire scenes, which can make people unconscious and unable to save themselves. Hence, discovering the unconscious victims is crucial to improve their survival rate. In this paper, we propose RF-Search, a victim searching system with RF device mounted on the drone. The challenge mainly comes from the fact that drone motion would overwhelm the subtle vital signs utilized for victim identification. To resolve this problem, we have noted that the physical signature of drone motion has been encoded in stationary object reflections. Leveraging this unique physical signature, we propose to identify the unconscious victim through the spatio-temporal correlation between signals reflected from the victim and the surrounding stationary objects. To extract respiration information of the victim, we propose a motion segmentation module and a motion compensation module to suppress the signal variation caused by drone movement. Extensive experiments have demonstrated that our system could achieve an accuracy of 92.5% for victim identification.

References

[1]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart Homes That Monitor Breathing and Heart Rate. In Proc. of the 33rd ACM CHI. 837--846.
[2]
Shubhani Aggarwal, Neeraj Kumar, Musaed Alhussein, and Ghulam Muhammad. 2021. Blockchain-based UAV path planning for healthcare 4.0: Current challenges and the way ahead. IEEE Network 35, 1 (2021), 20--29.
[3]
AAS Alarifi, Herodotos N Phylaktou, and Gordon E Andrews. 2016. What kills people in a fire? heat or smoke? 9th SSC Proceedings (2016).
[4]
Marc J Assael and Konstantinos E Kakosimos. 2010. Fires, explosions, and toxic gas dispersions: effects calculation and risk analysis. CRC Press.
[5]
Harald Bayerlein, Mirco Theile, Marco Caccamo, and David Gesbert. 2021. Multi-UAV path planning for wireless data harvesting with deep reinforcement learning. IEEE Open Journal of the Communications Society 2 (2021), 1171--1187.
[6]
Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. 2020. nuScenes: A Multimodal Dataset for Autonomous Driving. In Proc. of the IEEE/CVF CVPR. 11618--11628.
[7]
Jinbo Chen, Dongheng Zhang, Zhi Wu, Fang Zhou, Qibin Sun, and Yan Chen. 2022. Contactless Electrocardiogram Monitoring With Millimeter Wave Radar. IEEE Transactions on Mobile Computing (2022), 1--17.
[8]
Yan Chen, Hongyu Deng, Dongheng Zhang, and Yang Hu. 2021. Speed-Net: Indoor Speed Estimation With Radio Signals. IEEE Internet of Things Journal 8, 4 (2021), 2762--2774.
[9]
Yan Chen, Xiang Su, Yang Hu, and Bing Zeng. 2020. Residual Carrier Frequency Offset Estimation and Compensation for Commodity WiFi. IEEE Transactions on Mobile Computing 19, 12 (2020), 2891--2902.
[10]
Zhe Chen, Tianyue Zheng, Chao Cai, and Jun Luo. 2021. MoVi-Fi: Motion-Robust Vital Signs Waveform Recovery via Deep Interpreted RF Sensing. In Proc. of the 27th ACM MobiCom (MobiCom '21). 392--405.
[11]
Israel Cohen, Yiteng Huang, Jingdong Chen, Jacob Benesty, Jacob Benesty, Jingdong Chen, Yiteng Huang, and Israel Cohen. 2009. Pearson correlation coefficient. Noise reduction in speech processing (2009), 1--4.
[12]
CTIF. 2022. World Fire Statistics. https://www.ctif.world-fire-statistics.
[13]
Shuya Ding, Zhe Chen, Tianyue Zheng, and Jun Luo. 2020. RF-Net: A Unified Meta-Learning Framework for RF-Enabled One-Shot Human Activity Recognition. In Proc. of the 18th ACM SenSys. 517--530.
[14]
Lijie Fan, Tianhong Li, Rongyao Fang, Rumen Hristov, Yuan Yuan, and Dina Katabi. 2020. Learning Longterm Representations for Person Re-Identification Using Radio Signals. In Proc. of the IEEE/CVF CVPR. 10696--10706.
[15]
Unsoo Ha, Salah Assana, and Fadel Adib. 2020. Contactless Seismo-cardiography via Deep Learning Radars. In Proc. of the 26th ACM MobiCom.
[16]
Ying He, Yan Chen, Yang Hu, and Bing Zeng. 2020. WiFi Vision: Sensing, Recognition, and Detection With Commodity MIMO-OFDM WiFi. IEEE Internet of Things Journal 7, 9 (2020), 8296--8317.
[17]
Da-Jiang Innovations. 2022. Mavic 3. https://www.dji.com/cn/mavic-3/specs.
[18]
Texas Instruments. 2020. AWR1843AOP. https://www.ti.com/product/AWR1843AOP?keyMatch=AWR1843AOP. Accessed: 2022-03-03.
[19]
Mastura Jaafar, Nuzaihan Aras Agus Salim, Naziah Muhamad Salleh, Mohd Zailan Sulieman, Norhidayah Md Ulang, and Andrew Ebekozien. 2021. Developing a framework for fire safety management plan: the case of Malaysia's public hospital buildings. International Journal of Building Pathology and Adaptation ahead-of-print (2021).
[20]
Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shuochao Yao, Yaqing Wang, Ye Yuan, Hongfei Xue, Chen Song, Xin Ma, Dimitrios Koutsonikolas, Wenyao Xu, and Lu Su. 2018. Towards Environment Independent Device Free Human Activity Recognition. In Proc. of the 24th ACM MobiCom. 289--304.
[21]
Wenjun Jiang, Hongfei Xue, Chenglin Miao, Shiyang Wang, Sen Lin, Chong Tian, Srinivasan Murali, Haochen Hu, Zhi Sun, and Lu Su. 2020. Towards 3D Human Pose Construction Using Wifi. In Proc. of the 26th ACM MobiCom. Article 23, 14 pages.
[22]
Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using WiFi. In Proc. of the ACM SIGCOMM. 269--282.
[23]
Tze Leung Lai, Herbert Robbins, and Ching Zong Wei. 1978. Strong consistency of least squares estimates in multiple regression. Proceedings of the national academy of sciences 75, 7 (1978), 3034--3036.
[24]
Seoungjun Lee, Dongsoo Har, and Dongsuk Kum. 2016. Drone-assisted disaster management: Finding victims via infrared camera and lidar sensor fusion. In 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE). IEEE, 84--89.
[25]
Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: Talk to Your Smart Devices with Finger-Grained Gesture. In Proc. of the ACM UbiComp (UbiComp '16). 250--261.
[26]
Tianhong Li, Lijie Fan, Yuan Yuan, and Dina Katabi. 2022. Unsupervised Learning for Human Sensing Using Radio Signals. In Proc. of the IEEE/CVF WACV. 1091--1100.
[27]
Wenxuan Li, Dongheng Zhang, Yadong Li, Zhi Wu, Jinbo Chen, Dong Zhang, Yang Hu, Qibin Sun, and Yan Chen. 2022. Real-Time Fall Detection Using Mmwave Radar. In Proc. of the IEEE ICASSP. 16--20.
[28]
Yucong Lin and Srikanth Saripalli. 2017. Sampling-based path planning for UAV collision avoidance. IEEE Transactions on Intelligent Transportation Systems 18, 11 (2017), 3179--3192.
[29]
Eleftherios Lygouras, Nicholas Santavas, Anastasios Taitzoglou, Konstantinos Tarchanidis, Athanasios Mitropoulos, and Antonios Gasteratos. 2019. Unsupervised human detection with an embedded vision system on a fully autonomous UAV for search and rescue operations. Sensors 19, 16 (2019), 3542.
[30]
Balmukund Mishra, Deepak Garg, Pratik Narang, and Vipul Mishra. 2020. Drone-surveillance for search and rescue in natural disaster. Computer Communications 156 (2020), 1--10.
[31]
Constantine Papageorgiou and Tomaso Poggio. 2000. A trainable system for object detection. International journal of computer vision 38 (2000), 15--33.
[32]
Kun Qian, Zhaoyuan He, and Xinyu Zhang. 2020. 3D Point Cloud Generation with Millimeter-Wave Radar. In Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 4.
[33]
Shankarachary Ragi and Edwin KP Chong. 2013. UAV path planning in a dynamic environment via partially observable Markov decision process. IEEE Trans. Aerospace Electron. Systems 49, 4 (2013), 2397--2412.
[34]
Vincent Roberge, Mohammed Tarbouchi, and Gilles Labonté. 2012. Comparison of parallel genetic algorithm and particle swarm optimization for real-time UAV path planning. IEEE Transactions on industrial informatics 9, 1 (2012), 132--141.
[35]
Frank C Robey, Daniel R Fuhrmann, Edward J Kelly, and Ramon Nitzberg. 1992. A CFAR adaptive matched filter detector. IEEE Transactions on aerospace and electronic systems 28, 1 (1992), 208--216.
[36]
Santiago Royo and Maria Ballesta-Garcia. 2019. An overview of lidar imaging systems for autonomous vehicles. Applied sciences 9, 19 (2019), 4093.
[37]
David C Schedl, Indrajit Kurmi, and Oliver Bimber. 2021. An autonomous drone for search and rescue in forests using airborne optical sectioning. Science Robotics 6, 55 (2021), eabg1188.
[38]
Ruiyuan Song, Dongheng Zhang, Zhi Wu, Cong Yu, Chunyang Xie, Shuai Yang, Yang Hu, and Yan Chen. 2022. RF-URL: Unsupervised Representation Learning for RF Sensing. In Proc. of the 28th ACM MobiCom. 282--295.
[39]
Maria Stefanidou, Sotiris Athanaselis, and Chara Spiliopoulou. 2008. Health impacts of fire smoke inhalation. Inhalation toxicology 20, 8 (2008), 761--766.
[40]
George W Stimson. 1998. Introduction to airborne radar. SciTech Publishing, Inc.
[41]
Jarosław Szrek, Radoslaw Zimroz, Jacek Wodecki, Anna Michalak, Mateusz Góralczyk, and Magdalena Worsa-Kozak. 2020. Application of the infrared thermography and unmanned ground vehicle for rescue action support in underground mine---The amicos project. Remote Sensing 13, 1 (2020), 69.
[42]
Yonglong Tian, Guang-He Lee, Hao He, Chen-Yu Hsu, and Dina Katabi. 2018. RF-Based Fall Monitoring Using Convolutional Neural Networks. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3, Article 137 (sep 2018), 24 pages.
[43]
Raghav H. Venkatnarayan, Shakir Mahmood, and Muhammad Shahzad. 2021. WiFi based Multi-User Gesture Recognition. IEEE Transactions on Mobile Computing 20, 3 (2021), 1242--1256.
[44]
Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using WiFi. In Proc. of the 15th ACM MobiSys (MobiSys '17). 252--264.
[45]
T Thuy Vu, Fumio Yamazaki, and Masashi Matsuoka. 2009. Multi-scale solution for building extraction from LiDAR and image data. International Journal of Applied Earth Observation and Geoinformation 11, 4 (2009), 281--289.
[46]
Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-Eyes: Device-Free Location-Oriented Activity Identification Using Fine-Grained WiFi Signatures. In Proc. of the 20th ACM MobiCom (MobiCom '14). 617--628.
[47]
Chenshu Wu, Feng Zhang, Beibei Wang, and K. J. Ray Liu. 2020. mm-Track: Passive Multi-Person Localization Using Commodity Millimeter Wave Radio. In Proc. of the IEEE INFOCOM 2020. 2400--2409.
[48]
Zhi Wu, Dongheng Zhang, Chunyang Xie, Cong Yu, Jinbo Chen, Yang Hu, and Yan Chen. 2022. RFMask: A Simple Baseline for Human Silhouette Segmentation With Radio Signals. IEEE Transactions on Multimedia (2022), 1--12.
[49]
Qinyi Xu, Yan Chen, BeiBei Wang, and K. J. Ray Liu. 2017. Radio Biometrics: Human Recognition Through a Wall. IEEE Transactions on Information Forensics and Security 12, 5 (2017), 1141--1155.
[50]
Qinyi Xu, Yan Chen, Beibei Wang, and K. J. Ray Liu. 2017. TRIEDS: Wireless Events Detection Through the Wall. IEEE Internet of Things Journal 4, 3 (2017), 723--735.
[51]
Hongfei Xue, Qiming Cao, Yan Ju, Haochen Hu, Haoyu Wang, Aidong Zhang, and Lu Su. 2021. MmMesh: Towards 3D Real-Time Dynamic Human Mesh Construction Using Millimeter-Wave. In Proc. of the 20th ACM MobiSys. 391--406.
[52]
Hongfei Xue, Yan Ju, Chenglin Miao, Yijiang Wang, Shiyang Wang, Aidong Zhang, and Lu Su. 2023. M4esh: MmWave-Based 3D Human Mesh Construction for Multiple Subjects. In Proc. of the 19th ACM SenSys. 269--282.
[53]
Shuai Yang, Dongheng Zhang, Ruiyuan Song, Pengfei Yin, and Yan Chen. 2023. Multiple WiFi Access Points Co-Localization Through Joint AoA Estimation. IEEE Transactions on Mobile Computing (2023), 1--16.
[54]
Dongheng Zhang, Ying He, Xinyu Gong, Yang Hu, Yan Chen, and Bing Zeng. 2018. Multitarget AOA estimation using wideband LFMCW signal and two receiver antennas. IEEE Transactions on Vehicular Technology 67, 8 (2018), 7101--7112.
[55]
Dongheng Zhang, Yang Hu, and Yan Chen. 2021. MTrack: Tracking Multiperson Moving Trajectories and Vital Signs With Radio Signals. IEEE Internet of Things Journal 8, 5 (2021), 3904--3914.
[56]
Dongheng Zhang, Yang Hu, Yan Chen, and Bing Zeng. 2019. Breath-Track: Tracking indoor human breath status via commodity WiFi. IEEE Internet of Things Journal 6, 2 (2019), 3899--3911.
[57]
Dongheng Zhang, Yang Hu, Yan Chen, and Bing Zeng. 2020. Calibrating Phase Offsets for Commodity WiFi. IEEE Systems Journal 14, 1 (2020), 661--664.
[58]
Fusang Zhang, Jie Xiong, Zhaoxin Chang, Junqi Ma, and Daqing Zhang. 2022. Mobi2Sense: empowering wireless sensing with mobility. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 268--281.
[59]
Yi Zhang, Yue Zheng, Kun Qian, Guidong Zhang, Yunhao Liu, Chenshu Wu, and Zheng Yang. 2021. Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021), 1--1.
[60]
Mingmin Zhao, Tianhong Li, Mohammad Abu Alsheikh, Yonglong Tian, Hang Zhao, Antonio Torralba, and Dina Katabi. 2018. Through-Wall Human Pose Estimation Using Radio Signals. In Proc. of the IEEE/CVF CVPR. 7356--7365.
[61]
Mingmin Zhao, Yingcheng Liu, Aniruddh Raghu, Hang Zhao, Tianhong Li, Antonio Torralba, and Dina Katabi. 2019. Through-Wall Human Mesh Recovery Using Radio Signals. In Proc. of the IEEE/CVF ICCV. 10112--10121.
[62]
Mingmin Zhao, Yonglong Tian, Hang Zhao, Mohammad Abu Alsheikh, Tianhong Li, Rumen Hristov, Zachary Kabelac, Dina Katabi, and Antonio Torralba. 2018. RF-Based 3D Skeletons. In Proc. of the ACM SIGCOMM (SIGCOMM '18). 267--281.
[63]
Tianyue Zheng, Zhe Chen, Chao Cai, Jun Luo, and Xu Zhang. 2020. V2iFi: In-Vehicle Vital Sign Monitoring via Compact RF Sensing. In Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.
[64]
Tianyue Zheng, Zhe Chen, Shujie Zhang, Chao Cai, and Jun Luo. 2021. MoRe-Fi: Motion-Robust and Fine-Grained Respiration Monitoring via Deep-Learning UWB Radar. In Proc. of the 19th ACM SenSys. 111--124.
[65]
Zhengxia Zou, Keyan Chen, Zhenwei Shi, Yuhong Guo, and Jieping Ye. 2023. Object detection in 20 years: A survey. Proc. IEEE (2023).

Cited By

View all
  • (2024)Lightweight sensing-computing-decision collaboration enhancement for multi-mobile terminalsSCIENTIA SINICA Informationis10.1360/SSI-2024-008954:9(2136)Online publication date: 9-Sep-2024
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • (2024)RF-GymCare: Introducing Respiratory Prior for RF Sensing in Gym EnvironmentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785688:3(1-28)Online publication date: 9-Sep-2024
  • Show More Cited By

Index Terms

  1. RF-Search: Searching Unconscious Victim in Smoke Scenes with RF-enabled Drone

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ACM MobiCom '23: Proceedings of the 29th Annual International Conference on Mobile Computing and Networking
    October 2023
    1605 pages
    ISBN:9781450399906
    DOI:10.1145/3570361
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. RF sensing
    2. victim rescue
    3. mmWave Radar

    Qualifiers

    • Research-article

    Conference

    ACM MobiCom '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 440 of 2,972 submissions, 15%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)470
    • Downloads (Last 6 weeks)15
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Lightweight sensing-computing-decision collaboration enhancement for multi-mobile terminalsSCIENTIA SINICA Informationis10.1360/SSI-2024-008954:9(2136)Online publication date: 9-Sep-2024
    • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
    • (2024)RF-GymCare: Introducing Respiratory Prior for RF Sensing in Gym EnvironmentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785688:3(1-28)Online publication date: 9-Sep-2024
    • (2024)MSense: Boosting Wireless Sensing Capability Under Motion InterferenceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649350(108-123)Online publication date: 29-May-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media