skip to main content
10.1145/3605390.3610832acmotherconferencesArticle/Chapter ViewAbstractPublication PageschitalyConference Proceedingsconference-collections
poster

Poster: Human Presence Detection After Earthquakes: An AI-Based Implicit User Interface on the Smartphone

Published: 20 September 2023 Publication History

Abstract

One of the main challenges of rescue operations after a devastating earthquake is the timely location of people trapped under debris. We propose a system that exploits the smartphone to detect the presence and implicitly interact with a person trapped in buildings. It leverages the phone microphone to detect sound waves generated by human breathing, heartbeat, and movement. It analyzes the signals on the smartphone itself using deep learning. A server collecting the results can support search-and-rescue operations or trigger further actions, such as an emergency call. The results of a preliminary evaluation of such a system based on a proof-of-concept Android app demonstrate an accurate detection of human presence within a specific range of the smartphone.

References

[1]
Mohanad Alkhodari and Ahsan H Khandoker. 2022. Detection of COVID-19 in smartphone-based breathing recordings: A pre-screening deep learning tool. PLoS One 17, 1 (2022), e0262448. https://doi.org/10.1371/journal.pone.0262448
[2]
M Bahoura and C Pelletier. 2004. Respiratory sounds classification using cepstral analysis and Gaussian mixture models. In The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Vol. 1. IEEE, 9–12. https://doi.org/10.1109/IEMBS.2004.1403077
[3]
Enrico Bassetti and Emanuele Panizzi. 2022. Earthquake detection at the edge: IoT crowdsensing network. Information 13, 4 (2022), 195.
[4]
Enrico Bassetti, Davide Quaranta, and Emanuele Panizzi. 2022. Quick decentralized estimation of earthquake epicenter with low-cost IoT network. In 2022 9th International Conference on Internet of Things: Systems, Management and Security (IOTSMS). IEEE, 1–8.
[5]
Jagmohan Chauhan, Yining Hu, Suranga Seneviratne, Archan Misra, Aruna Seneviratne, and Youngki Lee. 2017. BreathPrint: Breathing acoustics-based user authentication. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. 278–291. https://doi.org/10.1145/3081333.3081355
[6]
Jiong Dong, Kaoru Ota, and Mianxiong Dong. 2021. UAV-based real-time survivor detection system in post-disaster search and rescue operations. IEEE Journal on Miniaturization for Air and Space Systems 2, 4 (2021), 209–219. https://doi.org/10.1109/JMASS.2021.3083659
[7]
Ketan Doshi. 2021. Audio Deep Learning Made Simple (Part 1): State-of-the-Art Techniques. https://towardsdatascience.com/audio-deep-learning-made-simple-part-1-state-of-the-art-techniques-da1d3dff2504. Retrieved on April 4, 2023.
[8]
Daniel S Drew. 2021. Multi-agent systems for search and rescue applications. Current Robotics Reports 2 (2021), 189–200. https://doi.org/10.1007/s43154-021-00048-3
[9]
Keita Fukuyama, Osamu Sugiyama, Kazuo Chin, Susumu Satou, Shigemi Matsumoto, and Manabu Muto. 2022. Identification of Respiratory Sounds Collected from Microphones Embedded in Mobile Phones. Advanced Biomedical Engineering 11 (2022), 58–67. https://doi.org/10.14326/abe.11.58
[10]
Google. 2019. Yamnet. https://tfhub.dev/google/yamnet/1. Retrieved on April 4, 2023.
[11]
Tian Hao, Guoliang Xing, and Gang Zhou. 2015. RunBuddy: a smartphone system for running rhythm monitoring. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 133–144. https://doi.org/10.1145/2750858.2804293
[12]
Andrew G Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017). https://doi.org/10.48550/arXiv.1704.04861
[13]
Ariffuddin Joret, Sajjad Ahmed, Norshidah Katiran, and Muhammad Suhaimi Sulong. 2022. Human Detection Techniques for Search and Rescue of Trapped Victims Under Debris: A Review. Evolution of Information, Communication and Computing System (2022), 54–65. https://publisher.uthm.edu.my/bookseries/index.php/eiccs/article/view/34
[14]
Yanick Xavier Lukic, Gisbert Wilhelm Teepe, Elgar Fleisch, and Tobias Kowatsch. 2022. Breathing as an Input Modality in a Gameful Breathing Training App (Breeze 2): Development and Evaluation Study. JMIR Serious Games 10, 3 (2022), e39186. https://doi.org/10.2196/39186
[15]
Stavros Ntalampiras, Danylo Kosmin, and Javier Sanchez. 2021. Acoustic classification of individual cat vocalizations in evolving environments. In 2021 44th International Conference on Telecommunications and Signal Processing (TSP). IEEE, 254–258. https://doi.org/10.1109/TSP52935.2021.9522660
[16]
Emanuele Panizzi. 2016. The seismocloud app: Your smartphone as a seismometer. In Proceedings of the International Working Conference on Advanced Visual Interfaces. 336–337.
[17]
Yanzhi Ren, Chen Wang, Jie Yang, and Yingying Chen. 2015. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In 2015 IEEE Conference on Computer Communications (INFOCOM). IEEE, 1194–1202. https://doi.org/10.1109/INFOCOM.2015.7218494
[18]
Mirco Rossi, Sebastian Feese, Oliver Amft, Nils Braune, Sandro Martis, and Gerhard Tröster. 2013. AmbientSense: A real-time ambient sound recognition system for smartphones. In 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 230–235. https://doi.org/10.1109/PerComW.2013.6529487
[19]
Friedrich Steinhäusler and Harris V Georgiou. 2022. Detection of victims with UAVs during wide area Search and Rescue operations. In 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). IEEE, 14–19. https://doi.org/10.1109/SSRR56537.2022.10018756
[20]
Huy Dat Tran and Haizhou Li. 2010. Sound event recognition with probabilistic distance SVMs. IEEE transactions on audio, speech, and language processing 19, 6 (2010), 1556–1568. https://doi.org/10.1109/TASL.2010.2093519

Cited By

View all
  • (2024)Human Presence Detection to Support Contextual Awareness in Ambient Assisted Living Scenarios2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE62247.2024.10796342(1189-1194)Online publication date: 21-Oct-2024
  • (2024)An Approach to Leverage Artificial Intelligence for Car-Parking Related Mobile ApplicationsEngineering Interactive Computer Systems. EICS 2023 International Workshops and Doctoral Consortium10.1007/978-3-031-59235-5_7(63-71)Online publication date: 8-Aug-2024

Index Terms

  1. Poster: Human Presence Detection After Earthquakes: An AI-Based Implicit User Interface on the Smartphone

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        CHItaly '23: Proceedings of the 15th Biannual Conference of the Italian SIGCHI Chapter
        September 2023
        416 pages
        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 20 September 2023

        Check for updates

        Author Tags

        1. deep learning
        2. earthquake
        3. human presence detection
        4. neural networks
        5. user testing

        Qualifiers

        • Poster
        • Research
        • Refereed limited

        Conference

        CHItaly 2023

        Acceptance Rates

        Overall Acceptance Rate 109 of 242 submissions, 45%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)44
        • Downloads (Last 6 weeks)3
        Reflects downloads up to 30 Jan 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)Human Presence Detection to Support Contextual Awareness in Ambient Assisted Living Scenarios2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE62247.2024.10796342(1189-1194)Online publication date: 21-Oct-2024
        • (2024)An Approach to Leverage Artificial Intelligence for Car-Parking Related Mobile ApplicationsEngineering Interactive Computer Systems. EICS 2023 International Workshops and Doctoral Consortium10.1007/978-3-031-59235-5_7(63-71)Online publication date: 8-Aug-2024

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media