short-paper

A Vision of Augmented Reality for Urban Search and Rescue

Authors:

Nicolas LaLone,

Sultan A. Alharthi,

Phoebe O. Toups DugasAuthors Info & Claims

HttF '19: Proceedings of the Halfway to the Future Symposium 2019

Article No.: 22, Pages 1 - 4

https://doi.org/10.1145/3363384.3363466

Published: 19 November 2019 Publication History

Abstract

Search and rescue (SAR) operations are often nearly computer-technology-free due to the fragility and connectivity needs of current information communication technology (ICT). In this design fiction, we envision a world where SAR uses augmented reality (AR) and the surplus labor of volunteers during crisis response efforts.

Unmanned aerial vehicles, crowdsourced mapping platforms, and concepts from video game mapping technologies can all be mixed to keep SAR operations complexity-free while incorporating ICTs. Our scenario describes a near-future SAR operation with currently available technology being assembled and deployed without issue. After our scenario, we discuss socio-technical barriers for technology use like technical fragility and overwhelming complexity. We also discuss how to work around those barriers and how to use video games as a testbed for SAR technology. We hope to inspire more resilient ICT design that is accessible without training.

References

[1]

Sultan A. Alharthi, William A. Hamilton, Igor Dolgov, and Phoebe O. Toups Dugas. 2018. Mapping in the Wild: Toward Designing to Train Search & Rescue Planning. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing(CSCW ?18). ACM, New York, NY, USA, 137-140. https://doi.org/10.1145/3272973.3274039

Digital Library

[2]

Sultan A. Alharthi, Ruth C. Torres, Ahmed S. Khalaf, Phoebe O. Toups Dugas, Igor Dolgov, and Lennart E. Nacke. 2018. Investigating the Impact of Annotation Interfaces on Player Performance in Distributed Multiplayer Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ?18). ACM, New York, NY, USA, Article 314, 13 pages. https://doi.org/10.1145/3173574.3173888

Digital Library

[3]

S. H. Alsamhi, F. A. Almalki, Ou Ma, M. S. Ansari, and M. Angelides. 2019. Performance optimization of tethered balloon technology for public safety and emergency communications. Telecommunication Systems(2019), 1–10.

[4]

Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju Row-Farr. 2006. Can You See Me Now?ACM Trans. Comput.-Hum. Interact. 13, 1 (March 2006), 100–133. https://doi.org/10.1145/1143518.1143522

Digital Library

[5]

Niño Cabatingan. 2019. SpaceX Dragon Successfully Delivers NASA Cargo To ISS. International Business Times (7 May 2019).

[6]

Matthew Chalmers and Areti Galani. 2004. Seamful Interweaving: Heterogeneity in the Theory and Design of Interactive Systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques(DIS ’04). ACM, New York, NY, USA, 243–252. https://doi.org/10.1145/1013115.1013149

Digital Library

[7]

Dharma Dailey, Robert Soden, and Nicolas LaLone. 2017. Crisis Informatics for Everyday Analysts: A Design Fiction Approach to Social Media Best Practices. In Proceedings of the 2018 ACM Conference on Supporting Groupwork. ACM, Florida, USA, 230–243.

[8]

Alan Dix. 2017. Human–computer interaction, foundations and new paradigms. Journal of Visual Languages & Computing 42 (2017), 122–134.

Digital Library

[9]

Joel E. Fischer, Stuart Reeves, Tom Rodden, Steve Reece, Sarvapali D. Ramchurn, and David Jones. 2015. Building a Birds Eye View: Collaborative Work in Disaster Response. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). ACM, New York, NY, USA, 4103–4112. https://doi.org/10.1145/2702123.2702313

Digital Library

[10]

Bud Force. 2011. Texas Task Force 1: Urban Search & Rescue. Texas A&M University Press, College Station, Texas, USA.

[11]

Amanda Hughes and Leysia Palen. 2014. Social Media and Emergency Management. In Critical issues in disaster science and management: a dialogue between researchers and practitioners, Joseph E. Trainor and Tony Subbio (Eds.). FEMA Higher Education Project, Washington D.C., USA, Book chapter 11, 348–391.

[12]

Amelia Hunt and Doug Specht. 2019. Crowdsourced mapping in crisis zones: collaboration, organisation and impact. Journal of International Humanitarian Action 4, 1 (2019), 1.

[13]

Christopher Ketcham and Jai Galliott. 2016. Outsourcing space. In Commercial Space Exploration: Ethics, Policy and Governance. Routledge, New York, NY, USA, 299.

[14]

Md. Nafiz Hasan Khan and Carman Neustaedter. 2019. An Exploratory Study of the Use of Drones for Assisting Firefighters During Emergency Situations. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). ACM, New York, NY, USA, Article 272, 14 pages. https://doi.org/10.1145/3290605.3300502

Digital Library

[15]

Wynand Lambrechts and Saurabh Sinha. 2019. Successful Implementations of Last Mile Internet Solutions in Emerging Markets. In Last Mile Internet Access for Emerging Economies. Springer, New York City, NY, USA, 185–207.

[16]

Bruno Latour. 2011. Love your monsters. Breakthrough Journal 2, 11 (2011), 21–28.

[17]

Patrick Meier. 2015. Digital humanitarians: how big data is changing the face of humanitarian response. Taylor & Francis, Boca Raton, Fl, USA.

Digital Library

[18]

Nintendo EPD. 2017. The Legend of Zelda: Breath of the Wild. Game [Switch]. Nintendo, Kyoto, Japan.

[19]

Oxford English Dictionary. 2019. ”hurricane, n.”. Dictionary Definition. Retrieved June 6, 2019 from http://www.oed.com/view/Entry/89594.

[20]

Leysia Palen and Kenneth M Anderson. 2016. Crisis informatics–New data for extraordinary times. Science 353, 6296 (2016), 224–225.

[21]

Stuart Reeves, Murray Goulden, and Robert Dingwall. 2016. The future as a design problem. Design Issues 32, 3 (2016), 6–17.

[22]

Christian Reuter, Amanda Lee Hughes, and Marc-André Kaufhold. 2018. Social media in crisis management: An evaluation and analysis of crisis informatics research. International Journal of Human–Computer Interaction 34, 4(2018), 280–294.

[23]

Florian Roth and Timothy Prior. 2019. Utility of virtual operation support teams: An international survey. The Australian Journal of Emergency Management 34, 2(2019), 53.

[24]

Mostafa Sabbaghi, Willie Cade, Sara Behdad, and Ann M Bisantz. 2017. The current status of the consumer electronics repair industry in the US: A survey-based study. Resources, Conservation and Recycling 116 (2017), 137–151.

[25]

Robert Soden and Leysia Palen. 2016. Infrastructure in the Wild: What Mapping in Post-Earthquake Nepal Reveals About Infrastructural Emergence. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 2796–2807. https://doi.org/10.1145/2858036.2858545

Digital Library

[26]

Olivia Solon. March 6, 2017. A right to repair: why Nebraska farmers are taking on John Deere and Apple. The Guardian. https://www.theguardian.com/environment/2017/mar/06/nebraska-farmers-right-to-repair-john-deere-apple

[27]

Phoebe O. Toups Dugas, William A. Hamilton, and Sultan A. Alharthi. 2016. Playing at Planning: Game Design Patterns from Disaster Response Practice. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play(CHI PLAY '16). ACM, New York, NY, USA, 362-375. https://doi.org/10.1145/2967934.2968089

Digital Library

[28]

U.S. Department of Homeland Security. 2008. National Incident Management System. U.S. Department of Homeland Security, Washington, DC, USA.

[29]

Jason Wuertz, Sultan A. Alharthi, William A. Hamilton, Scott Bateman, Carl Gutwin, Anthony Tang, Phoebe O. Toups Dugas, and Jessica Hammer. 2018. A Design Framework for Awareness Cues in Distributed Multiplayer Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI '18). ACM, New York, NY, USA, Article 243, 14 pages. https://doi.org/10.1145/3173574.3173817

Digital Library

[30]

Kaige Yan, Jingweijia Tan, and Xin Fu. 2019. Bridging mobile device configuration to the user experience under budget constraint. Pervasive and Mobile Computing 58 (2019), 101023.

Digital Library

Cited By

Feder SPüschel AŞimşek MOdenwald SBendixen AEinhäuser W(2024)Visual search for hazardous items: using virtual reality (VR) in laypersons to test wearable displays for firefightersFrontiers in Virtual Reality10.3389/frvir.2024.12523515Online publication date: 11-Nov-2024
https://doi.org/10.3389/frvir.2024.1252351
Zhang KCochran BChen RHartung LSprecher BTredinnick RPonto KBanerjee SZhao Y(2024)Exploring the Design Space of Optical See-through AR Head-Mounted Displays to Support First Responders in the FieldProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642195(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642195
Liang JNi XChen F(2024)Xian Metaverse - Extended Reality Technology Enabling Digital Economy in Commercial NeighborhoodsHCI International 2024 Posters10.1007/978-3-031-61963-2_3(20-29)Online publication date: 8-Jun-2024
https://doi.org/10.1007/978-3-031-61963-2_3
Show More Cited By

Index Terms

A Vision of Augmented Reality for Urban Search and Rescue
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing

Index terms have been assigned to the content through auto-classification.

Recommendations

3D reconstruction of disaster scenes for urban search and rescue

Natural and man-made disasters that may take place due to a catastrophic incident (e.g., earthquake, explosion, terrorist attack) often result in trapped humans under rubble piles. In such emergency response situations, Urban Search and Rescue (USaR) ...
New Evacuation Guidance Using Augmented Reality for Emergency Rescue Evacuation Support System (ERESS)
ICPP Workshops '21: 50th International Conference on Parallel Processing Workshop

We are developing an Emergency Rescue Evacuation Support System (ERESS) for the purpose of evacuation support in the event of a local disaster. This system uses only terminals equipped with multiple sensors such as smartphones. It is a system that ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

HttF '19: Proceedings of the Halfway to the Future Symposium 2019

November 2019

260 pages

ISBN:9781450372039

DOI:10.1145/3363384

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

HTTF 2019

HTTF 2019: Halfway to the Future

November 19 - 20, 2019

Nottingham, United Kingdom

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
342
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)8

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Feder SPüschel AŞimşek MOdenwald SBendixen AEinhäuser W(2024)Visual search for hazardous items: using virtual reality (VR) in laypersons to test wearable displays for firefightersFrontiers in Virtual Reality10.3389/frvir.2024.12523515Online publication date: 11-Nov-2024
https://doi.org/10.3389/frvir.2024.1252351
Zhang KCochran BChen RHartung LSprecher BTredinnick RPonto KBanerjee SZhao Y(2024)Exploring the Design Space of Optical See-through AR Head-Mounted Displays to Support First Responders in the FieldProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642195(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642195
Liang JNi XChen F(2024)Xian Metaverse - Extended Reality Technology Enabling Digital Economy in Commercial NeighborhoodsHCI International 2024 Posters10.1007/978-3-031-61963-2_3(20-29)Online publication date: 8-Jun-2024
https://doi.org/10.1007/978-3-031-61963-2_3
Oztank FEscobar DBalcisoy S(2023)First Responders' Take on Technology: A Deep Dive into Mobile and AR Interface Preferences.Proceedings of the 22nd International Conference on Mobile and Ubiquitous Multimedia10.1145/3626705.3631788(499-500)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1145/3626705.3631788
Hoang Mvan Berkel NSkov MMerritt T(2023)Challenges and Requirements in Multi-Drone InterfacesExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585673(1-9)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585673
Khanal SMedasetti UMashal MSavage BKhadka R(2022)Virtual and Augmented Reality in the Disaster Management Technology: A Literature Review of the Past 11 yearsFrontiers in Virtual Reality10.3389/frvir.2022.8431953Online publication date: 11-Apr-2022
https://doi.org/10.3389/frvir.2022.843195
Rueben MHorrocks MMartinez JCormier MLaLone NFraune MToups Dugas P(2022)“I See You!”: A Design Framework for Interface Cues about Agent Visual Perception from a Thematic Analysis of VideogamesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517699(1-22)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517699
Luksas JQuinn KGabbard JHasan MHe JSurana NTabbarah MTeckchandani N(2022)Search and Rescue AR Visualization Environment (SAVE): Designing an AR Application for Use with Search and Rescue Personnel2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00109(488-492)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00109
Boldi ARapp ATirassa M(2022)Playing during a crisis: The impact of commercial video games on the reconfiguration of people’s life during the COVID-19 pandemicHuman–Computer Interaction10.1080/07370024.2022.205072539:5-6(338-379)Online publication date: 30-Mar-2022
https://doi.org/10.1080/07370024.2022.2050725
LaLone NToups Dugas PPapangelis K(2022)Practical Considerations on Applications of the Popularity of Games: The Case of Location-Based Games and DisasterHCI in Games10.1007/978-3-031-05637-6_13(213-233)Online publication date: 26-Jun-2022
https://dl.acm.org/doi/10.1007/978-3-031-05637-6_13
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten