skip to main content
10.1145/3544549.3585643acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Up, Up and Away - Investigating Information Needs for Helicopter Pilots in future Urban Air Mobility

Published: 19 April 2023 Publication History

Abstract

This qualitative work aims to address the emerging challenges and opportunities through advanced automation and visualization capabilities in the field of helicopter piloting for future Urban Air Mobility. A workshop was conducted with N=6 professional helicopter pilots to gather insights on these topics. The participants discussed key themes, including information needs, user interfaces, and automation. The results unveiled novel opportunities and highlighted challenges for research on aiding helicopter pilots in the fields of obstacle avoidance, map visualization, and air traffic visualization, such as augmenting flight paths to increase their situation awareness.

Supplementary Material

MP4 File (3544549.3585643-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706 qp063oa
[2]
Eric T. Chancey and Michael S. Politowicz. 2020. Public Trust and Acceptance for Concepts of Remotely Operated Urban Air Mobility Transportation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 64, 1 (2020), 1044–1048. https://doi.org/10.1177/1071181320641251
[3]
Mark Colley, Christian Bräuner, Mirjam Lanzer, Marcel Walch, Martin Baumann, and Enrico Rukzio. 2020. Effect of Visualization of Pedestrian Intention Recognition on Trust and Cognitive Load. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 181–191. https://doi.org/10.1145/3409120.3410648
[4]
Mark Colley, Julian Britten, Simon Demharter, Tolga Hisir, and Enrico Rukzio. 2022. Feedback Strategies for Crowded Intersections in Automated Traffic — A Desirable Future?. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 243–252. https://doi.org/10.1145/3543174.3545255
[5]
Mark Colley, Benjamin Eder, Jan Ole Rixen, and Enrico Rukzio. 2021. Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 155, 11 pages. https://doi.org/10.1145/3411764.3445351
[6]
Mark Colley, Max Rädler, Jonas Glimmann, and Enrico Rukzio. 2022. Effects of Scene Detection, Scene Prediction, and Maneuver Planning Visualizations on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 49 (jul 2022), 21 pages. https://doi.org/10.1145/3534609
[7]
Thomas Edwards and George Price. 2020. eVTOL Passenger Acceptance. (2020). https://ntrs.nasa.gov/citations/20200000532
[8]
EHang. 2020. The future of Transportation: White Paper on Urban Air Mobility Systems. https://www.ehang.com/app/en/EHang%20White%20Paper%20on%20Urban%20Air%20Mobility%20Systems.pdf
[9]
Daniel Friesen, Marilena D Pavel, Clark Borst, Olaf Stroosma, Pierangelo Masarati, and Max Mulder. 2020. Design and Evaluation of a Constraint-Based Head-Up Display for Helicopter Obstacle Avoidance During Forward Flight. In AIAA Scitech 2020 Forum. 0667. https://doi.org/10.2514/6.2020-0667
[10]
Julien Haan, Laurie A. Garrow, Aude Marzuoli, Satadru Roy, and Michel Bierlaire. 2021. Are commuter air taxis coming to your city? A ranking of 40 cities in the United States. Transportation Research Part C: Emerging Technologies 132 (2021), 103392. https://doi.org/10.1016/j. trc.2021.103392
[11]
Sandra G. Hart. 1988. Helicopter Human Factors. In Human Factors in Aviation. Elsevier, Amsterdam, The Netherlands, 591–638. https://doi.org/10.1016/B978-0-08-057090-7.50024-2
[12]
Renate Häuslschmid, Max von Bülow, Bastian Pfleging, and Andreas Butz. 2017. SupportingTrust in Autonomous Driving. In Proceedings of the 22nd International Conference on Intelligent User Interfaces, George A. Papadopoulos, Tsvi Kuflik, Fang Chen, Carlos Duarte, and Wai-Tat Fu (Eds.). ACM, New York, NY, USA, 319–329. https://doi.org/10.1145/3025171.3025198
[13]
Reilly J Innes, Zachary L Howard, Alexander Thorpe, Ami Eidels, and Scott D Brown. 2021. The effects of increased visual information on cognitive workload in a helicopter simulator. Human factors 63, 5 (2021), 788–803. https://doi.org/10.1177/0018720820945409
[14]
Liu Kai, Li Jun-Jie, Wu Jing, and Wu Xiao-Jun. 2021. Research on Augmented Reality Technology of Helicopter Aided Navigation Based on Lidar. In 2021 IEEE 7th International Conference on Virtual Reality (ICVR). IEEE, New York, NY, USA, 373–379. https://doi.org/10.1109/ICVR51878.2021.9483859
[15]
Young Woo Kim, Cherin Lim, Yong Gu Ji, Sol Hee Yoon, Mark Colley, and Luca-Maxim Meinhardt. 2022. The 2nd Workshop on User Experience in Urban Air Mobility: From Ground to Aerial Transportation. In Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 168–171. https://doi.org/10.1145/3544999.3550223
[16]
Young Woo Kim, Cherin Lim, Seul Chan Lee, Sol Hee Yoon, and Yong Gu Ji. 2021. The 1st Workshop on User Experience in Urban Air Mobility: Design Considerations and Issues. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Leeds, United Kingdom) (AutomotiveUI ’21 Adjunct). Association for Computing Machinery, New York, NY, USA, 175–177. https://doi.org/10.1145/3473682.3477440
[17]
Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2018. Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 164–175. https://doi.org/10.1145/3239060.3239074
[18]
Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2019. Conveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 329–341. https://doi.org/10.1145/3342197.3344537
[19]
Cherin Lim, Young Woo Kim, Yong Gu Ji, Solhee Yoon, and Seul Chan Lee. 2022. Is This Flight Headed Downtown? : User Experience Considerations for Urban Air Mobility. In CHI Conference on Human Factors in Computing Systems Extended Abstracts, Simone Barbosa, Cliff Lampe, Caroline Appert, and David A. Shamma (Eds.). ACM, New York, NY, USA, 1–7. https://doi.org/10.1145/3491101.3519852
[20]
Thomas Lüken and Bernd Korn. 2008. “Tunnel in the Sky” Guidance for Helicopter IFR steep and curved approaches. In ODAS 2008 9th ONERA-DLR Aerospace Symposium. https://elib.dlr.de/55041/
[21]
R. Bruce Lumsden, Gareth D. Padfield, and Carole D. Braby-Deighton. 1999. Human Factors Challenges at the Helicopter-Ship Dynamic Interface. In SAE Technical Paper Series(SAE Technical Paper Series). SAE International400, Warrendale, PA, USA, 23 pages. https://doi.org/10.4271/1999-01-5607
[22]
Tim Mehling, Omkar Halbe, Manfred Hajek, and Milan Vrdoljak. 2022. Visual and Control Augmentation Techniques for Pilot Assistance During Helicopter Shipboard Recovery. Journal of the American Helicopter Society 67, 4 (2022), 16 pages. https://doi.org/10.4050/JAHS.67.042004
[23]
Dev Minotra and Karen M. Feigh. 2020. An Analysis of Cognitive Demands in Ship-Based Helicopter-Landing Maneuvers. Journal of the American Helicopter Society 65, 4 (2020), 1–11. https://doi.org/10.4050/JAHS.65.042009
[24]
Tobias Müller, Mark Colley, Gülsemin Dogru, and Enrico Rukzio. 2022. AR4CAD: Creation and Exploration of a Taxonomy of Augmented Reality Visualization for Connected Automated Driving. Proc. ACM Hum.-Comput. Interact. 6, MHCI, Article 177 (sep 2022), 27 pages. https://doi.org/10.1145/3546712
[25]
Thomas Münsterer, Tobias Schafhitzel, Michael Strobel, Philipp Völschow, Stephanus Klasen, and Ferdinand Eisenkeil. 2014. Sensor-enhanced 3D conformal cueing for safe and reliable HC operation in DVE in all flight phases. In Degraded Visual Environments: Enhanced, Synthetic, and External Vision Solutions 2014(SPIE Proceedings), Jeff J. Güell and Jack Sanders-Reed (Eds.). SPIE, Bellingham, Washington, USA, 90870I. https://doi.org/10.1117/12.2050377
[26]
Niklas Peinecke, Patrizia M. Knabl, Sven Schmerwitz, and Hans-Ullrich Döhler. 2012. Developing an obstacle display for helicopter brownout situations. In Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications IX, Daniel J. Henry, Davis A. Lange, Dale Linne von Berg, Darrell L. Young, Kenneth L. Bernier, Jeff J. Guell, and Sreekanth Danny Rajan (Eds.). Vol. 8360. International Society for Optics and Photonics, SPIE, Bellingham, WA. USA, 83600R. https://doi.org/10.1117/12.919081
[27]
Niklas Peinecke, Sven Schmerwitz, Hans-Ullrich Döhler, and Thomas Lüken. 2017. Review of conformal displays: more than a highway in the sky. Optical Engineering 56, 5 (2017), 051406. https://doi.org/10.1117/1.OE.56.5.051406
[28]
Andrew Prahl and Lyn Van Swol. 2017. Understanding algorithm aversion: When is advice from automation discounted?Journal of Forecasting 36, 6 (2017), 691–702. https://doi.org/10.1002/for.2464
[29]
A. Pukhova, C. Llorca, A. Moreno, C. Staves, Q. Zhang, and R. Moeckel. 2021. Flying taxis revived: Can Urban air mobility reduce road congestion?Journal of Urban Mobility 1 (2021), 100002. https://doi.org/10.1016/j. urbmob.2021.100002
[30]
Suchithra Rajendran and Jake Shulman. 2020. Study of emerging air taxi network operation using discrete-event systems simulation approach. Journal of Air Transport Management 87 (2020), 101857. https://doi.org/10.1016/j. jairtraman.2020.101857
[31]
Suchithra Rajendran and Joshua Zack. 2019. Insights on strategic air taxi network infrastructure locations using an iterative constrained clustering approach. Transportation Research Part E: Logistics and Transportation Review 128 (2019), 470–505. https://doi.org/10.1016/j.tre.2019.06.003
[32]
Johnny Saldaña. 2016. The coding manual for qualitative researchers (3e [third edition] ed.). SAGE, Los Angeles, Calif. and London.
[33]
Sven Schmerwitz, Thomas Lueken, Hans-Ullrich Doehler, Niklas Peinecke, Johannes M. Ernst, and David L. da Silva Rosa. 2017. Conformal displays: human factor analysis of innovative landing aids. Optical Engineering 56, 5 (2017), 051407. https://doi.org/10.1117/1.OE.56.5.051407
[34]
Neville A Stanton, Katherine L Plant, Aaron P Roberts, and Craig K Allison. 2019. Use of Highways in the Sky and a virtual pad for landing Head Up Display symbology to enable improved helicopter pilots situation awareness and workload in degraded visual conditions. Ergonomics 62, 2 (2019), 255–267. https://doi.org/10.1080/00140139.2017.1414301
[35]
Neville A Stanton, Aaron P Roberts, Katherine L Plant, Craig K Allison, and Catherine Harvey. 2018. Head-up displays assist helicopter pilots landing in degraded visual environments. Theoretical issues in ergonomics science 19, 5 (2018), 513–529. https://doi.org/10.1080/1463922X.2017.1394506
[36]
Jean Toner. 2009. Small is not too small: Reflections concerning the validity of very small focus groups (VSFGs). Qualitative Social Work 8, 2 (2009), 179–192. https://doi.org/10.1177/1473325009103374
[37]
Volocopter GmbH. 2017. First Ever Public Demonstration of an Autonomous Urban Air Taxi. Volocopter GmbH. Retrieved August 22, 2022 from https://www.volocopter.com/newsroom/first-ever-public-demonstration-of-an-autonomous-urban-air-taxi/
[38]
Tamara von Sawitzky, Philipp Wintersberger, Andreas Riener, and Joseph L. Gabbard. 2019. Increasing trust in fully automated driving. In Proceedings of the 8th ACM International Symposium on Pervasive Displays, Mohamed Khamis, Salvatore Sorce, Jessica R. Cauchard, and Vito Gentile (Eds.). ACM, New York, NY, USA, 1–7. https://doi.org/10.1145/3321335.3324947
[39]
Tim Waanders, T. Münsterer, and M. Kress. 2013. Sensor supported pilot assistance for helicopter flight in DVE. In Degraded Visual Environments: Enhanced, Synthetic, and External Vision Solutions 2013(SPIE Proceedings), Kenneth L. Bernier and Jeff J. Güell (Eds.). SPIE, Bellingham, Washington, USA, 873704. https://doi.org/10.1117/12.2015783
[40]
Guoqing Wang and Wenhao Zhao. 2020. Chapter 3 - The requirement organization of the avionics system. In The Principles of Integrated Technology in Avionics Systems, Guoqing Wang and Wenhao Zhao (Eds.). Academic Press, London, UK, 103–167. https://doi.org/10.1016/B978-0-12-816651-2.00003-4
[41]
Philipp Wintersberger, Tamara von Sawitzky, Anna-Katharina Frison, and Andreas Riener. 2017. Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter, Fabio Paternò, Lucio Davide Spano, Carmelo Ardito, and Carmen Santoro (Eds.). ACM, New York, NY, USA, 1–7. https://doi.org/10.1145/3125571.3125600

Cited By

View all
  • (2024)Wind of Change: Investigating Information Visualizations for Passengers and Residents' Perception of Automated Urban Air MobilityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997538:4(1-31)Online publication date: 21-Nov-2024
  • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
  • (2024)An Augmented Reality Pilot Assistance Concept for Advanced Air Mobility Aircraft Employing Simplified Vehicle Operations2024 AIAA DATC/IEEE 43rd Digital Avionics Systems Conference (DASC)10.1109/DASC62030.2024.10749170(1-9)Online publication date: 29-Sep-2024
  • Show More Cited By

Index Terms

  1. Up, Up and Away - Investigating Information Needs for Helicopter Pilots in future Urban Air Mobility

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    3914 pages
    ISBN:9781450394222
    DOI:10.1145/3544549
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Check for updates

    Author Tags

    1. Helicopters
    2. Urban Air Mobility
    3. Virtual Reality
    4. Workshop

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)123
    • Downloads (Last 6 weeks)49
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Wind of Change: Investigating Information Visualizations for Passengers and Residents' Perception of Automated Urban Air MobilityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997538:4(1-31)Online publication date: 21-Nov-2024
    • (2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
    • (2024)An Augmented Reality Pilot Assistance Concept for Advanced Air Mobility Aircraft Employing Simplified Vehicle Operations2024 AIAA DATC/IEEE 43rd Digital Avionics Systems Conference (DASC)10.1109/DASC62030.2024.10749170(1-9)Online publication date: 29-Sep-2024
    • (2023)Come Fly With MeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962497:2(1-23)Online publication date: 12-Jun-2023
    • (2023)Stairway to Heaven: A Demonstration of Different Trajectories and Weather Conditions in Automated Urban Air MobilityAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3610372(311-313)Online publication date: 18-Sep-2023
    • (2023)The 3rd Workshop on User Experience in Urban Air Mobility: What Could We Learn From AutomotiveUI?Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609824(252-255)Online publication date: 18-Sep-2023

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media