skip to main content
10.1145/3349263.3351511acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
Work in Progress

VRoad: gesture-based interaction between pedestrians and automated vehicles in virtual reality

Published: 21 September 2019 Publication History

Abstract

As a third party to both automated and non-automated vehicles, pedestrians are among the most vulnerable participants in traffic. Currently, there is no way for them to communicate their intentions to an automated vehicle (AV). In this work, we explore the interactions between pedestrians and AVs at unmarked crossings. We propose a virtual reality testbed, in which we conducted a pilot study to compare three conditions: crossing a street before a car that (1) does not give information, (2) displays its locomotion, or (3) displays its locomotion and reacts to pedestrians' gestures. Our results show that gestures introduce a new point of failure, which can increase pedestrians' insecurity. However, communicating the vehicle's locomotion supports pedestrians, helping them to make safer decisions.

References

[1]
F. Camara, O. Giles, R. Madigan, M. Rothmüller, P. H. Rasmussen, S. A. Vendelbo-Larsen, G. Markkula, Y. M. Lee, L. Garach, N. Merat, and C. W. Fox. 2018. Predicting pedestrian road-crossing assertiveness for autonomous vehicle control. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC). 2098--2103.
[2]
Chia-Ming Chang, Koki Toda, Daisuke Sakamoto, and Takeo Igarashi. 2017. Eyes on a Car: An Interface Design for Communication Between an Autonomous Car and a Pedestrian. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 65--73.
[3]
Rebecca Currano, So Yeon Park, Lawrence Domingo, Jesus Garcia-Mancilla, Pedro C. Santana-Mancilla, Victor M. Gonzalez, and Wendy Ju. 2018. Vamos!: Observations of Pedestrian Interactions with Driverless Cars in Mexico. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '18). ACM, New York, NY, USA, 210--220.
[4]
Debargha Dey, Marieke Martens, Chao Wang, Felix Ros, and Jacques Terken. 2018. Interface Concepts for Intent Communication from Autonomous Vehicles to Vulnerable Road Users. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '18). ACM, New York, NY, USA, 82--86.
[5]
Debargha Dey and Jacques Terken. 2017. Pedestrian Interaction with Vehicles: Roles of Explicit and Implicit Communication. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '17). ACM, New York, NY, USA, 109--113.
[6]
Azra Habibovic, Jonas Andersson, Victor Malmsten Lundgren, Maria Klingegård, Cristofer Englund, and Sofia Larsson. 2019. External Vehicle Interfaces for Communication with Other Road Users? Springer International Publishing, Cham, 91--102.
[7]
Azra Habibovic, Victor Malmsten Lundgren, Jonas Andersson, Maria Klingegård, Tobias Lagström, Anna Sirkka, Johan Fagerlönn, Claes Edgren, Rikard Fredriksson, Stas Krupenia, Dennis Saluäär, and Pontus Larsson. 2018. Communicating Intent of Automated Vehicles to Pedestrians. Frontiers in Psychology 9 (2018), 1336.
[8]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology 52 (1988), 139 -- 183.
[9]
Franz Keferböck and Andreas Riener. 2015. Strategies for negotiation between autonomous vehicles and pedestrians. Mensch und Computer 2015--Workshopband (2015).
[10]
Andrew L. Kun. 2018. Human-Machine Interaction for Vehicles: Review and Outlook. Foundations and Trends® in Human-Computer Interaction 11, 4 (2018), 201--293.
[11]
Karthik Mahadevan, Sowmya Somanath, and Ehud Sharlin. 2018. Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 429, 12 pages.
[12]
Alexander G. Mirnig, Philipp Wintersberger, Alexander Meschtscherjakov, Andreas Riener, and Susanne Boll. 2018. Workshop on Communication Between Automated Vehicles and Vulnerable Road Users. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '18). ACM, New York, NY, USA, 65--71.
[13]
Vincent Nguyen. 2017. 2019 Audi A8 Level 3 autonomy first-drive: Chasing the perfect 'jam'. (Sep 2017).
[14]
A. Rasouli and J. K. Tsotsos. 2019. Autonomous Vehicles That Interact With Pedestrians: A Survey of Theory and Practice. IEEE Transactions on Intelligent Transportation Systems (2019), 1--19.
[15]
Robert Bosch GmbH. 2019. Automated Valet Parking - Don't get stressed, get parked. (2019). https://web.archive.org/web/20190411085556/https://www.bosch.com/stories/automated-valet-parking/
[16]
Dirk Rothenbücher, Jamy Li, David Sirkin, Brian Mok, and Wendy Ju. 2015. Ghost Driver: A Platform for Investigating Interactions Between Pedestrians and Driverless Vehicles. In Adjunct Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). ACM, New York, NY, USA, 44--49.
[17]
Sebastian Weiss. 2019. VRoad. https://github.com/seweiss-hci/VRoad. (2019). [Online; accessed 27-July-2019].

Cited By

View all
  • (2024)Mapping Pedestrian-to-Driver Gestures: Implications for Autonomous Vehicle Bidirectional InteractionAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685014(1-7)Online publication date: 22-Sep-2024
  • (2024)SafeARCross: Augmented Reality Collision Warnings and Virtual Traffic Lights for Pedestrian SafetyProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675734(63-73)Online publication date: 22-Sep-2024
  • (2024)"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and PedestriansProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642029(1-25)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. VRoad: gesture-based interaction between pedestrians and automated vehicles in virtual reality

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      AutomotiveUI '19: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings
      September 2019
      524 pages
      ISBN:9781450369206
      DOI:10.1145/3349263
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 September 2019

      Check for updates

      Author Tags

      1. automated vehicle (AV)
      2. gestures
      3. pedestrian-interaction
      4. virtual reality (VR)

      Qualifiers

      • Work in progress

      Conference

      AutomotiveUI '19
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 248 of 566 submissions, 44%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)46
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 10 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Mapping Pedestrian-to-Driver Gestures: Implications for Autonomous Vehicle Bidirectional InteractionAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685014(1-7)Online publication date: 22-Sep-2024
      • (2024)SafeARCross: Augmented Reality Collision Warnings and Virtual Traffic Lights for Pedestrian SafetyProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675734(63-73)Online publication date: 22-Sep-2024
      • (2024)"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and PedestriansProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642029(1-25)Online publication date: 11-May-2024
      • (2024)Realistic Grasping Based on Soft Finger Force Interaction2024 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD61410.2024.10580216(2528-2533)Online publication date: 8-May-2024
      • (2024)Interpreting pedestrians' head movements when encountering automated vehicles at a virtual crossroadTransportation Research Part F: Traffic Psychology and Behaviour10.1016/j.trf.2024.04.022103(340-352)Online publication date: May-2024
      • (2023)Exploring the Potential of eHMIs as Traffic Light AlternativesAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609885(99-104)Online publication date: 18-Sep-2023
      • (2023)Digital twin in virtual reality for human-vehicle interactions in the context of autonomous driving2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)10.1109/ITSC57777.2023.10421914(590-595)Online publication date: 24-Sep-2023
      • (2023)Towards More Effective Interactions: A Hybrid Embodied Interaction Approach in Stereoscopic Displays2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00031(113-117)Online publication date: 16-Oct-2023
      • (2022)Designing Wearable Augmented Reality Concepts to Support Scalability in Autonomous Vehicle-Pedestrian InteractionFrontiers in Computer Science10.3389/fcomp.2022.8665164Online publication date: 29-Mar-2022
      • (2022)Tour de Interaction: Understanding Cyclist-Driver Interaction with Self-Reported Cyclist BehaviourAdjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3544999.3552531(127-131)Online publication date: 17-Sep-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media