skip to main content
10.1145/3473682.3481878acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
demonstration

Mixed Reality Environment for Testing Automated Vehicle and Pedestrian Interaction

Published: 22 September 2021 Publication History

Abstract

The test and development of Automated Driving Systems is usually realized by scenario based testing or virtual testing environments. These methods apply artificial targets to trigger the safety critical functions under specific predefined scenarios, as the NCAP or IIHS test catalogues. Despite having a good reproducibility, these approaches hardly permit the evaluation of new interaction concepts like external Human-Machine Interfaces (eHMIs), since the interaction between real users and the vehicle cannot be realistic reproduced without risks to the participants. The novel Mixed Reality Test Environment (MiRE) overcomes this limitation by the integration of Virtual Reality (VR) technologies, Dynamic Vehicle-in-the-Loop (DynViL) and the Virtual Environment. In MiRE the movement and positioning of the vehicles and the VRUs are tracked in real time and reproduced in the virtual environment. Synthetic data from the virtual environment is generated to stimulate the vehicle and the human participant, enabling a safe interaction between both entities.

References

[1]
Aptiv, Audi, Apollo, BMW, Continental, Daimler, FCA, here, Infenieon, Intel and Volkswagen. 2019. Safety First for Automated Driving. https://www.daimler.com/documents/innovation/other/safety-first-for-automated-driving.pdf
[2]
Polona Caserman, Augusto Garcia-Agundez, Robert Konrad, Stefan Göbel, and Ralf Steinmetz. 2019. Real-time body tracking in virtual reality using a Vive tracker. Virtual Reality 23, 2 (2019), 155–168. https://doi.org/10.1007/s10055-018-0374-z
[3]
Yu Chen, Shitao Chen, Tong Xiao, Songyi Zhang, Qian Hou, and Nanning Zheng. 2020. Mixed Test Environment-based Vehicle-in-the-loop Validation - A New Testing Approach for Autonomous Vehicles. In 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE, Las Vegas, NV, USA, 1283–1289. https://doi.org/10.1109/IV47402.2020.9304658
[4]
Shuchisnigdha Deb, Daniel Carruth, Richard Sween, Lesley Strawderman, and Teena Garrison. 2017. Efficacy of virtual reality in pedestrian safety research. Applied ergonomics 65 (11 2017). https://doi.org/10.1016/j.apergo.2017.03.007
[5]
European new car assessment Programme. 2021. Test Protocal – AEB VRU systems. https://cdn.euroncap.com/media/62795/euro-ncap-aeb-vru-test-protocol-v304.pdf
[6]
Tanja Fuest, Elisabeth Schmidt, and Klaus Bengler. 2020. Comparison of Methods to Evaluate the Influence of an Automated Vehicle’s Driving Behavior on Pedestrians: Wizard of Oz, Virtual Reality, and Video. Information 11 (05 2020), 291. https://doi.org/10.3390/info11060291
[7]
Insurance Institute for Highway Safety. 2019. Pedestrian Autonomous Emergency Braking, Test Protocol. https://cdn.euroncap.com/media/62795/euro-ncap-aeb-vru-test-protocol-v304.pdf
[8]
F. Reway, W. Huber, and E. P. Ribeiro. 2018. Test Methodology for Vision-Based ADAS Algorithms with an Automotive Camera-in-the-Loop. In 2018 IEEE International Conference on Vehicular Electronics and Safety (ICVES). IEEE, Madrid, Spain, 1–7. https://doi.org/10.1109/ICVES.2018.8519598
[9]
Stefan Riedmaier, Jonas Nesensohn, Christian Gutenkunst, Tobias Düser, Bernhard Schick, and Houssem Abdellatif. 2018. Validation of X-in-the-Loop Approaches for Virtual Homologation of Automated Driving Functions. In 11th Graz Symposium Virtual Vehicle. Virtual Vehicle Research GmbH, Graz.
[10]
Nadja Schömig, Katharina Wiedemann, Frederik Naujoks, Alexandra Neukum, Bettina Leuchtenberg, and Thomas Vöhringer-Kuhnt. 2018. An Augmented Reality Display for Conditionally Automated Driving. In Adjunct Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 137–141. https://doi.org/10.1145/3239092.3265956
[11]
Selim Solmaz, Martin Rudigier, and Marlies Mischinger. 2020. A Vehicle-in-the-Loop Methodology for Evaluating Automated Driving Functions in Virtual Traffic. In 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE, Las Vegas, NV, USA, 1465–1471. https://doi.org/10.1109/IV47402.2020.9304811
[12]
Balazs Varga, Tamás Tettamanti, and Zsolt Szalay. 2021. System Architecture for Scenario-In-The-Loop Automotive Testing. Transport and Telecommunication Journal 22, 2 (2021), 141–151. https://doi.org/10.2478/ttj-2021-0011
[13]
Tamara von Sawitzky, Philipp Wintersberger, Andreas Riener, and Joseph L. Gabbard. 2019. Increasing Trust in Fully Automated Driving: Route Indication on an Augmented Reality Head-up Display. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis ’19). Association for Computing Machinery, New York, NY, USA, Article 6, 7 pages. https://doi.org/10.1145/3321335.3324947
[14]
Marcel Walch, David Lehr, Mark Colley, and Michael Weber. 2019. Don’t You See Them? Towards Gaze-Based Interaction Adaptation for Driver-Vehicle Cooperation. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 232–237. https://doi.org/10.1145/3349263.3351338
[15]
Marcel Walch, Marcel Woide, Kristin Mühl, Martin Baumann, and Michael Weber. 2019. Cooperative Overtaking: Overcoming Automated Vehicles’ Obstructed Sensor Range via Driver Help. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 144–155. https://doi.org/10.1145/3342197.3344531
[16]
Gesa Wiegand, Kai Holländer, Katharina Rupp, and Heinrich Hussmann. 2020. The Joy of Collaborating with Highly Automated Vehicles. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 223–232. https://doi.org/10.1145/3409120.3410643
[17]
Philipp Wintersberger, Tamara von Sawitzky, Anna-Katharina Frison, and Andreas Riener. 2017. Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter (Cagliari, Italy) (CHItaly ’17). Association for Computing Machinery, New York, NY, USA, Article 17, 7 pages. https://doi.org/10.1145/3125571.3125600

Cited By

View all
  • (2024)Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A SurveyIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.347374025:12(19276-19294)Online publication date: Dec-2024
  • (2023)IntVRsection: Virtual Reality Environment for Evaluating Signalized and Unsignalized Intersection ScenariosAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3610373(300-303)Online publication date: 18-Sep-2023
  • (2023)2nd Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Immersive Driving Experiences, and Helmet-Mounted AR for Future MobilityAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609832(219-222)Online publication date: 18-Sep-2023
  • Show More Cited By
  1. Mixed Reality Environment for Testing Automated Vehicle and Pedestrian Interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    AutomotiveUI '21 Adjunct: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
    September 2021
    234 pages
    ISBN:9781450386418
    DOI:10.1145/3473682
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 September 2021

    Check for updates

    Author Tags

    1. Automated Driving Systems
    2. External Human-Machine Interfaces
    3. Sensor stimulation
    4. Test Procedures
    5. Vehicle-in-the-Loop

    Qualifiers

    • Demonstration
    • Research
    • Refereed limited

    Funding Sources

    Conference

    AutomotiveUI '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 248 of 566 submissions, 44%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)72
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Advancements in Mixed Reality for Autonomous Vehicle Testing and Advanced Driver Assistance Systems: A SurveyIEEE Transactions on Intelligent Transportation Systems10.1109/TITS.2024.347374025:12(19276-19294)Online publication date: Dec-2024
    • (2023)IntVRsection: Virtual Reality Environment for Evaluating Signalized and Unsignalized Intersection ScenariosAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3610373(300-303)Online publication date: 18-Sep-2023
    • (2023)2nd Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Immersive Driving Experiences, and Helmet-Mounted AR for Future MobilityAdjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3581961.3609832(219-222)Online publication date: 18-Sep-2023
    • (2023)Sim-on-Wheels: Physical World in the Loop Simulation for Self-DrivingIEEE Robotics and Automation Letters10.1109/LRA.2023.33256898:12(8192-8199)Online publication date: Dec-2023
    • (2023)A mixed-reality framework based on depth camera for safety testing of autonomous navigation systems2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)10.1109/ITSC57777.2023.10421982(2050-2055)Online publication date: 24-Sep-2023
    • (2022)Workshop on Automotive Mixed Reality Applications: Transitional Interfaces, Multi-User VR, and Helmet-Mounted AR for CyclistsAdjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3544999.3550158(172-175)Online publication date: 17-Sep-2022
    • (2022)MiRE, A Mixed Reality Environment for Testing of Automated Driving FunctionsIEEE Transactions on Vehicular Technology10.1109/TVT.2022.316035371:4(3443-3456)Online publication date: Apr-2022
    • (2022)How Simulation based Test Methods will substitute the Proving Ground Testing?2022 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV51971.2022.9827394(903-908)Online publication date: 4-Jun-2022
    • (2022)Comparing Different Pedestrian Representations for Testing Automated Driving Functions in Mixed Reality Environments2022 IEEE International Conference on Vehicular Electronics and Safety (ICVES)10.1109/ICVES56941.2022.9986669(1-7)Online publication date: 14-Nov-2022

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media