skip to main content
10.1145/3550356.3558506acmconferencesArticle/Chapter ViewAbstractPublication PagesmodelsConference Proceedingsconference-collections
research-article

Towards realizing test conditions for automated vehicles

Published:09 November 2022Publication History

ABSTRACT

The verification and validation of Automated Driving Systems pose a challenge to the deployment of automated vehicles onto the roads. Current research considers a scenario-based approach to control the traffic situations an automated vehicle is tested in. One of the several open challenges in this field is how test conditions for the self-driving vehicle under test (VUT) can be realized. This is because the test designer probably cannot tailor the test script to the VUT's actual behaviour due to unknown knowledge of the complex system logic and therefore the VUT might not reach the situation of interest during a test. In this paper, the problem of bringing the VUT and the environment in the desired initial states for a test, respectively a scenario, is described. Furthermore, the idea of a reinforcement learning approach of controlling traffic agents in the environment of the VUT is presented and under development in the corresponding doctoral project with focus on virtual testing.

References

  1. Matthias Althoff and Sebastian Lutz. 2018. Automatic Generation of Safety-Critical Test Scenarios for Collision Avoidance of Road Vehicles. In 2018 IEEE Intelligent Vehicles Symposium (IV). 1326--1333. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. ASAM. 2022. OpenSCENARIO. Available at https://www.asam.net/standards/detail/openscenario/. Last accessed June 20, 2022.Google ScholarGoogle Scholar
  3. Felix Beringhoff, Joel Greenyer, Christian Roesener, and Matthias Tichy. 2022. Thirty-One Challenges in Testing Automated Vehicles: Interviews with Experts from Industry and Research. In 2022 IEEE Intelligent Vehicles Symposium (IV). 360--366. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Glen Chou, Yunus Emre Sahin, Liren Yang, Kwesi J. Rutledge, Petter Nilsson, and Necmiye Ozay. 2018. Using Control Synthesis to Generate Corner Cases: A Case Study on Autonomous Driving. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 37, 11 (2018), 2906--2917. Google ScholarGoogle ScholarCross RefCross Ref
  5. On-Road Automated Driving (ORAD) committee. 2021. Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Google ScholarGoogle ScholarCross RefCross Ref
  6. PEGASUS Consortium. 2019. PEGASUS METHOD - An Overview. https://www.pegasusprojekt.de/files/tmpl/Pegasus-Abschlussveranstaltung/PEGASUS-Gesamtmethode.pdf. Last accessed June 26, 2022.Google ScholarGoogle Scholar
  7. Johannes Deichmann, Georg Doll, Jan Paul Stein, Benjamin Klein, and Bernhard Mühlreiter. 2022. Cracking the complexity code in embedded systems development. Available at https://www.mckinsey.com/industries/advanced-electronics/our-insights/cracking-the-complexity-code-in-embedded-systems-development. Last accessed June 26, 2022.Google ScholarGoogle Scholar
  8. Wenhao Ding, Baiming Chen, Minjun Xu, and Ding Zhao. 2020. Learning to Collide: An Adaptive Safety-Critical Scenarios Generating Method. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2243--2250. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Lutz Eckstein, Thomas Form, Markus Maurer, Rodolfo Schöneburg, Gernot Spiegelberg, and Christoph Stiller. 2018. VDI-Statusreport Automatisiertes Fahren.Google ScholarGoogle Scholar
  10. Alessio Gambi, Tri Huynh, and Gordon Fraser. 2019. Generating Effective Test Cases for Self-Driving Cars from Police Reports. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Tallinn, Estonia) (ESEC/FSE 2019). Association for Computing Machinery, New York, NY, USA, 257--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Thomas Hempen, Sanjana Biank, Werner Huber, and Christian Diedrich. 2017. Model based generation of driving scenarios. In First International Conference on Intelligent Transport Systems. Springer, 153--163.Google ScholarGoogle Scholar
  12. Moritz Klischat and Matthias Althoff. 2019. Generating Critical Test Scenarios for Automated Vehicles with Evolutionary Algorithms. In 2019 IEEE Intelligent Vehicles Symposium (IV). 2352--2358. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Chengjie Lu, Yize Shi, Huihui Zhang, Man Zhang, Tiexin Wang, Tao Yue, and Shaukat Ali. 2022. Learning Configurations of Operating Environment of Autonomous Vehicles to Maximize their Collisions. IEEE Transactions on Software Engineering (2022). Google ScholarGoogle ScholarCross RefCross Ref
  14. Till Menzel, Gerrit Bagschik, and Markus Maurer. 2018. Scenarios for Development, Test and Validation of Automated Vehicles. In 2018 IEEE Intelligent Vehicles Symposium (IV). 1821--1827. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Euro NCAP. 2018. 2018Automated Driving Tests. https://www.euroncap.com/en/vehicle-safety/safety-campaigns/2018-automated-driving-tests/. Last accessed July 04, 2022.Google ScholarGoogle Scholar
  16. Euro NCAP. 2019. TEST PROTOCOL - AEB Car-to-Car systems. Available at https://cdn.euroncap.com/media/62794/euro-ncap-aeb-c2c-test-protocol-v303.pdf. Last accessed June 20, 2022.Google ScholarGoogle Scholar
  17. Christian Neurohr, Lukas Westhofen, Tabea Henning, Thies de Graaff, Eike Möhlmann, and Eckard Böde. 2020. Fundamental Considerations around Scenario-Based Testing for Automated Driving. In 2020 IEEE Intelligent Vehicles Symposium (IV). 121--127. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ken Peffers, Tuure Tuunanen, Marcus A Rothenberger, and Samir Chatterjee. 2007. A design science research methodology for information systems research. Journal of management information systems 24, 3 (2007), 45--77.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Stefan Riedmaier, Thomas Ponn, Dieter Ludwig, Bernhard Schick, and Frank Diermeyer. 2020. Survey on Scenario-Based Safety Assessment of Automated Vehicles. IEEE Access 8 (2020), 87456--87477. Google ScholarGoogle ScholarCross RefCross Ref
  20. Christian Roesener, Felix Fahrenkrog, Axel Uhlig, and Lutz Eckstein. 2016. A scenario-based assessment approach for automated driving by using time series classification of human-driving behaviour. In 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC). 1360--1365. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. John M Scanlon, Kristofer D Kusano, Tom Daniel, Christopher Alderson, Alexander Ogle, and Trent Victor. 2021. Waymo simulated driving behavior in reconstructed fatal crashes within an autonomous vehicle operating domain. Accident Analysis & Prevention 163 (2021), 106454.Google ScholarGoogle ScholarCross RefCross Ref
  22. Hans-Peter Schöner and Wolfgang Hurich. 2016. Testing with coordinated automated vehicles. In Handbook of Driver Assistance Systems. Springer, 261--276.Google ScholarGoogle Scholar
  23. Angela Schubert, Christian Erbsmehl, and Lars Hannawald. 2013. Standardized pre-crash-scenarios in digital format on the basis of the VUFO simulation. In 5th International Conference on ESAR 2012.Google ScholarGoogle Scholar
  24. Jan Erik Stellet, Matthias Woehrle, Tino Brade, Alexander Poddey, and Wolfgang Branz. 2020. Validation of automated driving a structured analysis and survey of approaches. In 13. Uni-DAS eV Workshop Fahrerassistenz und automatisiertes Fahren.Google ScholarGoogle Scholar
  25. Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Xinhai Zhang, Jianbo Tao, Kaige Tan, Martin Torngren, Jose Manuel Gaspar Sanchez, Muhammad Rusyadi Ramli, Xin Tao, Magnus Gyllenhammar, Franz Wotawa, Naveen Mohan, Mihai Nica, and Hermann Felbinger. 2022. Finding Critical Scenarios for Automated Driving Systems: A Systematic Mapping Study. IEEE Transactions on Software Engineering (2022). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards realizing test conditions for automated vehicles

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            MODELS '22: Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings
            October 2022
            1003 pages
            ISBN:9781450394673
            DOI:10.1145/3550356
            • Conference Chairs:
            • Thomas Kühn,
            • Vasco Sousa

            Copyright © 2022 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 9 November 2022

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

            Acceptance Rates

            Overall Acceptance Rate118of382submissions,31%
          • Article Metrics

            • Downloads (Last 12 months)33
            • Downloads (Last 6 weeks)1

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader