Skip to main content

Experimental Conformance Evaluation onUBER ATG Safety Case Framework withANSI/UL 4600

  • Conference paper
  • First Online:
  • 1225 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12853))

Abstract

The safety of Self-Driving Vehicles (SDVs) is crucial for social acceptance of self-driving technology/vehicles, and how to assure such safety is of great concern for automakers and regulatory and standardization bodies. ANSI/UL 4600 (4600) [3], a standard for the safety of autonomous products, has an impact on the regulatory regime of self-driving technology/vehicles due to its detailed and well defined assurance requirements on what will be required for the safety of autonomous products. One of the major characteristics of the standard is wide-scale adoption of the safety case, which has been traditionally used for safety assurance of safety-critical systems such as railways and automobiles.

Uber ATG (now Aurora) then released its own safety case called the Safety Case Framework (SCF) [1] for their SDVs. A question arises as to how much the SCF would conform to 4600 even though the SFC does not claim its conformance with the standard. An answer to this question would result in what type of argumentation would be fit for purpose for safety assurance for SDVs and address issues with conformance assessment of a safety case with a standard.

In this paper we report on lessons we learned from an experimental analysis on the conformance ratios of the SCF with 4600 and structural analysis following the argument structure of the SCF.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Safety Case Framework (2020). https://uberatgresources.com/safetycase/gsn

  2. Safety Case Framework Blog. https://medium.com/@UberATG/trailblazing-a-safe-path-forward-e02f5f9ef0cc

  3. ANSI/UL 4600:2020. Standard for Evaluation of Autonomous Products (2020)

    Google Scholar 

  4. ISO 26262:2018 Road Vehicles - Functional Safety (2018)

    Google Scholar 

  5. SAE J3016: 2018, Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles, SAE International (2018)

    Google Scholar 

  6. ISO/PAS 21448: 2019, Road vehicles - Safety of the intended functionality (2019)

    Google Scholar 

  7. Kelly, T.: Arguing safety: a systematic approach to managing safety cases. D. Phil Thesis, U. York (1998)

    Google Scholar 

  8. ACWG: Goal Structuring Notation Community Standard (ver. 2) (2018)

    Google Scholar 

  9. Maus, A.: PEGASUS Safety Argument (2019). https://www.pegasusprojekt.de/files/tmpl/Symposium2019/3_3_PEGASUS%20safety%20argument_Maus.pdf

  10. Safety First for Automated Driving (2019)

    Google Scholar 

  11. Uber ATG Safety Report: https://uber.app.box.com/v/UberATGSafetyReport?uclick_id=3a2a8230-402c-404c-9eac-1e81a561b703

  12. Dardar, R.: Building a Safety Case in Compliance with ISO 26262 for Fuel Level Estimation and Display System, Master Thesis, Mälardalen University (2013)

    Google Scholar 

  13. Dardar, R., Gallina, B., Johnsen, A., Lundqvist, K., Nyberg, M.: Industrial experiences of building a safety case in compliance with ISO26262. In: 23rd IEEE International Symposium on Software Reliability Engineering Workshops. ISSRE Workshops 2012, pp. 349–354 (2012)

    Google Scholar 

  14. Gauerhof, L., Munk, P., Burton, S.: Structuring validation targets of a machine learning function applied to automated driving. In: Gallina, B., Skavhaug, A., Bitsch, F. (eds.) SAFECOMP 2018. LNCS, vol. 11093, pp. 45–58. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99130-6_4

    Chapter  Google Scholar 

  15. Graydon, P., Habli, I., Hawkins, R., Kelly, T., Knight, J.: Arguing conformance. IEEE Softw. 29(3), 50–57 (2012)

    Article  Google Scholar 

  16. DO-178B: Software Consideration in Airborne System and Equipment Certification, RTCA (1992)

    Google Scholar 

Download references

Acknowledgements

This work is supported by JST ERATO-MMSD and JST MIRAI-eAI projects (grant numbers: JPMJER1603 and JPMJMI20B8).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenji Taguchi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Taguchi, K., Ishikawa, F. (2021). Experimental Conformance Evaluation onUBER ATG Safety Case Framework withANSI/UL 4600. In: Habli, I., Sujan, M., Gerasimou, S., Schoitsch, E., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2021 Workshops. SAFECOMP 2021. Lecture Notes in Computer Science(), vol 12853. Springer, Cham. https://doi.org/10.1007/978-3-030-83906-2_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-83906-2_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-83905-5

  • Online ISBN: 978-3-030-83906-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics