Skip to main content

A Framework to Handle Uncertainties of Machine Learning Models in Compliance with ISO 26262

  • Conference paper
  • First Online:
Advances in Computational Intelligence Systems (UKCI 2021)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1409))

Included in the following conference series:

  • 852 Accesses

Abstract

Assuring safety and thereby certifying is a key challenge of many kinds of Machine Learning (ML) Models. ML is one of the most widely used technological solutions to automate complex tasks such as autonomous driving, traffic sign recognition, lane keep assist etc. The application of ML is making a significant contributions in the automotive industry, it introduces concerns related to the safety and security of these systems. ML models should be robust and reliable throughout and prove their trustworthiness in all use cases associated with vehicle operation. Proving confidence in the safety and security of ML-based systems and there by giving assurance to regulators, the certification authorities, and other stakeholders is an important task. This paper proposes a framework to handle uncertainties of ML model to improve the safety level and thereby certify the ML Models in the automotive industry.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Waymo, L.L.C.: Waymo safety report, pp. 1–48 (2020)

    Google Scholar 

  2. Bojarski, D.M., et al.: End to end learning for self-driving cars, arXiv preprintarXiv:1604.07316 (2016)

  3. I.O.: For Standardization. International organization for standardization, ISO 26262 road vehicles functional safety (2011)

    Google Scholar 

  4. Rao, Q., Frtunikj, J.: Deep learning for self-driving cars: chances and challenges. In: Proceedings of the 1st International Workshop on Software Engineering for AI in Autonomous Systems, pp. 35–38 (2018)

    Google Scholar 

  5. Salay, R., Queiroz, R., Czarnecki, K.: An analysis of ISO 26262: using machine learning safely in automotive software. arXiv preprintarXiv:1709.02435, pp. 1–6 (2017)

  6. Mohseni, S., Pitale, M., Singh, V., Wang, Z.: Practical solutions for machine learning safety in autonomous vehicles. arXiv preprintarXiv:1912.09630 (2019)

  7. LeCun, Y., Bengio, Y., et al.: Convolutional networks for images, speech, and time series. Handb. Brain Theor. Neural Networks 3361(10), 1995 (1995)

    Google Scholar 

  8. Salay, R., Czarnecki, K.: Using machine learning safely in automotive software: an assessment and adaption of software process requirements in ISO 26262. arXiv preprintarXiv:1808.01614 (2018)

  9. Dempster, A.P.: Upper and lower probabilities induced by a multivalued mapping. In: Yager, R.R., Liu, L. (eds.) Studies in Fuzziness and Soft Computing. Springer, Berlin, Heidelberg (2008). https://doi.org/10.1007/978-3-540-44792-4_3

    Chapter  Google Scholar 

  10. Sensoy, M., Kaplan, L., Kandemir, M.: Evidential deep learning to quantify classification uncertainty (2018)

    Google Scholar 

  11. Mohseni, S., Zarei, N., Ragan, E.D.: A multidisciplinary survey and framework for design and evaluation of explainable AI systems. arXiv preprintarXiv:1811.11839 (2018)

  12. Hendrycks, D., Dietterich, T.: Benchmarking neural network robustness to common corruptions and perturbations (2019)

    Google Scholar 

  13. Shafique, M., Naseer, M., Theocharides, T., Kyrkou, C., Mutlu, O., Orosa, L., Choi, J.: Robust machine learning systems: challenges, current trends, perspectives, and the road ahead. IEEE Des. Test 37(2), 30–57 (2020)

    Article  Google Scholar 

  14. Der Kiureghian, A., Ditlevsen, O.: Aleatory or epistemic? does it matter? Struct. Saf. 31(2), 105–112 (2009)

    Article  Google Scholar 

  15. Amini, A., Schwarting, W., Soleimany, A., Rus, D.: Deep evidential regression (2020)

    Google Scholar 

  16. D.F.: Transport, Safe use of automated lane keeping system on GB motorways: call for evidence, April 2021. https://www.gov.uk/government/consultations/safe-use-of-automated-lane-keeping-system-on-gb-motorways-call-for-evidence

  17. Willers, O., Sudholt, S., Raafatnia, S., Abrecht, S.: Safety concerns and mitigation approaches regarding the use of deep learning in safety-critical perception tasks. In: Casimiro, A., Ortmeier, F., Schoitsch, E., Bitsch, F., Ferreira, P. (eds.) Computer Safety, Reliability, and Security. SAFECOMP 2020 Workshops, SAFECOMP 2020. LNCS, vol. 12235, pp. 336–350. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-55583-2_25

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vinod Vasudevan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vasudevan, V., Abdullatif, A., Kabir, S., Campean, F. (2022). A Framework to Handle Uncertainties of Machine Learning Models in Compliance with ISO 26262. In: Jansen, T., Jensen, R., Mac Parthaláin, N., Lin, CM. (eds) Advances in Computational Intelligence Systems. UKCI 2021. Advances in Intelligent Systems and Computing, vol 1409. Springer, Cham. https://doi.org/10.1007/978-3-030-87094-2_45

Download citation

Publish with us

Policies and ethics