Skip to main content

Machine Learning-Based Fault Injection for Hazard Analysis and Risk Assessment

  • Conference paper
  • First Online:
Computer Safety, Reliability, and Security (SAFECOMP 2021)

Abstract

Current automotive standards such as ISO 26262 require Hazard Analysis and Risk Assessment (HARA) on possible hazards and consequences of safety-critical components. This work attempts to ease this labour-intensive process by using machine learning-based fault injection to discover representative hazardous situations. Using a Simulation-Aided Hazard Analysis and Risk Assessment (SAHARA) methodology, a visualisation and suggested hazard classification is then presented for the safety engineer. We demonstrate this SAHARA methodology using machine learning-based fault injection on a safety-critical use case of an adaptive cruise control system, to show that our approach can discover, visualise, and classify hazardous situations in a (semi-)automated manner in around twenty minutes.

This work was partly funded by Flanders Make vzw, the strategic research centre for the Flemish manufacturing industry; and by the aSET project (grant no. HBC.2017.0389) of the Flanders Innovation and Entrepreneurship agency (VLAIO).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Other approaches such as [13, 14] refer to a SAHARA approach. This paper uses SAHARA solely to refer to the methodology of [21].

  2. 2.

    The model is an adapted version of https://www.mathworks.com/help/mpc/ug/adaptive-cruise-control-using-model-predictive-controller.html.

  3. 3.

    Friction values sourced from Fig. 24 of Singh and Taheri [28].

  4. 4.

    https://github.com/nickovic/rtamt.

  5. 5.

    https://www.youtube.com/playlist?list=PLNyNvnuIvPKvsmUT1I-hwEYDMyZ7YGZkA.

References

  1. Althoff, M., Lutz, S.: Automatic generation of safety-critical test scenarios for collision avoidance of road vehicles. In: 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 1326–1333. IEEE (2018)

    Google Scholar 

  2. Bae, I., Moon, J., Seo, J.: Toward a comfortable driving experience for a self-driving shuttle bus. Electronics 8(9), 943 (2019)

    Article  Google Scholar 

  3. Benso, A., Prinetto, P.: Fault Injection Techniques and Tools for Embedded Systems Reliability Evaluation, vol. 23. Springer, Boston (2003). https://doi.org/10.1007/b105828

    Book  MATH  Google Scholar 

  4. Bernaerts, M., Oakes, B., Vanherpen, K., Aelvoet, B., Vangheluwe, H., Denil, J.: Validating industrial requirements with a contract-based approach. In: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), pp. 18–27. IEEE (2019)

    Google Scholar 

  5. Coley, G., Wesley, A., Reed, N., Parry, I.: Driver reaction times to familiar, but unexpected events. TRL published project report (2009)

    Google Scholar 

  6. Coppola, R., Morisio, M.: Connected car: technologies, issues, future trends. ACM Comput. Surv. 49(3), 1–36 (2016)

    Article  Google Scholar 

  7. Denil, J., Mosterman, P.J., Vangheluwe, H.: Rule-based model transformation for, and in Simulink. In: Proceedings of the Symposium on Theory of Modeling & Simulation-DEVS Integrative, pp. 1–8 (2014)

    Google Scholar 

  8. Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: CARLA: an open urban driving simulator. In: Proceedings of the 1st Annual Conference on Robot Learning, pp. 1–16 (2017)

    Google Scholar 

  9. Duracz, A., et al.: Advanced hazard analysis and risk assessment in the ISO 26262 functional safety standard using rigorous simulation. In: Chamberlain, R., Edin Grimheden, M., Taha, W. (eds.) CyPhy/WESE -2019. LNCS, vol. 11971, pp. 108–126. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-41131-2_6

    Chapter  Google Scholar 

  10. Hauer, F., Pretschner, A., Holzmüller, B.: Fitness functions for testing automated and autonomous driving systems. In: Romanovsky, A., Troubitsyna, E., Bitsch, F. (eds.) SAFECOMP 2019. LNCS, vol. 11698, pp. 69–84. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-26601-1_5

    Chapter  Google Scholar 

  11. International Organization for Standardization: ISO 26262: Road vehicles-functional safety (2011)

    Google Scholar 

  12. Juez, G., Amparan, E., Lattarulo, R., Rastelli, J.P., Ruiz, A., Espinoza, H.: Safety assessment of automated vehicle functions by simulation-based fault injection. In: 2017 IEEE International Conference on Vehicular Electronics and Safety (ICVES), pp. 214–219. IEEE (2017)

    Google Scholar 

  13. Kemmann, S.: SAHARA-a structured approach for hazard analysis and risk assessments. Ph.D. thesis, Fraunhofer-Institut für Experimentelles Software Engineering (2015)

    Google Scholar 

  14. Macher, G., Sporer, H., Berlach, R., Armengaud, E., Kreiner, C.: SAHARA: a security-aware hazard and risk analysis method. In: 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE), pp. 621–624. IEEE (2015)

    Google Scholar 

  15. Maler, O., Nickovic, D.: Monitoring temporal properties of continuous signals. In: Lakhnech, Y., Yovine, S. (eds.) FORMATS/FTRTFT -2004. LNCS, vol. 3253, pp. 152–166. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30206-3_12

    Chapter  MATH  Google Scholar 

  16. Meyers, B., Gadeyne, K., Oakes, B.J., Bernaerts, M., Vangheluwe, H., Denil, J.: A model-driven engineering framework to support the functional safety process. In: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), pp. 619–623, September 2019

    Google Scholar 

  17. Moradi, M., Oakes, B., Denil, J.: Machine learning-assisted fault injection. In: 39th International Conference on Computer Safety, Reliability and Security (SAFECOMP), Position Paper, Lisbon, Portugal (2020)

    Google Scholar 

  18. Moradi, M., Oakes, B.J., Saraoglu, M., Morozov, A., Janschek, K., Denil, J.: Exploring fault parameter space using reinforcement learning-based fault injection. In: 2020 50th Annual IEEE/IFIP International Conference on Dependable Systems and Networks Workshops (DSN-W), pp. 102–109. IEEE (2020)

    Google Scholar 

  19. Moradi, M., Van Acker, B., Vanherpen, K., Denil, J.: Model-implemented hybrid fault injection for Simulink (tool demonstrations). In: Chamberlain, R., Taha, W., Törngren, M. (eds.) CyPhy/WESE -2018. LNCS, vol. 11615, pp. 71–90. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23703-5_4

    Chapter  Google Scholar 

  20. Polydoros, A.S., Nalpantidis, L.: Survey of model-based reinforcement learning: applications on robotics. J. Intell. Robot. Syst. 86(2), 153–173 (2017). https://doi.org/10.1007/s10846-017-0468-y

    Article  Google Scholar 

  21. Rafael, A.B.J., Bachir, Z.: SAHARA: Simulation aided hazard analysis and risk assessment methodology. In: Risk Analysis XII, vol. 129, p. 41 (2020)

    Google Scholar 

  22. Riedmaier, S., Ponn, T., Ludwig, D., Schick, B., Diermeyer, F.: Survey on scenario-based safety assessment of automated vehicles. IEEE Access 8, 87456–87477 (2020)

    Article  Google Scholar 

  23. Salvucci, D.D.: Modeling driver behavior in a cognitive architecture. Hum. Factors 48(2), 362–380 (2006)

    Article  Google Scholar 

  24. Saraoglu, M., Morozov, A., Janschek, K.: MOBATSim: Model-based autonomous traffic simulation framework for fault-error-failure chain analysis. IFAC-PapersOnLine 52(8), 239–244 (2019)

    Article  Google Scholar 

  25. Saraoğlu, M., Morozov, A., Söylemez, M.T., Janschek, K.: ErrorSim: a tool for error propagation analysis of Simulink models. In: Tonetta, S., Schoitsch, E., Bitsch, F. (eds.) SAFECOMP 2017. LNCS, vol. 10488, pp. 245–254. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66266-4_16

    Chapter  Google Scholar 

  26. Saraoğlu, M., Shi, Q., Morozov, A., Janschek, K.: Virtual validation of autonomous vehicle safety through simulation-based testing. In: 20. Internationales Stuttgarter Symposium. P, pp. 419–434. Springer, Wiesbaden (2020). https://doi.org/10.1007/978-3-658-29943-9_33

    Chapter  Google Scholar 

  27. Shanahan, D.F.: Human tolerance and crash survivability. In: Pathological Aspects and Associate Biodynamics in Aircraft Accident Investigation (2004)

    Google Scholar 

  28. Singh, K.B., Taheri, S.: Estimation of tire-road friction coefficient and its application in chassis control systems. Syst. Sci. Control Eng. 3(1), 39–61 (2015)

    Article  Google Scholar 

  29. Tuncali, C.E., Fainekos, G., Prokhorov, D., Ito, H., Kapinski, J.: Requirements-driven test generation for autonomous vehicles with machine learning components. IEEE Trans. Intell. Veh. 5(2), 265–280 (2019)

    Article  Google Scholar 

  30. Zapridou, E., Bartocci, E., Katsaros, P.: Runtime verification of autonomous driving systems in CARLA. In: Deshmukh, J., Ničković, D. (eds.) RV 2020. LNCS, vol. 12399, pp. 172–183. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60508-7_9

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mehrdad Moradi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Oakes, B.J., Moradi, M., Van Mierlo, S., Vangheluwe, H., Denil, J. (2021). Machine Learning-Based Fault Injection for Hazard Analysis and Risk Assessment. In: Habli, I., Sujan, M., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2021. Lecture Notes in Computer Science(), vol 12852. Springer, Cham. https://doi.org/10.1007/978-3-030-83903-1_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-83903-1_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-83902-4

  • Online ISBN: 978-3-030-83903-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics