Skip to main content
SpringerLink
Log in

Safety Case Maintenance: A Systematic Literature Review

  • Conference paper
  • First Online:
Computer Safety, Reliability, and Security (SAFECOMP 2021)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12852))

Included in the following conference series:

Abstract

Safety standards from different domains recommend the execution of a process for keeping the system safety case up to date, whenever the system undergoes a change, however, without providing any more specific guidelines on how to do this. Even if several (semi)automated safety case maintenance approaches have been proposed in the literature, currently, in the industry, the execution of this process is still manual, being error prone and expensive. To this end, we present in this paper the results of what is, to the best of our knowledge, the first Systematic Literature Review (SLR) conducted with the goal to provide a holistic overview of state-of-the-art safety case maintenance approaches. For each identified approach, we analyze its strengths and weaknesses. We observe that existing approaches are pessimistic, identifying a larger number of safety case elements as impacted by a change than the number of the actually impacted elements. Also, there is limited quantitative impact assessment. Further, existing approaches only address a few system change scenarios when providing guidelines for updating the safety case.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://betterembsw.blogspot.com/p/potentially-deadly-automotive-software.html.

  2. 2.

    https://insights.securecodewarrior.com/one-line-of-code-1-million/.

  3. 3.

    https://libertyvillepersonalinjurylawyer.com/software-fault-liability/.

References

  1. Agrawal, A., Khoshmanesh, S., Vierhauser, M., Rahimi, M., Cleland-Huang, J., Lutz, R.R.: Leveraging artifact trees to evolve and reuse safety cases. In: Proceedings of the 41st International Conference on Software Engineering, pp. 1222–1233. IEEE/ACM (2019)

    Google Scholar 

  2. Asaadi, E., Denney, E., Menzies, J., Pai, G.J., Petroff, D.: Dynamic assurance cases: a pathway to trusted autonomy. Computer 53(12), 35–46 (2020)

    Article  Google Scholar 

  3. Bagheri, H., Kang, E., Mansoor, N.: Synthesis of assurance cases for software certification. In: Proceedings of the 42nd International Conference on Software Engineering, New Ideas and Emerging Results, pp. 61–64. ACM (2020)

    Google Scholar 

  4. Betz, J., Heilmeier, A., Wischnewski, A., Stahl, T., Lienkamp, M.: Autonomous driving-a crash explained in detail. Appl. Sci. 9(23), 13–20 (2019)

    Article  Google Scholar 

  5. Björnander, S., Land, R., Graydon, P., Lundqvist, K., Conmy, P.: A method to formally evaluate safety case arguments against a system architecture model. In: Proceedings of the 2nd Edition of the Workshop on Software Certification. IEEE Computer Society (2012)

    Google Scholar 

  6. Bloomfield, R.E., Bishop, P.G.: Safety and assurance cases: past, present and possible future - an adelard perspective. In: Dale, C., Anderson, T. (eds.) Making Systems Safer - Proceedings of the 18th Safety-Critical Systems Symposium, pp. 51–67. Springer, London (2010). https://doi.org/10.1007/978-1-84996-086-1_4

    Chapter  Google Scholar 

  7. Calinescu, R., Weyns, D., Gerasimou, S., Iftikhar, M.U., Habli, I., Kelly, T.: Engineering trustworthy self-adaptive software with dynamic assurance cases. IEEE Trans. Softw. Eng. 44(11), 1039–1069 (2018)

    Article  Google Scholar 

  8. Cârlan, C., Nigam, V., Voss, S., Tsalidis, A.: Explicitcase: tool-support for creating and maintaining assurance arguments integrated with system models. In: Proceedings of the 38th International Symposium on Software Reliability Engineering Workshops, pp. 330–337. IEEE (2019)

    Google Scholar 

  9. Cârlan, C., Petrisor, D., Gallina, B., Schoenhaar, H.: Checkable safety cases: Enabling automated consistency checks between safety work products. In: Proceedings of the 31st International Symposium on Software Reliability Engineering - ISSRE Workshops, pp. 295–302. IEEE (2020)

    Google Scholar 

  10. Cheng, B.H.C., Clark, R.J., Fleck, J.E., Langford, M.A., McKinley, P.K.: AC-ROS: assurance case driven adaptation for the robot operating system. In: Proceedings of the 23rd International Conference on Model Driven Engineering Languages and Systems, pp. 102–113. ACM (2020)

    Google Scholar 

  11. Cimatti, A., DeLong, R., Marcantonio, D., Tonetta, S.: Combining MILS with contract-based design for safety and security requirements. In: Koornneef, F., van Gulijk, C. (eds.) Combining MILS with contract-based design for safety and security requirements. LNCS, vol. 9338, pp. 264–276. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24249-1_23

    Chapter  Google Scholar 

  12. Cruanes, S., Hamon, G., Owre, S., Shankar, N.: Tool integration with the evidential tool bus. In: Giacobazzi, R., Berdine, J., Mastroeni, I. (eds.) VMCAI 2013. LNCS, vol. 7737, pp. 275–294. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-35873-9_18

    Chapter  Google Scholar 

  13. de la Vara, J.L., Borg, M., Wnuk, K., Moonen, L.: An industrial survey of safety evidence change impact analysis practice. IEEE Trans. Software Eng. 42(12), 1095–1117 (2016)

    Article  Google Scholar 

  14. De La Vara, J.L., Parra, E., Ruiz, A., Gallina, B.: The AMASS tool platform: an innovative solution for assurance and certification of cyber-physical systems. In: CEUR Workshop Proceedings, vol. 2584. CEUR-WS (2020)

    Google Scholar 

  15. Denney, E., Pai, G.: Tool support for assurance case development. Autom. Softw. Eng. 25(3), 435–499 (2018)

    Article  Google Scholar 

  16. Denney, E., Pai, G.J., Habli, I.: Dynamic safety cases for through-life safety assurance. In: Proceedings of the 37th International Conference on Software Engineering, pp. 587–590. IEEE Computer Society (2015)

    Google Scholar 

  17. Felici, M.: Modeling safety case evolution – examples from the air traffic management domain. In: Guelfi, N., Savidis, A. (eds.) RISE 2005. LNCS, vol. 3943, pp. 81–96. Springer, Heidelberg (2006). https://doi.org/10.1007/11751113_7

    Chapter  Google Scholar 

  18. Fujita, H., Matsuno, Y., Hanawa, T., Sato, M., Kato, S., Ishikawa, Y.: DS-bench toolset: tools for dependability benchmarking with simulation and assurance. In: Proceedings of the 42nd International Conference on Dependable Systems and Networks, pp. 1–8. IEEE Computer Society (2012)

    Google Scholar 

  19. Gacek, A., Backes, J., Cofer, D.D., Slind, K., Whalen, M.: Resolute: an assurance case language for architecture models. Computing Research Repository (CoRR), abs/1409.4629 (2014)

    Google Scholar 

  20. Gallina, B.: AMASS Deliverable: design of the AMASS tools and methods for cross/intra-domain reuse. Technical report D6.3, AMASS Consortium (2018)

    Google Scholar 

  21. Govardhanrao, S.B.: A comparative analysis of argumentation languages in the context of safety case development. Master’s thesis, Mälardalen University, School of Innovation, Design and Engineering (2019)

    Google Scholar 

  22. Grüber, T.: AMASS Deliverable: Prototype for multi-concern assurance. Technical Report D4.6, AMASS Consortium (2018)

    Google Scholar 

  23. Hawkins, R., Habli, I., Kolovos, D., Paige, R., Kelly, T.: Weaving an assurance case from design: a model-based approach. In: Proceedings of the 16th International Symposium on High Assurance Systems Engineering, pp. 110–117. IEEE (2015)

    Google Scholar 

  24. Jaradat, O.T.S., Bate, I.: Using safety contracts to guide the maintenance of systems and safety cases. In: Proceedings of the 13th European Dependable Computing Conference, pp. 95–102. IEEE Computer Society (2017)

    Google Scholar 

  25. Kelly, T.P., McDermid, J.A.: A systematic approach to safety case maintenance. Reliab. Eng. Syst. Safety 71(3), 271–284 (2001)

    Article  Google Scholar 

  26. Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering (EBSE 2007-001) (2007)

    Google Scholar 

  27. Kokaly, S., Salay, R., Chechik, M., Lawford, M., Maibaum, T.: Safety case impact assessment in automotive software systems: an improved model-based approach. In: Tonetta, S., Schoitsch, E., Bitsch, F. (eds.) SAFECOMP 2017. LNCS, vol. 10488, pp. 69–85. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66266-4_5

    Chapter  Google Scholar 

  28. Lin, C.-L., Shen, W., Yue, T., Li, G.: Automatic support of the generation and maintenance of assurance cases. In: Feng, X., Müller-Olm, M., Yang, Z. (eds.) SETTA 2018. LNCS, vol. 10998, pp. 11–28. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99933-3_2

    Chapter  Google Scholar 

  29. Maksimov, M., Fung, N.L.S., Kokaly, S., Chechik, M.: Two decades of assurance case tools: a survey. In: Gallina, B., Skavhaug, A., Schoitsch, E., Bitsch, F. (eds.) SAFECOMP 2018. LNCS, vol. 11094, pp. 49–59. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-99229-7_6

    Chapter  Google Scholar 

  30. Matsuno, Y.: A design and implementation of an assurance case language. In: Proceedings of the 44th Annual International Conference on Dependable Systems and Networks, pp. 630–641. IEEE Computer Society (2014)

    Google Scholar 

  31. Matsuno, Y., Yamamoto, S.: A framework for dependability consensus building and in-operation assurance. J. Wirel. Mobile Netw. Ubiquit. Comput. Depend. Appl. 4(1), 118–134 (2013)

    Google Scholar 

  32. Mistry, M., Felici, M.: Implementation of change management in safety cases. Formal Aspects of Safety-Critical Systems (2008)

    Google Scholar 

  33. Nemouchi, Y., Foster, S., Gleirscher, M., Kelly, T.: Mechanised assurance cases with integrated formal methods in Isabelle. Computing Research Repository (CoRR), abs/1905.06192 (2019)

    Google Scholar 

  34. Nicholson, M., Conmy, P., Bate, I., McDermid, J.: Generating and maintaining a safety argument for integrated modular systems. In: Proceedings of the 5th Australian Workshop on Industrial Experience with Safety Critical Systems and Software, pp. 31–41 (2000)

    Google Scholar 

  35. Prokhorova, Y., Laibinis, L., Troubitsyna, E.: Facilitating construction of safety cases from formal models in Event-B. Inf. Soft. Technol. 60, 51–76 (2015)

    Article  Google Scholar 

  36. Retouniotis, A., Papadopoulos, Y., Sorokos, I., Parker, D., Matragkas, N., Sharvia, S.: Model-connected safety cases. In: Bozzano, M., Papadopoulos, Y. (eds.) IMBSA 2017. LNCS, vol. 10437, pp. 50–63. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-64119-5_4

    Chapter  Google Scholar 

  37. Sandro, A.D., Selim, G.M.K., Salay, R., Viger, T., Chechik, M., Kokaly, S.: MMINT-A 2.0: tool support for the lifecycle of model-based safety artifacts. In: Proceedings of the 23rd International Conference on Model Driven Engineering Languages and Systems, pp. 15:1–15:5. ACM (2020)

    Google Scholar 

  38. Sljivo, I., Gallina, B., Carlson, J., Hansson, H.: Using safety contracts to guide the integration of reusable safety elements within ISO 26262. In: Proceedings of the 21st Pacific Rim International Symposium on Dependable Computing - PRDC, pp. 129–138. IEEE Computer Society (2015)

    Google Scholar 

  39. I. Standard. 26262: Road vehicles - functional safety. ISO (2018)

    Google Scholar 

  40. Törner, F., Öhman, P.: Automotive safety case a qualitative case study of drivers, usages, and issues. In: Proceedings of the 11th High Assurance Systems Engineering Symposium, pp. 313–322. IEEE Computer Society (2008)

    Google Scholar 

  41. UNDERWRITERS LABORATORIES INC.: ANSI/UL-4600 Standard for Evaluation of Autonomous Products (2020)

    Google Scholar 

  42. Vierhauser, M., et al.: Interlocking safety cases for unmanned autonomous systems in shared airspaces. Trans. Softw. Eng. 47, 899–918 (2019)

    Article  Google Scholar 

  43. Wardziński, A., Jones, P.: Uniform model interface for assurance case integration with system models. In: Tonetta, S., Schoitsch, E., Bitsch, F. (eds.) SAFECOMP 2017. LNCS, vol. 10489, pp. 39–51. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66284-8_4

    Chapter  Google Scholar 

  44. Wohlin, C.: Guidelines for snowballing in systematic literature studies and a replication in software engineering. In: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, pp. 1–10. ACM (2014)

    Google Scholar 

  45. Zhang, H., Babar, M.A., Tell, P.: Identifying relevant studies in software engineering. Inf. Softw. Technol. 53(6), 625–637 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. fortiss GmbH, Munich, Germany

    Carmen Cârlan & Liana Soima

  2. Mälardalen University, Västeras, Sweden

    Barbara Gallina

Authors
  1. Carmen Cârlan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Barbara Gallina
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Liana Soima
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carmen Cârlan .

Editor information

Editors and Affiliations

  1. University of York, York, UK

    Ibrahim Habli

  2. Human Factors Everywhere Ltd., Woking, UK

    Mark Sujan

  3. Thales Deutschland GmbH, Ditzingen, Germany

    Friedemann Bitsch

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cârlan, C., Gallina, B., Soima, L. (2021). Safety Case Maintenance: A Systematic Literature Review. In: Habli, I., Sujan, M., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2021. Lecture Notes in Computer Science(), vol 12852. Springer, Cham. https://doi.org/10.1007/978-3-030-83903-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-83903-1_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-83902-4

  • Online ISBN: 978-3-030-83903-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation