Skip to main content
SpringerLink
Log in

Automating Recoverability Proofs for Cyber-Physical Systems with Runtime Assurance Architectures

  • Conference paper
  • First Online:
Theoretical Aspects of Software Engineering (TASE 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13931))

Included in the following conference series:

Abstract

Cyber-physical systems (CPSes), such as autonomous vehicles, use sophisticated components like ML-based controllers. It is difficult to provide evidence about the safe functioning of such components. To overcome this problem, Runtime Assurance Architecture (RTA) solutions have been proposed. The RTA ’s decision component evaluates the system’s safety risk and whenever the risk is higher than acceptable the RTA switches to a safety mode that, for example, activates a controller with strong evidence for its safe functioning. In this way, RTAs increase CPS runtime safety and resilience by recovering the system from higher to lower risk levels. The goal of this paper is to automate recovery proofs of CPSes using RTAs. We first formalize the key verification problems, namely, the decision sampling-time adequacy problem and the time-bounded recoverability problem. We then demonstrate how to automatically generate proofs for the proposed verification problems using symbolic rewriting modulo SMT. Automation is enabled by integrating the rewriting logic tool (Maude), which generates sets of non-linear constraints, with an SMT-solver (Z3) to produce proofs

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apollo. An Open Autonomous Driving Platform. https://github.com/ApolloAuto/apollo

  2. I. 21448:2019 (2021). https://www.iso.org/standard/70939.html.

  3. Allenby, B., Fink, J.: Toward inherently secure and resilient societies. Science 309(5737), 1034–1036 (2005)

    Article  Google Scholar 

  4. Alturki, M.A., Kirigin, T.B., Kanovich, M.I., Nigam, V., Scedrov, A., Talcott, C.L.: On the formalization and computational complexity of resilience problems for cyber-physical systems. In Seidl, H., Liu, Z., Pasareanu, C.S., (eds.) Theoretical Aspects of Computing - ICTAC 2022–19th International Colloquium, Tbilisi, Georgia, 27–29 September 2022, Proceedings, vol. 13572. LNCS, pp 96–113. Springer (2022). https://doi.org/10.1007/978-3-031-17715-6_8

  5. Barker, K., Ramirez-Marquez, J.E., Rocco, C.M.: Resilience-based network component importance measures. Reliability Eng. Syst. Safety 117, 89–97 (2013)

    Article  Google Scholar 

  6. Bloomfield, R., et al.: Towards identifying and closing gaps in assurance of autonomous road vehicles-a collection of technical notes part 1. arXiv preprint arXiv:2003.00789 (2020)

  7. Bohrer, B., Tan, Y.K., Mitsch, S., Myreen, M.O., Platzer, A.: VeriPhy: Verified controller executables from verified cyber-physical system models. In: Proceedings of 39th ACM SIGPLAN Conference on Programming Language Design and Implementation. ACM New York (2018)

    Google Scholar 

  8. Bohrer, B., Tan, Y.K., Mitsch, S., Sogokon, A., Platzer, A.: A formal safety net for waypoint following in ground robots. IEEE Robot. Autom. Lett. (2019). arxiv:1903.15073

  9. Bozga, M., Sifakis, J.: Specification and validation of autonomous driving systems: A multilevel semantic framework. CoRR, abs/ arXiv: 1210.90647 (2021)

  10. M. Clavel., et al.: All About Maude: A High-Performance Logical Framework, vol. 4350. LNCS. Springer (2007). https://doi.org/10.1007/978-3-540-71999-1

  11. Damare, A., Roy, S., Smolka, S.A., Stoller, S.D.: A barrier certificate-based simplex architecture with application to microgrids. In: Dang, T., Stolz, V., (eds.), Runtime Verification - 22nd International Conference, RV 2022, Tbilisi, Georgia, 28–30 September 2022, Proceedings, vol. 13498. LNCS, pp. 105–123. Springer (2022). https://doi.org/10.1007/978-3-031-17196-3_6

  12. de Moura, L., Bjørner, N.: Z3: an efficient SMT solver. In: Ramakrishnan, C.R., Rehof, J. (eds.) TACAS 2008. LNCS, vol. 4963, pp. 337–340. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78800-3_24

    Chapter  Google Scholar 

  13. Desai, A., Ghosh, S., Seshia, S.A., Shankar, N., Tiwari, A.: SOTER: A runtime assurance framework for programming safe robotics systems. In: 49th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2019, Portland, OR, USA, 24–27 June 2019, pp. 138–150. IEEE (2019)

    Google Scholar 

  14. Fremont, D.J., Dreossi, T., Ghosh, S., Yue, X., Sangiovanni-Vincentelli, A.L., Seshia, S. A.: Scenic: a language for scenario specification and scene generation. In McKinley, K.S., Fisher, K., (eds.) Proceedings of the 40th ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI 2019, Phoenix, AZ, USA, 22–26 June 2019, pp. 63–78. ACM (2019)

    Google Scholar 

  15. Fremont, D.J:. Formal scenario-based testing of autonomous vehicles: From simulation to the real world. In: 23rd IEEE International Conference on Intelligent Transportation Systems, ITSC 2020, Rhodes, Greece, 20–23 September 2020, pp 1–8. IEEE (2020)

    Google Scholar 

  16. Jha, S., Rushby, J., Shankar, N.: Model-centered assurance for autonomous systems. In: Casimiro, A., Ortmeier, F., Bitsch, F., Ferreira, P. (eds.) SAFECOMP 2020. LNCS, vol. 12234, pp. 228–243. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-54549-9_15

    Chapter  Google Scholar 

  17. Laprie, J.-C.: From dependability to resilience. In 38th IEEE/IFIP International Conference on dependable systems and networks, pp G8–G9. Citeseer (2008)

    Google Scholar 

  18. Luca Mengani, P.D.: Hazard analysis and risk assessment and functional safety concept. Technical report, D2.11 of H2020 project ENSEMBLE (2019). www.platooningensemble.eu

  19. Mehmood, U., Sheikhi, S., Bak, S., Smolka, S.A., Stoller, S.D.: The black-box simplex architecture for runtime assurance of autonomous CPS. In: Deshmukh, J.V., Havelund, K., Perez, I., (eds.) NASA Formal Methods - 14th International Symposium, NFM 2022, Pasadena, CA, USA, 24–27 May 2022, Proceedings, vol. 13260. LNCS, pp. 231–250. Springer (2022). https://doi.org/10.1007/978-3-031-06773-0_12

  20. Menzel, T., Bagschik, G., Maurer, M.: Scenarios for development, test and validation of automated vehicles. In: 2018 IEEE Intelligent Vehicles Symposium, IV 2018, Changshu, Suzhou, China, 26–30 June 2018, pp. 1821–1827. IEEE (2018)

    Google Scholar 

  21. Nigam, V., Talcott, C.: Automating safety proofs about cyber-physical systems using rewriting modulo smt. In: Bae, K., (ed.), 14th International Workshop on Rewriting Logic and its Applications, vol. 13252. LNCS, pp. 212–229. Springer (2022). https://doi.org/10.1007/978-3-031-12441-9_11

  22. Nigam, V., Talcott, C.: Technical-report: Automating recoverability proofs for cyber-physical systems with runtime assurance architectures (2023)

    Google Scholar 

  23. Quesel, J.-D., Mitsch, S., Loos, S., Aréchiga, N., Platzer, A.: How to model and prove hybrid systems with KeYmaera: a tutorial on safety. Int. J. Softw. Tools Technol. Trans. 18, 67–91 (2016)

    Article  Google Scholar 

  24. Ramakrishna, S., Hartsell, C., Burruss, M.P., Karsai, G., Dubey, A.: Dynamic-weighted simplex strategy for learning enabled cyber physical systems. J. Syst. Archit. 111, 101760 (2020)

    Article  Google Scholar 

  25. Riedmaier, S., Ponn, T., Ludwig, D., Schick, B., Diermeyer, F.: Survey on scenario-based safety assessment of automated vehicles. IEEE Access 8, 87456–87477 (2020)

    Article  Google Scholar 

  26. Rocha, C., Meseguer, J., Muñoz, C.: Rewriting modulo SMT and open system analysis. J. Logical Algebraic Meth. Program., 269–297 (2017)

    Google Scholar 

  27. Ross, R., Pillitteri, V., Graubart, R., Bodeau, D., McQuaid, R.: Developing cyber resilient systems: a systems security engineering approach. Technical report, National Institute of Standards and Technology (2019)

    Google Scholar 

  28. Rubio, R.: Maude as a library: An efficient all-purpose programming interface. In: Bae, K. (ed.), Rewriting Logic and Its Applications - 14th International Workshop, vol. 13252. LNCS, pp. 274–294. Springer (2022). https://doi.org/10.1007/978-3-031-12441-9_14

  29. Seto, D., Krogh, B., Sha, L., Chutinan, A.: The simplex architecture for safe online control system upgrades. In: Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207), vol. 6, pp. 3504–3508 (1998)

    Google Scholar 

  30. Sha, L.: Using simplicity to control complexity. IEEE Softw. 18(4), 20–28 (2001)

    Article  Google Scholar 

  31. Shalev-Shwartz, S., Shammah, S., Shashua, A.: On a formal model of safe and scalable self-driving cars. CoRR, abs/ arXiv: 1708.06374 (2017)

  32. Talcott, C., Nigam, V., Arbab, F., Kappé, T.: Formal specification and analysis of robust adaptive distributed cyber-physical systems. In: Bernardo, M., De Nicola, R., Hillston, J. (eds.) SFM 2016. LNCS, vol. 9700, pp. 1–35. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-34096-8_1

    Chapter  Google Scholar 

  33. TKX team, KeYmaera X: An aXiomatic tactical theorem prover for hybrid systems (2022). (Accessed 22 Sept 2022)

    Google Scholar 

  34. Westhofen, L., et al.: Criticality metrics for automated driving: A review and suitability analysis of the state of the art. Archives of Computational Methods in Engineering, abs/ arXiv: 2108.02403 (2022)

Download references

Acknowledgments

Talcott was partially supported by the U. S. Office of Naval Research under award numbers N00014-15-1-2202 and N00014-20-1-2644, and NRL grant N0017317-1-G002. We also thank the anonymous reviewers for their comments.

Author information

Authors and Affiliations

  1. SRI International, Menlo Park, USA

    Carolyn Talcott

  2. Federal University of Paraíba, João Pessoa, Brazil

    Vivek Nigam

  3. Huawei Munich Research Center, Munich, Germany

    Vivek Nigam

Authors
  1. Vivek Nigam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carolyn Talcott
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vivek Nigam .

Editor information

Editors and Affiliations

  1. University of Bristol, Bristol, UK

    Cristina David

  2. Peking University, Beijing, China

    Meng Sun

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nigam, V., Talcott, C. (2023). Automating Recoverability Proofs for Cyber-Physical Systems with Runtime Assurance Architectures. In: David, C., Sun, M. (eds) Theoretical Aspects of Software Engineering. TASE 2023. Lecture Notes in Computer Science, vol 13931. Springer, Cham. https://doi.org/10.1007/978-3-031-35257-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35257-7_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35256-0

  • Online ISBN: 978-3-031-35257-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation