Skip to main content
SpringerLink
Log in
Book cover

International Conference on Software Engineering and Formal Methods

SEFM 2019: Software Engineering and Formal Methods pp 183–202Cite as

Multi-objective Search for Effective Testing of Cyber-Physical Systems

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11724))

Abstract

We propose a multi-objective strategy for finding effective inputs for fault detection in Cyber Physical Systems (CPSs). The main goal is to provide input signals for a system in such a way that they maximise the distance between the system’s output and an ideal target, thus leading the system towards a fault; this is based on Genetic Algorithm and Simulated Annealing heuristics. Additionally, we take into consideration the discrete locations (of hybrid system models) and a notion of input diversity to increase coverage. We implement our strategy and present an empirical analysis to estimate its effectiveness.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Abbas, H., Hoxha, B., Fainekos, G.E., Deshmukh, J.V., Kapinski, J., Ueda, K.: Conformance testing as falsification for cyber-physical systems. In: Proceedings of the ACM/IEEE 5th International Conference on Cyber-Physical Systems (ICCPS 2014), p. 211. IEEE (2014)

    Google Scholar 

  2. Abbas, H.Y.: Test-based falsification and conformance testing for cyber-physical systems. Ph.D. thesis, Arizona State University (2015)

    Google Scholar 

  3. Adimoolam, A., Dang, T., Donzé, A., Kapinski, J., Jin, X.: Classification and coverage-based falsification for embedded control systems. In: Majumdar, R., Kunčak, V. (eds.) CAV 2017. LNCS, vol. 10426, pp. 483–503. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-63387-9_24

    Chapter  Google Scholar 

  4. Aerts, A.: Model-based design and testing of mechatronic systems: an industrial case study. Master’s thesis, Eindhoven University of Technology, Eindhoven, Netherlands (2016)

    Google Scholar 

  5. Agrawal, A., Simon, G., Karsai, G.: Semantic translation of simulink/stateflow models to hybrid automata using graph transformations. Electron. Notes Theoret. Comput. Sci. 109, 43–56 (2004)

    Article  Google Scholar 

  6. Alur, R.: Principles of Cyber-Physical Systems. MIT Press, Cambridge (2015)

    Google Scholar 

  7. Alur, R., et al.: The algorithmic analysis of hybrid systems. Theor. Comput. Sci. 138(1), 3–34 (1995)

    Article  MathSciNet  Google Scholar 

  8. Alur, R., Courcoubetis, C., Henzinger, T.A., Ho, P.-H.: Hybrid automata: an algorithmic approach to the specification and verification of hybrid systems. In: Grossman, R.L., Nerode, A., Ravn, A.P., Rischel, H. (eds.) HS 1991-1992. LNCS, vol. 736, pp. 209–229. Springer, Heidelberg (1993). https://doi.org/10.1007/3-540-57318-6_30

    Chapter  Google Scholar 

  9. Ammann, P., Offutt, J.: Introduction to Software Testing. Cambridge University Press, Cambridge (2016)

    Book  Google Scholar 

  10. Annpureddy, Y., Liu, C., Fainekos, G., Sankaranarayanan, S.: S-TaLiRo: a tool for temporal logic falsification for hybrid systems. In: Abdulla, P.A., Leino, K.R.M. (eds.) TACAS 2011. LNCS, vol. 6605, pp. 254–257. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19835-9_21

    Chapter  MATH  Google Scholar 

  11. Binh, N.T., et al.: Mutation operators for simulink models. In: 2012 Fourth International Conference on Knowledge and Systems Engineering (KSE), pp. 54–59. IEEE (2012)

    Google Scholar 

  12. Carvalho, G., Barros, F., Carvalho, A., Cavalcanti, A., Mota, A., Sampaio, A.: NAT2TEST tool: from natural language requirements to test cases based on CSP. In: Calinescu, R., Rumpe, B. (eds.) SEFM 2015. LNCS, vol. 9276, pp. 283–290. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22969-0_20

    Chapter  Google Scholar 

  13. Chen, X., Ábrahám, E., Sankaranarayanan, S.: Flow*: an analyzer for non-linear hybrid systems. In: Sharygina, N., Veith, H. (eds.) CAV 2013. LNCS, vol. 8044, pp. 258–263. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39799-8_18

    Chapter  Google Scholar 

  14. Dang, T., Nahhal, T.: Coverage-guided test generation for continuous and hybrid systems. Formal Methods Syst. Des. 34(2), 183–213 (2009)

    Article  Google Scholar 

  15. De Schutter, B., Heemels, W., Lunze, J., Prieur, C., et al.: Survey of modeling, analysis, and control of hybrid systems. In: Handbook of Hybrid Systems Control-Theory, Tools, Applications, pp. 31–55 (2009)

    Google Scholar 

  16. Donzé, A.: Breach, a toolbox for verification and parameter synthesis of hybrid systems. In: Touili, T., Cook, B., Jackson, P. (eds.) CAV 2010. LNCS, vol. 6174, pp. 167–170. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14295-6_17

    Chapter  Google Scholar 

  17. Dorigo, M., Birattari, M.: Ant Colony Optimization. Springer, Heidelberg (2010)

    Google Scholar 

  18. Frehse, G., et al.: SpaceEx: scalable verification of hybrid systems. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 379–395. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22110-1_30

    Chapter  Google Scholar 

  19. Gelfand, S.B., Mitter, S.K.: Analysis of simulated annealing for optimization. In: 1985 24th IEEE Conference on Decision and Control, vol. 24, pp. 779–786. IEEE (1985)

    Google Scholar 

  20. Goebel, R., Sanfelice, R.G., Teel, A.R.: Hybrid dynamical systems. IEEE Control Syst. 29(2), 28–93 (2009)

    Article  MathSciNet  Google Scholar 

  21. Heemels, W., De Schutter, B.: Modeling and control of hybrid dynamical systems. TU Eindhoven, Lecture notes course 4K160 (2013)

    Google Scholar 

  22. Horgan, J.R., London, S., Lyu, M.R.: Achieving software quality with testing coverage measures. Computer 27(9), 60–69 (1994)

    Article  Google Scholar 

  23. Khakpour, N., Mousavi, M.R.: Notions of conformance testing for cyber-physical systems: overview and roadmap (invited paper). In: Aceto, L., de Frutos Escrig, D. (eds.) 26th International Conference on Concurrency Theory (CONCUR 2015). Leibniz International Proceedings in Informatics (LIPIcs), vol. 42, pp. 18–40. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany (2015)

    Google Scholar 

  24. Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by simulated annealing. Science 220(4598), 671–680 (1983)

    Article  MathSciNet  Google Scholar 

  25. Konak, A., Coit, D.W., Smith, A.E.: Multi-objective optimization using genetic algorithms: a tutorial. Reliab. Eng. Syst. Saf. 91(9), 992–1007 (2006)

    Article  Google Scholar 

  26. Malaiya, Y.K., Li, M.N., Bieman, J.M., Karcich, R., Skibbe, B., et al.: The relationship between test coverage and reliability. In: Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering, pp. 186–195. IEEE (1994)

    Google Scholar 

  27. Matinnejad, R., Nejati, S., Briand, L., Bruckmann, T.: Test generation and test prioritization for simulink models with dynamic behavior. IEEE Trans. Softw. Eng. (2018)

    Google Scholar 

  28. Matinnejad, R., Nejati, S., Briand, L.C., Bruckmann, T.: Effective test suites for mixed discrete-continuous stateflow controllers. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, pp. 84–95. ACM (2015)

    Google Scholar 

  29. Matinnejad, R., Nejati, S., Briand, L.C., Bruckmann, T.: Automated test suite generation for time-continuous simulink models. In: proceedings of the 38th International Conference on Software Engineering, pp. 595–606. ACM (2016)

    Google Scholar 

  30. Mitchell, M.: An Introduction to Genetic Algorithms. MIT Press, Cambridge (1998)

    MATH  Google Scholar 

  31. Mockus, A., Nagappan, N., Dinh-Trong, T.T.: Test coverage and post-verification defects: a multiple case study. In: 2009 3rd International Symposium on Empirical Software Engineering and Measurement, ESEM 2009, pp. 291–301. IEEE (2009)

    Google Scholar 

  32. Mosterman, P.J., Zander, J.: Cyber-physical systems challenges: a needs analysis for collaborating embedded software systems. Softw. Syst. Model. 15(1), 5–16 (2016)

    Article  Google Scholar 

  33. Müller, O., Stauner, T.: Modelling and verification using linear hybrid automata-a case study. Math. Comput. Model. Dyn. Syst. 6(1), 71–89 (2000)

    Article  Google Scholar 

  34. Picard, D.: Testing and estimating change-points in time series. Adv. Appl. Probab. 17(4), 841–867 (1985)

    Article  MathSciNet  Google Scholar 

  35. Platzer, A., Quesel, J.-D.: KeYmaera: a hybrid theorem prover for hybrid systems (system description). In: Armando, A., Baumgartner, P., Dowek, G. (eds.) IJCAR 2008. LNCS (LNAI), vol. 5195, pp. 171–178. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-71070-7_15

    Chapter  Google Scholar 

  36. Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Test case prioritization: an empirical study. In: 1999 Proceedings of IEEE International Conference on Software Maintenance (ICSM 1999), pp. 179–188. IEEE (1999)

    Google Scholar 

  37. Rubinstein, R.Y., Kroese, D.P.: The Cross-entropy Method: A Unified Approach to Combinatorial Optimization. Monte-Carlo Simulation and Machine Learning. Springer, Heidelberg (2013)

    MATH  Google Scholar 

  38. Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) Formal Methods and Testing. LNCS, vol. 4949, pp. 1–38. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78917-8_1

    Chapter  Google Scholar 

  39. Windisch, A., Al Moubayed, N.: Signal generation for search-based testing of continuous systems. In: 2009 International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2009, pp. 121–130. IEEE (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universidade Federal de Pernambuco, Recife, Brazil

    Hugo Araujo, Gustavo Carvalho & Augusto Sampaio

  2. University of Leicester, Leicester, UK

    Mohammad Reza Mousavi

Authors
  1. Hugo Araujo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gustavo Carvalho
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohammad Reza Mousavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Augusto Sampaio
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hugo Araujo .

Editor information

Editors and Affiliations

  1. University of Oslo, Oslo, Norway

    Peter Csaba Ölveczky

  2. University of Grenoble Alpes, Montbonnot, France

    Gwen Salaün

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Araujo, H., Carvalho, G., Mousavi, M.R., Sampaio, A. (2019). Multi-objective Search for Effective Testing of Cyber-Physical Systems. In: Ölveczky, P., Salaün, G. (eds) Software Engineering and Formal Methods. SEFM 2019. Lecture Notes in Computer Science(), vol 11724. Springer, Cham. https://doi.org/10.1007/978-3-030-30446-1_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30446-1_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30445-4

  • Online ISBN: 978-3-030-30446-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation