Skip to main content

Model-Based Testing for Asynchronous Systems

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 10471))

Abstract

Model-based testing is a prominent validation technique, integrating well with other formal approaches to verification, such as model checking. Automated test derivation and execution approaches often struggle with asynchrony in communication between the implementation under test (IUT) and tester, a phenomenon present in most networked systems. Earlier attacks on this problem came with different restrictions on the specification model side. This paper presents a new and effective approach to model-based testing under asynchrony. By waiving the need to guess the possible output state of the IUT, we reduce the computational effort of the test generation algorithm while preserving soundness and conceptual completeness of the testing procedures. In addition, no restrictions on the specification model need to be imposed. We define a suitable conformance relation and we report on empirical results obtained from an industrial case study from the domain of electric mobility.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Balemi, S.: Control of discrete event systems: theory and application. Ph.D. thesis, Swiss Federal Institute of Technology, Zurich, Switzerland (1992)

    Google Scholar 

  2. Bernot, G., Gaudel, M.-C., Marre, B.: Software testing based on formal specifications: a theory and a tool. Softw. Eng. J. 6(6), 387–405 (1991)

    Article  Google Scholar 

  3. Bijl, M., Rensink, A., Tretmans, J.: Action refinement in conformance testing. In: Khendek, F., Dssouli, R. (eds.) TestCom 2005. LNCS, vol. 3502, pp. 81–96. Springer, Heidelberg (2005). doi:10.1007/11430230_7

    Chapter  Google Scholar 

  4. CAN in Automation International Users and Manufacturers Group e.V.: CiA 301 CANopen Application Layer and Communication Profile, v. 4.2.0 (2011)

    Google Scholar 

  5. CAN in Automation International Users and Manufacturers Group e.V.: CiA 305 Layer setting services (LSS) and protocols, v. 3.0.0 (2013)

    Google Scholar 

  6. CAN in Automation International Users and Manufacturers Group e.V. and EnergyBus e.V.: CiA 454 Draft Standard Proposal Application profile for energy management systems - doc. series 1-14, v. 2.0.0 (2014)

    Google Scholar 

  7. da Silva Simão, A., Petrenko, A.: From test purposes to asynchronous test cases. In: ICST 2010 Workshops Proceedings, pp. 1–10. IEEE Computer Society (2010)

    Google Scholar 

  8. De Nicola, R.: Extensional equivalences for transition systems. Acta Inf. 24(2), 211–237 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  9. De Nicola, R., Hennessy, M.: Testing equivalences for processes. Theor. Comput. Sci. 34, 83–133 (1984)

    Article  MATH  MathSciNet  Google Scholar 

  10. Gaudel, M.-C.: Testing can be formal, too. In: Mosses, P.D., Nielsen, M., Schwartzbach, M.I. (eds.) CAAP 1995. LNCS, vol. 915, pp. 82–96. Springer, Heidelberg (1995). doi:10.1007/3-540-59293-8_188

    Chapter  Google Scholar 

  11. Graf-Brill, A., Hermanns, H., Garavel, H.: A model-based certification framework for the EnergyBus standard. In: Ábrahám, E., Palamidessi, C. (eds.) FORTE 2014. LNCS, vol. 8461, pp. 84–99. Springer, Heidelberg (2014). doi:10.1007/978-3-662-43613-4_6

    Chapter  Google Scholar 

  12. Hahn, E.M., Hartmanns, A., Hermanns, H., Katoen, J.-P.: A compositional modelling and analysis framework for stochastic hybrid systems. Form. Methods Syst. Des. 43(2), 191–232 (2013)

    Article  MATH  Google Scholar 

  13. Hartmanns, A., Hermanns, H.: The modest toolset: an integrated environment for quantitative modelling and verification. In: Ábrahám, E., Havelund, K. (eds.) TACAS 2014. LNCS, vol. 8413, pp. 593–598. Springer, Heidelberg (2014). doi:10.1007/978-3-642-54862-8_51

    Chapter  Google Scholar 

  14. Hierons, R.M.: The complexity of asynchronous model based testing. Theor. Comput. Sci. 451, 70–82 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  15. Hierons, R.M.: Implementation relations for testing through asynchronous channels. Comput. J. 56(11), 1305–1319 (2013)

    Article  Google Scholar 

  16. Huo, J., Petrenko, A.: On testing partially specified IOTS through lossless queues. In: Groz, R., Hierons, R.M. (eds.) TestCom 2004. LNCS, vol. 2978, pp. 76–94. Springer, Heidelberg (2004). doi:10.1007/978-3-540-24704-3_6

    Chapter  Google Scholar 

  17. Jard, C., Jéron, T.: TGV: theory, principles and algorithms. STTT 7(4), 297–315 (2005)

    Article  Google Scholar 

  18. Langerak, R.: A testing theory for LOTOS using deadlock detection. In: PSTV 1989, North-Holland, pp. 87–98 (1989)

    Google Scholar 

  19. Petrenko, A.: Fault model-driven test derivation from finite state models: annotated bibliography. In: Cassez, F., Jard, C., Rozoy, B., Ryan, M.D. (eds.) MOVEP 2000. LNCS, vol. 2067, pp. 196–205. Springer, Heidelberg (2001). doi:10.1007/3-540-45510-8_10

    Chapter  Google Scholar 

  20. Petrenko, A., Yevtushenko, N.: Queued testing of transition systems with inputs and outputs. In: Proceedings of FATES 2002, pp. 79–93 (2002)

    Google Scholar 

  21. Phillips, I.: Refusal testing. Theor. Comput. Sci. 50, 241–284 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  22. Tretmans, J.: A formal approach to conformance testing. Ph.D. thesis, University of Twente, Enschede (1992)

    Google Scholar 

  23. Tretmans, J.: Testing concurrent systems: a formal approach. In: Baeten, J.C.M., Mauw, S. (eds.) CONCUR 1999. LNCS, vol. 1664, pp. 46–65. Springer, Heidelberg (1999). doi:10.1007/3-540-48320-9_6

    Chapter  Google Scholar 

  24. Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) Formal Methods and Testing. LNCS, vol. 4949, pp. 1–38. Springer, Heidelberg (2008). doi:10.1007/978-3-540-78917-8_1

    Chapter  Google Scholar 

  25. Tretmans, J., Brinksma, E.: TorX: Automated Model Based Testing - Côte de Resyste (2003)

    Google Scholar 

  26. Tretmans, J., Verhaard, L.: A queue model relating synchronous and asynchronous communication. In: PSTV 1992, North-Holland, pp. 131–145 (1992)

    Google Scholar 

  27. Verhaard, L., Tretmans, J., Kars, P., Brinksma, E.: On asynchronous testing. In: IWPTS 1992, North-Holland, pp. 55–66 (1992)

    Google Scholar 

  28. Weiglhofer, M., Wotawa, F.: Asynchronous input-output conformance testing. In: COMPSAC 2009, pp. 154–159. IEEE Computer Society (2009)

    Google Scholar 

Download references

Acknowledgments

This work is supported by the ERC Advanced Grant powver (695614) and the Sino-German project CAP (GZ 1023).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Graf-Brill .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Graf-Brill, A., Hermanns, H. (2017). Model-Based Testing for Asynchronous Systems. In: Petrucci, L., Seceleanu, C., Cavalcanti, A. (eds) Critical Systems: Formal Methods and Automated Verification. AVoCS FMICS 2017 2017. Lecture Notes in Computer Science(), vol 10471. Springer, Cham. https://doi.org/10.1007/978-3-319-67113-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67113-0_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67112-3

  • Online ISBN: 978-3-319-67113-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics