Skip to main content
SpringerLink
Log in

Automated test generation from timed automata

  • Special section on trends in verification and validation
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

Testing is the most dominant validation activity used by industry today, and there is an urgent need for improving its effectiveness, both with respect to the time and resources for test generation and execution, and obtained test coverage. We present a new technique for automatic generation of real-time black-box conformance tests for non-deterministic systems from a determinizable class of timed automata specifications with a dense time interpretation. In contrast to other attempts, our tests are generated using a coarse equivalence class partitioning of the specification. To analyze the specification, to synthesize the timed tests, and to guarantee coverage with respect to a coverage criterion, we use the efficient symbolic techniques recently developed for model checking of real-time systems. Application of our prototype tool to a realistic specification shows promising results in terms of both the test suite size, and the time and space used for test generation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Alur R, Dill DL: A theory of timed automata. Theoret Comput Sci 126(2):183–235, 1994

    Article  MathSciNet  Google Scholar 

  2. Alur R, Fix L, Henzinger TA: Event-clock automata: a determinizable class of timed automata. In: 6th Conference on Computer Aided Verification, Lecture Notes in Computer Science, vol. 818. Springer, Berlin Heidelberg New York, 1994

  3. Behrmann G, Larsen KG, Pearson J, Weise C, Yi W: Efficient timed reachability analysis using clock difference diagrams. In: Computer Aided Verification (CAV’99), Lecture Notes in Computer Science, vol. 1633. Springer, Berlin Heidelberg New York, 1999, pp. 22–24

  4. Beizer B: Software testing techniques. International Thompson Computer, New York, 1990

  5. Bellman R: Dynamic programming. Princeton University Press, Princeton, New Jersey, 1957

  6. Bengtsson J, David Griffioen WO, Kristoffersen KJ, Larsen KG, Larsson F, Petterson P, Yi W: Verification of an audio protocol with bus collision using UppAal. In: 9th Int. Conference on Computer Aided Verification, Lecture Notes in Computer Science, vol. 1102. Springer, Berlin Heidelberg New York, 1996, pp. 244–256

  7. Steffen B, Cleaveland R (eds.): Int J Software Tools Technol Transfer 1(1+2), 1997

  8. Bosscher D, Polak I, Vaandrager F: Verification of an audio protocol. TR CS-R9445, CWI, Amsterdam, The Netherlands, 1994; Lecture Notes in Computer Science, vol. 863. Springer, Berlin Heidelberg New York, 1994

  9. Bouajjani A, Tripakis S, Yovine S: On-the-fly symbolic model-checking for real-time systems. In: 1997 IEEE Real-Time Systems Symposium, RTSS’97, San Fransisco, Calif., USA. IEEE Computer, New York, 1996

  10. Bozga M, Fernandez JC, Ghirvu L, Jard C, Jéron T, Kerbrat A, Morel P, Mounier L: Verification and test generation for the SSCOP protocol. Sci Comput Program 36(1):27–52, 2000

    Article  Google Scholar 

  11. Bozga M, Fernandez JC, Kerbrat A, Mounier L: Protocol verification with the ALDÉBARAN toolset. Int J Software Tools Technol Transfer 1(1+2):166–184, 1997

  12. Braberman V, Felder M, Marré M: Testing timing behaviors of real time software. In: Quality Week 1997. San Francisco, Calif., USA, 1997, pp. 143–155

  13. Brinksma E: A theory for the derivation of tests. In: Protocol Specification Testing and Verification VIII (PSTV’88), 1988, pp. 63–74

  14. Cardell-Oliver R: Conformance testing of real-time systems with timed automata. Formal Aspects Comput 12(5):350–371, 2000

    Article  Google Scholar 

  15. Cardell-Oliver R, Glover T: A practical and complete algorithm for testing real-time systems. In: 5th international Symposium on Formal Techniques in Real Time and Fault Tolerant Systems (FTRTFT’98), September 14–18, Lecture Notes in Computer Science, vol. 1486. Springer, Berlin Heidelberg New York, 1998, pp. 251–261

  16. Castanet R, Koné O, Laurençot P: On-the-fly test generation for real-time protocols. In: International Conference in Computer Communications and Networks, Lafayette, La., USA, October 12–15. IEEE Computer, New York, 1998

  17. Clarke D, Lee I: Testing real-time constraints in a process algebraic setting. In: 17th International Conference on Software Engineering, 1995

  18. Clarke D, Lee I: Automatic test generation for the analysis of a real-time system: case study. In: 3rd IEEE Real-Time Technology and Applications Symposium, 1997

  19. Cleaveland R, Hennessy M: Testing equivalence as a bisimulation equivalence. Formal Aspects Comput 5:1–20, 1993

    Article  Google Scholar 

  20. Daws C, Yovine S: Reducing the number of clock variables of timed automata. In: 1996 IEEE Real-Time Systems Symposium, RTSS’96, Washington, DC, USA. IEEE Computer, New York, 1996

  21. de Vries RG, Tretmans J: On-the-fly conformance testing using SPIN. Int Jn Software Tools Technol Transfer 2(4):382–393, 2000

    Google Scholar 

  22. Dill DL: Timing assumptions and verification of finite-state concurrent systems. In: International Workshop on Automatic Verification Methods for Finite State Systems, Grenoble, France, June. Lecture Notes in Computer Science, vol. 407. Springer, Berlin Heidelberg New York, 1989, pp. 197–212

  23. En-Nouaary A, Dssouli R, Khendek F: Timed test cases generation based on state characterization technique. In: 19th IEEE Real-Time Systems Symposium (RTSS’98), 1998, pp. 220–229

  24. Holzmann JG: Design and validation of computer protocols. Prentice-Hall, N.J., USA, 1991

  25. Kerbrat A, Jéron T, Groz R: Automated test generation from SDL specifications. In: 9th SDL Forum, 21–25 June. Montréal, Québec, Canada, 1999

  26. Koustsofios E, North SC: Drawing graphs with dot. Technical Report http://www.research.att.com/sw/tools/graphviz/ dotguide.ps.gz, AT&T Bell Laboratories, Murray Hill, N.J., USA, 1999

  27. Larsen KG, Larsson F, Petterson P, Yi W: Efficient verification of real-time systems: compact data structures and state-space reduction. In: 18th IEEE Real-Time Systems Symposium, 1997, pp. 14–24

  28. Larsen KG, Pettersson P, Yi W: UppAal in a nutshell. Int J Software Tools Technol Transfer 1(1):134–152, 1997

    Article  Google Scholar 

  29. Leblanc P: OMT and SDL based techniques and tools for design, simulation and test production of distributed systems. Int J Software Tools Technol Transfer 1(1+2):153–165, 1997

  30. Mandrioli D, Morasca S, Morzenti A: Generating test cases for real-time systems from logic specifications. ACM Trans Comput Syst 13(4):365–398, 1995

    Article  Google Scholar 

  31. De Nicola R, Hennessy MCB: Testing equivalences for processes. Theoret Comput Sci 34:83–133, 1984

    Article  MathSciNet  Google Scholar 

  32. Nielsen B: Specification and test of real-time systems. PhD thesis, Department of Computer Science, Aalborg University, Denmark, 2000

  33. Peleska J, Buth B: Formal methods for the international space station ISS. In: Olderog ER, Steffen B (eds) Correct System Design. Lecture Notes in Computer Science, vol. 1710. Springer, Berlin Heidelberg New York, 1999, pp. 363–389

  34. Peleska J, Zahlten C: Test automation for avionic systems and space technology. In: GI Working Group on Test, Analysis and Verification of Software. Munich (extended abstract), 1999

  35. Ressouche A, de Simone R, Bouali A, Roy V. The fcTools user manual. Technical Report ftp://ftp-sop.inria.fr/meije/verif/fc2.userman.ps, INRIA Sophia Antipolis

  36. Rushby J: Formal methods: instruments of justification or tools of discovery. In: Nordic Seminar on Dependable Computing Systems (NSDCS’94), Lyngby, Denmark, 1994

  37. Schlingloff H, Meyer O, Hülsing T: Correctness analysis of an embedded controller. In: Data Systems in Aerospace (DASIA99). ESA SP-447, Lisbon, Portugal, 1999, pp. 317–325

  38. Schmitt M, Koch B, Grabowski J, Hogrefe D: Autolink – Putting formal test methods into practice. In: 11th Int. Workshop on Testing of Communicating Systems (IWTCS’98), Tomsk, Russia, 1998

  39. Springintveld J, Vaandrager F, D’Argenio PR: Testing timed automata. TR CTIT 97-17, University of Twente. Theoret Comput Sci 254(1–2):225–257, 2001

  40. Diekert V, Gastin P, Petit A: Removing epsilon-transitions in timed automata. In: 14th Annual Symposium on Theoretical Aspects of Computer Science, STACS 1997, Lübeck, Germany, February 27 – March 1 1997. Lecture Notes in Computer Science, vol. 1200. Springer, Berlin Heidelberg New York, 1997, pp. 583–594

  41. Yi W, Pettersson P, Daniels M: Automatic verification of real-time communicating systems by constraint solving. In: 7th Int. Conf. on Formal Description Techniques. North-Holland, Amsterdam, The Netherlands, 1994, pp. 223–238

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Aalborg University, Fredrik Bajersvej 7E, 9220, Aalborg, Denmark

    Brian Nielsen & Arne Skou

Authors
  1. Brian Nielsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arne Skou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Brian Nielsen or Arne Skou.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nielsen, B., Skou, A. Automated test generation from timed automata. Int J Softw Tools Technol Transfer 5, 59–77 (2003). https://doi.org/10.1007/s10009-002-0094-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-002-0094-1

Search

Navigation