Abstract
Testing is the most dominating validation activity used by industry today, and there is an urgent need for improving its effectiveness, both with respect to the time and resources for test generation and execution, and obtained test coverage. We present a new technique for automatic generation of real-time black-box conformance tests for non-deterministic systems from a determinizable class of timed automata specifications with a dense time interpretation. In contrast to other attempts, our tests are generated using a coarse equivalence class partitioning of the specification. To analyze the specification, to synthesize the timed tests, and to guarantee coverage with respect to a coverage criterion, we use the efficient symbolic techniques recently developed for model checking of real-time systems. Application of our prototype tool to a realistic specification shows promising results in terms of both the test suite size, and the time and space used for test generation.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Rajeev Alur and David L. Dill. A Theory of Timed Automata. Theoretical Computer Science, 126(2):183–235, 25 April 1994.
Rajeev Alur, Limor Fix, and Thomas A. Henzinger. Event-Clock Automata: A Determinizable Class of Timed Automata. In 6th Conference on Computer Aided Verification, 1994. Also in LNCS 818.
Boris Beizer. Software Testing Techniques. International ThompsonComputer Press, 1990. 2nd edition, ISBN 1850328803.
Johan Bengtsson, W. O. David Griffioen, Kåare J. Kristoffersen, Kim G. Larsen, Fredrik Larsson, Paul Petterson, and Wang Yi. Verification of an Audio Protocol with Bus Collision using UppAal. In 9th Intl. Conference on Computer Aided Verification, pages 244–256, 1996. LNCS 1102.
Doeko Bosscher, Indra Polak, and Frits Vaandrager. Verification of an Audio Protocol. TR CS-R9445, CWI, Amsterdam, The Netherlands, 1994. Also in LNCS 863, 1994.
Ahmed Bouajjani, Stavros Tripakis, and Sergio Yovine. On-the-fly Symbolic Model-Checking for Real-Time Systems. In 1997 IEEE Real-Time Systems Symposium, RTSS’97, San Fransisco, USA, December 1996. IEEE Computer Society Press.
Marius Bozga, Jean-Claude Fernandez, Lucian Ghirvu, Claude Jard, Thierry Jéron, Alain Kerbrat, Pierre Morel, and Laurent Mounier. Verification and Test Generation for the SSCOP Protocol. Science of Computer Programming, 36(1):27–52, 2000.
V. Braberman, M. Felder, and M. Marré. Testing Timing Behaviors of Real Time Software. In Quality Week 1997. San Francisco, USA., pages 143–155, April-May 1997 1997.
Rachel Cardell-Oliver and Tim Glover. A Practical and Complete Algorithm for Testing Real-Time Systems. In 5th international Symposium on Formal Techniques in Real Time and Fault Tolerant Systems (FTRTFT’98), pages 251–261, September 14-18 1998. Also in LNCS 1486.
R. Castanet, Ousmane Koné, and Patrice Laurençot. On the fly test generation for realtime protocols. In International Conference in Computer Communications and Networks, Lafayette, Lousiana,USA, October 12–15 1998. IEEE Computer Society Press.
Duncan Clarke and Insup Lee. Testing Real-Time Constraints in a Process Algebraic Setting. In 17th International Conference on Software Engineering, 1995.
Duncan Clarke and Insup Lee. Automatic Test Generation for the Analysis of a Real-Time System: Case Study. In 3rd IEEE Real-Time Technology and Applications Symposium, 1997.
Rance Cleaveland and Matthew Hennessy. Testing Equivalence as a Bisimulation Equivalence. Formal Aspects of Computing, 5:1–20, 1993.
Conrado Daws and Sergio Yovine. Reducing the Number of Clock Variables of Timed Automata. In 1996 IEEE Real-Time Systems Symposium, RTSS’96,Washington, DC, USA, december 1996. IEEE Computer Society Press.
David L. Dill. Timing Assumptions andVerification of Finite-State Concurrent Systems. In International Workshop on Automatic Verification Methods for Finite State Systems, pages 197–212, Grenoble, France, June 1989. LNCS 407.
Abdeslam En-Nouaary, Rachida Dssouli, and Ferhat Khendek. Timed Test Cases Generation Based on State Characterization Technique. In 19th IEEE Real-Time Systems Symposium (RTSS’98), pages 220–229, December 2–4 1998.
Alain Kerbrat, Thierry Jéron, and Roland Groz. Automated Test Generation from SDL Specifications. In Ninth SDL Forum, 21–25 June 1999. Montral, Qubec, Canada.
Kim G. Larsen, Fredrik Larsson, Paul Petterson, and Wang Yi. Efficient Verification of Real-Time Systems: Compact Data Structures and State-Space Reduction. In 18th IEEE Real-Time Systems Symposium, pages 14–24, 1997.
Kim G. Larsen, Paul Pettersson, and Wang Yi. UppAal in a Nutshell. International Journal on Software Tools for Technology Transfer, 1(1):134–152, 1997.
Dino Mandrioli, Sandro Morasca, and Angelo Morzenti. Generating Test Cases for Real-Time Systems from Logic Specifications. ACM Transactions on Computer Systems, 13(4):365–398, 1995.
R. De Nicola and M.C.B Hennessy. Testing Equivalences for Processes. TheoreticalComputer Science, 34:83–133, 1984.
Brian Nielsen. Specification and Test of Real-Time Systems. PhD thesis, Department of Computer Science, Aalborg University, Denmark, april 2000.
Jan Peleska and Bettina Buth. Formal Methods for the International Space Station ISS. In E.-R. Olderog and B. Steffen, editors, Correct System Design, pages 363–389, 1999. Springer LNCS 1710.
Jan Peleska and Cornelia Zahlten. Test Automation for Avionic Systems and Space Technology. In GIWorkingGroup on Test, Analysis and Verification of Software, 1999. Munich, Extended Abstract.
Annie Ressouche, Robert de Simone, Amar Bouali, and Valérie Roy. The FCTOOLS User Manual. Technical Report ftp://ftpsop.inria.fr/meije/verif/fc2.userman.ps, INRIA Sophia Antipolis.
Holger Schlingloff, Oliver Meyer, and Thomas Hülsing. Correctness Analysis of an Embedded Controller. In Data Systems in Aerospace (DASIA99). ESA SP-447, Lisbon, Portugal, pages 317–325, 1999.
J. Springintveld, F. Vaandrager, and P.R. D’Argenio. Testing Timed Automata. TR CTIT 97-17, University of Twente, 1997. To appear in Theoretical Computer Science.
Wang Yi, Paul Pettersson, and Mats Daniels. Automatic Verification of Real-Time Communicating Systems by Constraint Solving. In 7th Int. Conf. on Formal Description Techniques, pages 223–238, 1994. North-Holland.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nielsen, B., Skou, A. (2001). Automated Test Generation from Timed Automata. In: Margaria, T., Yi, W. (eds) Tools and Algorithms for the Construction and Analysis of Systems. TACAS 2001. Lecture Notes in Computer Science, vol 2031. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45319-9_24
Download citation
DOI: https://doi.org/10.1007/3-540-45319-9_24
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41865-8
Online ISBN: 978-3-540-45319-2
eBook Packages: Springer Book Archive