Abstract
We describe a comprehensive approach for conformance testing of reactive systems. Based on a formal specification, namely UML state machines, we automatically generate test cases and use them to test the input-output conformance of a system under test. The test cases include not only the stimuli to trigger the system under test, they also include the test oracles to automatically evaluate the test execution. In contrast to Harel Statecharts, state machines behave asynchronously, which makes automatic test case generation a particular challenge. As a prerequisite we have completely formalized a substantial subset of UML state machines that includes complex structured data. The Teager tool suite implements our test approach and proves its applicability.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
UML2: Unified Modeling Language: Infrastructure and Superstructure. Object Management Group, Version 2.1.1, formal/07-02-03 (2007), http://www.uml.org/uml
Balser, M., Bäumler, S., Knapp, A., Reif, W., Thums, A.: Interactive Verification of UML State Machines. In: Davies, J., Schulte, W., Barnett, M. (eds.) ICFEM 2004. LNCS, vol. 3308. Springer, Heidelberg (2004)
Lilius, J., Paltor, I.P.: Formalising UML State Machines for Model Checking. In: France, R.B., Rumpe, B. (eds.) UML 1999. LNCS, vol. 1723. Springer, Heidelberg (1999)
Latella, D., Majzik, I., Massink, M.: Automatic Verification of a Behavioural Subset of UML Statechart Diagrams Using the SPIN Model-checker. Formal Aspects of Computing (1999)
De Nicola, R., Hennessy, M.C.B.: Testing Equivalences for Processes. Theoretical Computer Science (1984)
Brinksma, E.: A Theory for the Derivation of Tests. In: Protocol Specification, Testing and Verification. North-Holland, Amsterdam (1988)
Tretmans, J.: Test Generation with Inputs, Outputs and Repetitive Quiescence. Software–Concepts and Tools (1996)
Lee, D., Yannakakis, M.: Principles and Methods of Testing Finite State Machines - A Survey. In: Proceedings of the IEEE (1996)
Petrenko, A.: Fault Model-driven Test Derivation from Finite State Models: Annotated Bibliography. LNCS. Springer, Heidelberg (2001)
Brinksma, E., Tretmans, J.: Testing Transition Systems: An Annotated Bibliography. LNCS. Springer, Heidelberg (2001)
Fujiwara, S., van Bochmann, G., Khendek, F., Amalou, M., Ghedamsi, A.: Test Selection Based on Finite State Models. IEEE Transactions on Software Engineering (1991)
Yang, B., Ural, H.: Protocol Conformance Test Generation using multiple UIO Sequences with Overlapping. SIGCOMM Computer Communication Review (1990)
Chow, T.S.: Testing Software Design Modeled by Finite-State Machines. IEEE Transactions on Software Engineering (1978)
Luo, G., van Bochmann, G., Petrenko, A.: Test Selection Based on Communicating Nondeterministic Finite State Machines Using a Generalized Wp-Method. IEEE Transactions on Software Engineering (1994)
Gnesi, S., Latella, D., Massink, M.: Formal Test-case Generation for UML Statecharts. In: Engineering Complex Computer Systems (ICECCS). IEEE Computer Society Press, Los Alamitos (2004)
Offutt, A.J., Liu, S., Abdurazik, A., Ammann, P.: Generating test data from state-based specifications. Software Test, Verification. Reliability (2003)
Latella, D., Massink, M.: A Formal Testing Framework for UML Statechart Diagrams Behaviours: From Theory to Automatic Verification. In: International Symposium on High-Assurance Systems Engineering. IEEE Computer Society Press, Los Alamitos (2001)
Latella, D., Massink, M.: On Testing and Conformance Relations for UML Statechart Diagrams Behaviours. SIGSOFT Software Engineering Notes (2002)
Offutt, J., Abdurazik, A.: Generating Tests from UML Specifications. In: The Unified Modeling Language (UML). Springer, Heidelberg (1999)
Pretschner, A., Lötzbeyer, H., Philipps, J.: Model based Testing in incremental System Development. Journal of Systems and Software (2004)
Hartman, A., Nagin, K.: The AGEDIS Tools for Model Based Testing. In: International Symposium on Software Testing and Analysis (ISSTA 2004), pp. 129–132 (2004)
Campbell, C., Grieskamp, W., Nachmanson, L., Schulte, W., Tillmann, N., Veanes, M.: Model-Based Testing of Object-Oriented Reactive Systems with Spec Explorer. Technical Report MSR-TR-2005-59, Microsoft Research (2005)
Harel, D.: Statecharts: A Visual Formulation for Complex Systems. Science of Computer Programming (1987)
Seifert, D.: An Executable Formal Semantics for a UML State Machine Kernel Considering Complex Structured Data. Technical Report inria-00274391, DEDALE (LORIA) (2008)
Seifert, D.: Automatisiertes Testen asynchroner nichtdeterministischer Systeme mit Daten. Shaker Verlag, Also: PhD dissertation, Technische Universität Berlin (2007)
Harel, D., Naamad, A.: The STATEMATE Semantics of Statecharts. ACM Transactions on Software Engineering and Methodology (1996)
De Nicola, R.: Extensional Equivalences for Transition Systems. Acta Informatica (1987)
Seifert, D., Souquières, J.: Using UML Protocol State Machines in Conformance Testing of Components. Technical Report inria-00274383, DEDALE (LORIA) (2008)
Santen, T., Seifert, D.: Teager - Test Automation for UML State Machines. In: Software Engineering 2006. LNI, GI (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Seifert, D. (2008). Conformance Testing Based on UML State Machines. In: Liu, S., Maibaum, T., Araki, K. (eds) Formal Methods and Software Engineering. ICFEM 2008. Lecture Notes in Computer Science, vol 5256. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88194-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-88194-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88193-3
Online ISBN: 978-3-540-88194-0
eBook Packages: Computer ScienceComputer Science (R0)