Abstract
For testing model transformations or model transformation chains, a software engineer usually designs a test suite consisting of test cases where each test case consists of one or several models. In order to ensure a high quality of such a test suite, coverage achieved by the test cases with regards to the system under test must be systematically measured. Using coverage analysis and the resulting coverage information, missing test cases and redundant test cases can be identified and thereby the quality of the test suite can be improved. As test cases consist of models, a coverage analysis approach must measure how complete models cover the domains of the transformations in the chain and to what degree of completeness transformations are covered when executing the test suite. In this paper, we present a coverage analysis approach for measuring test suite quality for model transformation chains. Our approach combines different coverage criteria and yields detailed coverage information that can be used to identify missing and redundant test cases.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
IBM WebSphere Business Modeler, http://www.ibm.com/software/integration/wbimodeler/
Ammann, P., Offutt, J.: Introduction to Software Testing. Cambridge University Press, New York (2008)
Andrews, A., France, R., Ghosh, S., Craig, G.: Test Adequacy Criteria for UML Design Models. Software Testing, Verification and Reliability 13(2), 95–127 (2003)
Baudry, B., Dinh-Trong, T., Mottu, J.-M., Simmonds, D., France, R., Ghosh, S., Fleurey, F., Le Traon, Y.: Model Transformation Testing Challenges. In: Proceedings of IMDT workshop in conjunction with ECMDA 2006, Bilbao, Spain (2006)
Bauer, E.: Analyzing Test Suites for Model Transformation Chains. Master’s thesis, University of Paderborn (2010)
Csertán, G., Huszerl, G., Majzik, I., Pap, Z., Pataricza, A., Varró, D.: VIATRA: Visual Automated Transformations for Formal Verification and Validation of UML Models. In: ASE 2002: 17th IEEE International Conference on Automated Software Engineering, pp. 267–270. IEEE Computer Society Press, Los Alamitos (2002)
Czarnecki, K., Helsen, S.: Feature-based Survey of Model Transformation Approaches. IBM Systems Journal 45(3), 621–645 (2006)
Cariou, E., Marvie, R., Seinturier, L., Duchien, L.: OCL for the Specification of Model Transformation Contracts. In: Workshop OCL and Model Driven Engineering of the Seventh International Conference on UML Modeling Languages and Applications UML 2004, Lisbon, Portugual, October 12 (2004)
Fleurey, F., Baudry, B., Muller, P., Le Traon, Y.: Qualifying Input Test Data for Model Transformations. Software and Systems Modeling 8(2), 185–203 (2009)
Object Management Group (OMG). Meta Object Facility (MOF) 2.0 Query/View/Transformation Specification Version 1.1 (January 2011)
Guerra, E., de Lara, J., Kolovos, D., Paige, R.: A Visual Specification Language for Model-to-Model Transformations. In: IEEE Symposium on Visual Languages and Human-Centric Computing, vol. 0, pp. 119–126. IEEE Computer Society Press, Los Alamitos (2010)
Harrold, M.J., Gupta, R., Soffa, M.L.: A Methodology for Controlling the Size of a Test Suite. ACM Transactions on Software Engineering and Methodology 2(3), 270–285 (1993)
Heimdahl, M., George, D.: Test-suite Reduction for Model Based Tests: Effects on Test Quality and Implications for Testing. In: Proceedings of the 19th IEEE International Conference on Automated Software Engineering (ASE), pp. 176–185. IEEE Computer Society, Los Alamitos (2004)
Jouault, F., Allilaire, F., Bézivin, J., Kurtev, I.: ATL: A Model Transformation Tool. Science of Computer Programming 72(1-2), 31–39 (2008)
Küster, J.M., Gerth, C., Förster, A., Engels, G.: Detecting and Resolving Process Model Differences in the Absence of a Change Log. In: Dumas, M., Reichert, M., Shan, M.-C. (eds.) BPM 2008. LNCS, vol. 5240, pp. 244–260. Springer, Heidelberg (2008)
Leon, D., Podgurski, A., White, L.: Multivariate Visualization in Observation-based Testing. In: ICSE 2000: Proceedings of the 22nd International Conference on Software Engineering, pp. 116–125. ACM Press, New York (2000)
McQuillan, J., Power, J.: White-Box Coverage Criteria for Model Transformations. In: 1st International Workshop on Model Transformation with ATL, Nantes, France, July 8-9 (2009)
Meyer, B.: Applying ”Design by Contract”. Computer 25(10), 40–51 (1992)
Object Management Group (OMG). Business Process Modeling Notation, V2.0 Beta 2 (June 2010)
Parsa, S., Khalilian, A., Fazlalizadeh, Y.: A New Algorithm to Test Suite Reduction Based on Cluster Analysis. In: International Conference on Computer Science and Information Technology, vol. 0, pp. 189–193 (2009)
Rothermel, G., Harrold, M.J., Ostrin, J., Hong, C.: An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites. In: ICSM 1998: Proceedings of the International Conference on Software Maintenance, pp. 34–43. IEEE Computer Society Press, Los Alamitos (1998)
von Pilgrim, J., Vanhooff, B., Schulz-Gerlach, I., Berbers, Y.: Constructing and Visualizing Transformation Chains. In: Schieferdecker, I., Hartman, A. (eds.) ECMDA-FA 2008. LNCS, vol. 5095, pp. 17–32. Springer, Heidelberg (2008)
Yan, S., Chen, Z., Zhao, Z., Zhang, C., Zhou, Y.: A Dynamic Test Cluster Sampling Strategy by Leveraging Execution Spectra Information. In: ICST 2010: Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation, pp. 147–154. IEEE Computer Society Press, Washington, DC, USA (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bauer, E., Küster, J.M., Engels, G. (2011). Test Suite Quality for Model Transformation Chains. In: Bishop, J., Vallecillo, A. (eds) Objects, Models, Components, Patterns. TOOLS 2011. Lecture Notes in Computer Science, vol 6705. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21952-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-21952-8_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21951-1
Online ISBN: 978-3-642-21952-8
eBook Packages: Computer ScienceComputer Science (R0)