skip to main content
10.1145/2660190.2662115acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfosdConference Proceedingsconference-collections
research-article

Towards incremental test suite optimization for software product lines

Published: 14 September 2014 Publication History

Abstract

The design of an appropriate test suite for software testing is a challenging task. It requires a suitable tradeoff between effectiveness, e.g., a sufficient amount of test cases to satisfy the test goals of a given coverage criterion, and efficiency, e.g., a redundancy-reduced selection of test cases. Recent test suite optimization approaches, therefore, usually require an explicit enumeration of existing test cases to select from. The test suite design for covering entire software product lines is even more problematic as the dependency between test cases, test goals and product configurations has to be taken into account. Due to the exponential number of configurations w.r.t. the number of features, an explicit enumeration of all products for optimizing a product-line test suite is impractible. To tackle this problem, we propose an incremental test suite optimization approach for product-line testing that does not require an explicit representation of the set of configurations under test, but rather uses a symbolic representation in terms of feature constraints. The approach is illustrated by means of a running example.

References

[1]
H. Baller, S. Lity, M. Lochau, and I. Schaefer. Multi-Objective Test Suite Optimization for Incremental Product Family Testing. In ICST, 2014.
[2]
D. Batory. Feature Models, Grammars, and Propositional Formulas. In SPLC. Springer, 2005.
[3]
D. Beyer, A. Holzer, M. Tautschnig, and H. Veith. Information Reuse for Multi-goal Reachability Analyses. In Programming Languages and Systems, volume 7792 of LNCS. Springer, 2013.
[4]
D. Beyer and M. Keremoglu. CPAchecker: A Tool for Configurable Software Verification. In Computer Aided Verification, volume 6806 of LNCS. Springer, 2011.
[5]
J. Bürdek, S. Lity, M. Lochau, M. Berens, U. Goltz, and A. Schürr. Staged Configuration of Dynamic Software Product Lines with Complex Binding Time Constraints. In VaMoS. ACM, 2013.
[6]
J. Chilenski and S. Miller. Applicability of modified condition/decision coverage to software testing. Software Engineering Journal, 9(5), 1994.
[7]
H. Cichos, S. Oster, M. Lochau, and A. Schürr. Model-based Coverage-Driven Test Suite Generation for Software Product Lines. In MoDELS, 2011.
[8]
A. Classen. Modelling with FTS: a Collection of Illustrative Examples. Technical Report P-CS-TR SPLMC-1, PReCISE Research Center, University of Namur, Namur, Belgium, 2010.
[9]
A. Fantechi and S. Gnesi. Formal Modeling for Product Families Engineering. In SPLC, 2008.
[10]
M. J. Harrold, R. Gupta, and M. L. Soffa. A Methodology for Controlling the Size of a Test Suite. ACM Trans. Softw. Eng. Methodol., 2(3), 1993.
[11]
K. J. Hayhurst, D. S. Veerhusen, J. J. Chilenski, and L. K. Rierson. A Practical Tutorial on Modified Condition/Decision Coverage. Technical report, NASA Langley Research Center, Hampton, Virginia, 2001.
[12]
Heidelberg University Hospital. Heidelberg Ion-Beam Therapy Center. http://www.klinikum.uni-heidelberg.de/Welcome.113005.0.html?&L=1, 2013.
[13]
J. Kamischke, M. Lochau, and H. Baller. Conditioned Model Slicing of Feature-Annotated State Machines. In FOSD. ACM, 2012.
[14]
C. K. Kang, S. G. Cohen, J. A. Hess, W. E. Novak, and A. S. Peterson. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical report, Carnegie Mellon, Software Engineering Inst., 1990.
[15]
M. Lochau, J. Bürdek, S. Lity, M. Hagner, C. Legat, U. Goltz, and A. Schürr. Applying Model-based Software Product Line Testing Approaches to the Automation Engineering Domain. at - Automatisierungstechnik, to appear, 2014.
[16]
S. Oster, I. Zorcic, F. Markert, and M. Lochau. MoSo-PoLiTe - Tool Support for Pairwise and Model-Based Software Product Line Testing. In VaMoS, 2011.
[17]
P. Schobbens, P. Heymans, and J.-C. Trigaux. Feature Diagrams: A Survey and a Formal Semantics. In ICRE, 2006.
[18]
Special Committee of RTCA. DO-178C, Software Considerations in Airborne Systems and Equipment Certification, 2011.
[19]
M. Utting and B. Legeard. Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann, San Francisco, CA, USA, 2007.
[20]
S. Xu, H. Miao, and H. Gao. Test Suite Reduction Using Weighted Set Covering Techniques. In SNPD, 2012.

Cited By

View all
  • (2019)Effective product-line testing using similarity-based product prioritizationSoftware and Systems Modeling (SoSyM)10.1007/s10270-016-0569-218:1(499-521)Online publication date: 1-Feb-2019
  • (2017)Reducing the Concretization Effort in FSM-Based Testing of Software Product Lines2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW.2017.61(329-336)Online publication date: Mar-2017
  • (2017)Efficient product-line testing using cluster-based product prioritizationProceedings of the 12th International Workshop on Automation of Software Testing10.1109/AST.2017.7(16-22)Online publication date: 20-May-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
FOSD '14: Proceedings of the 6th International Workshop on Feature-Oriented Software Development
September 2014
53 pages
ISBN:9781450329804
DOI:10.1145/2660190
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. model-based software engineering
  2. software product lines
  3. test case generation

Qualifiers

  • Research-article

Funding Sources

Conference

FOSD '14

Acceptance Rates

Overall Acceptance Rate 17 of 28 submissions, 61%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2019)Effective product-line testing using similarity-based product prioritizationSoftware and Systems Modeling (SoSyM)10.1007/s10270-016-0569-218:1(499-521)Online publication date: 1-Feb-2019
  • (2017)Reducing the Concretization Effort in FSM-Based Testing of Software Product Lines2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW)10.1109/ICSTW.2017.61(329-336)Online publication date: Mar-2017
  • (2017)Efficient product-line testing using cluster-based product prioritizationProceedings of the 12th International Workshop on Automation of Software Testing10.1109/AST.2017.7(16-22)Online publication date: 20-May-2017
  • (2016)Fine-grained test case prioritization for integration testing of delta-oriented software product linesProceedings of the 7th International Workshop on Feature-Oriented Software Development10.1145/3001867.3001868(1-10)Online publication date: 30-Oct-2016
  • (2016)Applying Incremental Model Slicing to Product-Line Regression TestingProceedings of the 15th International Conference on Software Reuse: Bridging with Social-Awareness - Volume 967910.1007/978-3-319-35122-3_1(3-19)Online publication date: 5-Jun-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media