skip to main content
10.1145/2451617.2451619acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmodularityConference Proceedingsconference-collections
research-article

Towards efficient SPL testing by variant reduction

Published: 26 March 2013 Publication History

Abstract

Testing software systems plays a pivotal role for quality, reliability, and safety of such systems. Several approaches exist that provide efficient algorithms to test one software system. However, in the context of variable software systems, called software product lines (SPLs), testing has to deal with potentially thousands of variants. Unfortunately, current approaches do not scale to this problem and thus testing SPLs efficiently is a challenging task. In this paper, we propose an approach to reduce the test set by explicitly modeling information about shared resources and communication in feature models. As a result, we can figure out features that interact with each other and thus are more likely to cause problems. We show with a small case study that our approach reduces both, the features under test as well as the time for computing all feature combinations to be tested.

References

[1]
M. Calder, M. Kolberg, E. H. Magill, and S. Reiff-Marganiec. Feature Interaction: A Critical Review and Considered Forecast. Comput. Netw., pages 115--141, 2003.
[2]
M. B. Cohen, M. B. Dwyer, and J. Shi. Constructing interaction test suites for highly-configurable systems in the presence of constraints: A greedy approach. IEEE Trans. Softw. Eng., 34 (5): 633--650, 2008.
[3]
K. Czarnecki and E. Ulrich. Generative Programming: Methods, Tools, and Applications: Methods, Techniques and Applications. Addison Wesley Longman, 2005.
[4]
E. N. Haslinger, R. E. Lopez-Herrejon, and A. Egyed. Using Feature Model Knowledge to Speed Up the Generation of Covering Arrays. In Proc. Int'l Workshop Variability Modelling of Software-intensive Systems, pages 16:1--16:6. ACM, 2013.
[5]
M. F. Johansen, O. Haugen, and F. Fleurey. An Algorithm for Generating t-wise Covering Arrays from Large Feature Models. In Proc. Int'l Software Product Line Conference, pages 46--55. ACM, 2012.
[6]
M. F. Johansen, O. Haugen, F. Fleurey, A. Eldegard, and T. Syversen. Generating Better Partial Covering Arrays by Modeling Weights on Sub-product Lines. In Proc. Int'l Conf. Model-driven Eng. Lang. and Sys., pages 269--284. Springer, 2012\natexlabb.
[7]
K. C. Kang, S. G. Cohen, J. A. Hess, W. E. Novak, and S. P. A. Feature-Oriented Domain Analysis (FODA) Feasibility Study. Technical report, Carnegie Mellon University, 1990.
[8]
M. Kowal. Variant Reduction by Representative Subset Selection with Respect to Feature Interactions. Master's thesis, TU Braunschweig, 2012.
[9]
D. R. Kuhn, D. R. Wallace, and A. M. Gallo, Jr. Software Fault Interactions and Implications for Software Testing. phIEEE Trans. Softw. Eng., pages 418--421, 2004.
[10]
Y. Lei, R. Kacker, D. R. Kuhn, V. Okun, and J. Lawrence. IPOG: A General Strategy for T-Way Software Testing. In Proc. Int'l Conf. Engineering of Computer-Based Systems, pages 549--556. IEEE CS, 2007.
[11]
M. Lochau and U. Goltz. Feature Interaction Aware Test Case Generation for Embedded Control Systems. Electronic Notes in Theor. Comp. Sci., pages 37--52, 2010.
[12]
M. Lochau, I. Schaefer, J. Kamischke, and S. Lity. Incremental Model-Based Testing of Delta-Oriented Software Product Lines. In Tests and Proofs, pages 67--82. Springer Berlin Heidelberg, 2012.
[13]
S. Oster. Feature Model-based Software Product Line Testing. PhD thesis, TU Darmstadt, 2011.
[14]
K. Pohl, G. Böckle, and F. van der Linden. Software Product Line Engineering: Foundations, Principles and Techniques. Springer, 2005.
[15]
S. Segura. Automated Analysis of Feature Models using Atomic Sets. In Workshop on Analysis of Software Product Lines, pages 201--207, 2008.

Cited By

View all
  • (2024)MulTi-Wise Sampling: Trading Uniform T-Wise Feature Interaction Coverage for Smaller SamplesProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672589(47-53)Online publication date: 2-Sep-2024
  • (2024)UnWise: High T-Wise Coverage from Uniform SamplingProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634716(37-45)Online publication date: 7-Feb-2024
  • (2023)Migrating Individual Applications into Software Product Lines Using the Mobioos Forge Platform2023 30th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC60848.2023.00060(483-492)Online publication date: 4-Dec-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
VariComp '13: Proceedings of the 4th international workshop on Variability & composition
March 2013
26 pages
ISBN:9781450318679
DOI:10.1145/2451617
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • AOSA: Aspect-Oriented Software Association

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. feature models
  2. software product lines
  3. testing

Qualifiers

  • Research-article

Conference

AOSD '13
Sponsor:
  • AOSA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)4
Reflects downloads up to 17 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)MulTi-Wise Sampling: Trading Uniform T-Wise Feature Interaction Coverage for Smaller SamplesProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3672589(47-53)Online publication date: 2-Sep-2024
  • (2024)UnWise: High T-Wise Coverage from Uniform SamplingProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634716(37-45)Online publication date: 7-Feb-2024
  • (2023)Migrating Individual Applications into Software Product Lines Using the Mobioos Forge Platform2023 30th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC60848.2023.00060(483-492)Online publication date: 4-Dec-2023
  • (2023)On the benefits of knowledge compilation for feature-model analysesAnnals of Mathematics and Artificial Intelligence10.1007/s10472-023-09906-692:5(1013-1050)Online publication date: 6-Nov-2023
  • (2021)Safety, security, and configurable software systemsProceedings of the 25th ACM International Systems and Software Product Line Conference - Volume A10.1145/3461001.3471147(148-159)Online publication date: 6-Sep-2021
  • (2020)YASAProceedings of the 14th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3377024.3377042(1-10)Online publication date: 5-Feb-2020
  • (2019)Automatic refactoring of delta-oriented SPLs to remove-free form and replace-free formInternational Journal on Software Tools for Technology Transfer10.1007/s10009-019-00534-2Online publication date: 23-Sep-2019
  • (2018)A classification of product sampling for software product linesProceedings of the 22nd International Systems and Software Product Line Conference - Volume 110.1145/3233027.3233035(1-13)Online publication date: 10-Sep-2018
  • (2018)Combining Agile Development and Software Product Lines in Automotive: Challenges and Recommendations2018 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC)10.1109/ICE.2018.8436277(1-10)Online publication date: Jun-2018
  • (2017)A novel model-based testing approach for software product linesSoftware and Systems Modeling (SoSyM)10.1007/s10270-016-0516-216:4(1223-1251)Online publication date: 1-Oct-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media