Abstract
Product line (PL) engineering is an emerging methodology for the development of variant-rich systems. As product lines are viable for this purpose, testing them is complicated in contrast to non-variable systems, as there is an increasing amount of possible products due to the number of features. The question of which products should be chosen for testing is still an ongoing challenge.
We present coverage criteria for sampling configurations from reusable test cases. Such criteria are e.g. choosing as many different products as possible so each of the test cases can be executed once. The main contribution is an analysis of the resulting fault detection potential for the presented criteria. The analysis is supported by an example product line and a mutation system for assessing the fault detection capability. From the results of this example, we draw conclusions about the different coverage criteria.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Batory, D.: Feature models, grammars, and propositional formulas. In: Obbink, H., Pohl, K. (eds.) SPLC 2005. LNCS, vol. 3714, pp. 7–20. Springer, Heidelberg (2005)
Beohar, H., Mousavi, M.R.: Spinal test suites for software product lines France. In: Proceedings Ninth Workshop on Model-based Testing, MBT 2014, EPTCS, vol. 141, pp. 44–55 (2014)
Czarnecki, K., Antkiewicz, M.: Mapping features to models: a template approach based on superimposed variants. In: Glück, R., Lowry, M. (eds.) GPCE 2005. LNCS, vol. 3676, pp. 422–437. Springer, Heidelberg (2005)
DeMillo, R.A.: Mutation analysis as a tool for software quality assurance (1980)
Grönniger, H., Krahn, H., Pinkernell, C., Rumpe, B.: Modeling variants of automotive systems using views. In: Tagungsband zur Modellierung 2008, Berlin-Adlershof, Deutschland, M"arz 2008, pp. 12–14. LNI, Gesellschaft für Informatik, Bonn (2008)
Henard, C., Papadakis, M., Perrouin, G., Klein, J., Le Traon, Y.: Assessing software product line testing via model-based mutation: an application to similarity testing. In: ICSTW 2013: IEEE 6th International Conference On Software Testing, Verification and Validation Workshops 2013, pp. 188–197 (2013)
Johansen, M.F., Haugen, Ø., Fleurey, F., Carlson, E., Endresen, J., Wien, T.: A technique for agile and automatic interaction testing for product lines. In: Nielsen, B., Weise, C. (eds.) ICTSS 2012. LNCS, vol. 7641, pp. 39–54. Springer, Heidelberg (2012)
Kang, K.C., Cohen, S.G., Hess, J.A., Novak, W.E., Peterson, A.S.: Feature-oriented Domain Analysis (FODA) Feasibility Study (1990)
Kuchcinski, K., Szymanek, R.: JaCoP - Java Constraint Programming Solver (2013)
Lackner, H., Schmidt, M.: Towards the assessment of software product line tests. In: The 18th International Software Product Line Conference, pp. 62–69 (2014)
Lackner, H., Thomas, M., Wartenberg, F., Weißleder, S.: Model-based test design of product lines: raising test design to the product line level. In: ICST 2014: International Conference on Software Testing, Verification, and Validation, pp. 51–60 (2014)
Lochau, M., Schaefer, I., Kamischke, J., Lity, S.: Incremental model-based testing of delta-oriented software product lines. In: Brucker, A.D., Julliand, J. (eds.) TAP 2012. LNCS, vol. 7305, pp. 67–82. Springer, Heidelberg (2012)
Oster, S., Zorcic, I., Markert, F., Lochau, M.: MoSo-PoLiTe: tool support for pairwise and model-based software product line testing. In: VaMoS 2011, pp. 79–82 (2011)
Perrouin, G., Sen, S., Klein, J., Baudry, B., Le Traon, Y.: Automated and scalable t-wise test case generation strategies for software product lines. In: ICST 2010: International Conference on Software Testing, Verification and Validation, pp. 459–468. IEEE Computer Society, IEEE, Los Alamitos, Calif, Piscataway, NJ (2010)
Pohl, K., Böckle, G., van der Linden, F.J.: Software Product Line Engineering: Foundations, Principles and Techniques. Springer, New York (2005)
Steffens, M., Oster, S., Lochau, M., Fogdal, T.: Industrial evaluation of pairwise SPL testing with MoSo-PoLiTe. In: The Sixth International Workshop, pp. 55–62 (2012)
Weißleder, S.: Simulated Satisfaction of coverage criteria on UML state machines. In: ICST 2010: International Conference on Software Testing, Verification and Validation. IEEE Computer Society, IEEE, Los Alamitos, Calif, Piscataway, NJ (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Lackner, H. (2015). Model-Based Product Line Testing: Sampling Configurations for Optimal Fault Detection. In: Fischer, J., Scheidgen, M., Schieferdecker, I., Reed, R. (eds) SDL 2015: Model-Driven Engineering for Smart Cities. SDL 2015. Lecture Notes in Computer Science(), vol 9369. Springer, Cham. https://doi.org/10.1007/978-3-319-24912-4_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-24912-4_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24911-7
Online ISBN: 978-3-319-24912-4
eBook Packages: Computer ScienceComputer Science (R0)