Abstract
In this paper we discuss the current state of product family testing. Testing, unlike other areas of software development, has received only little attention in this context despite the problems directly rising from scale, reuse and variability. We present the current approaches to product family testing methodology and processes. We also evaluate the current state-of-the-art in product family testing and highlight problems that need to be addressed in the future.
- {Bei90} Boris Beizer. Software Testing Techniques, 2nd ed. Van Nostrand Reinhold, 1990. Google ScholarDigital Library
- {BG03} Antonia Bertolino and Stefania Gnesi. Use casebased testing of product lines. In Proceedings of the 9th European software engineering conference held jointly with 10th ACM SIGSOFT international symposium on Foundations of software engineering, pages 355--358, 2003. Google ScholarDigital Library
- {Bin00} Robert V. Binder. Testing Object-Oriented Systems. Wiley, 2000.Google Scholar
- {Bos00} Jan Bosch. Design and Use of Software Architectures. Addison-Wesley, 2000.Google ScholarDigital Library
- {DHS02} Nigel Daley, Daniel Hoffman, and Paul Strooper. A framework for table driven testing of Java classes. Software - Practice and Experience, 32(5): 465--493, April 2002. Google ScholarDigital Library
- {FHB00} Mohamed E. Fayad, David S. Hamu, and Davide Brugali. Enterprise frameworks characteristics, criteria, and challanges. Communications of the ACM, 43(10): 39--46, October 2000. Google ScholarDigital Library
- {GB99} Erich Gamma and Kent Beck. Junit: A cook's tour. Java Report, 4(5): 27--38, May 1999.Google Scholar
- {HW02} Daniel Hoffman and Sarah Wilkin. Junit extensions for documentation and inheritance. In Proceedings of the 20th Pacific Northwest Software Quality Conference, pages 71--84, 2002.Google Scholar
- {Jaa02} Ari Jaaksi. Developing mobile browsers in a product line. IEEE Software, 19(4): 73--80, July/August 2002. Google ScholarDigital Library
- {Jaa03} Ari Jaaksi. Assessing software projects: tools for business owners. In Proceedings of the 9th European software engineering conference held jointly with 10th ACM SIGSOFT international symposium on Foundations of software engineering, pages 15--18, 2003. Google ScholarDigital Library
- {JRvdL00} Mehdi Jazayeri, Alexander Ran, and Frank van der Linden. Software Architecture for Product Families: Principles and Practices. Addison-Wesley, 2000. Google ScholarDigital Library
- {Kau03} Raine Kauppinen. Testing framework-based software product lines. Master's thesis, University of Helsinki, Department of Computer Science, 2003.Google Scholar
- {KT03} Raine Kauppinen and Juha Taina. Rita environment for testing framework-based software product lines. In Proceedings of the Eighth Symposium on Programming Languages and Software Tools, pages 58--69, June 2003.Google Scholar
- {McG01a} John D. McGregor. A Practical Guide to Testing Object-Oriented Software. Addison Wesley, 2001. Google ScholarDigital Library
- {McG01b} John D. McGregor. Structuring Test Assets in a Product Line Effort. In Proceedings of the Second International Workshop on Software Product Lines: Economics, Architectures, and Implications, pages 89--92, May 2001.Google Scholar
- {McG01c} John D. McGregor. Testing a software product line. Technical Report CMU/SEI-2001-TR-022, Software Engineering Institute, Carnegie Mellon University, December 2001.Google ScholarCross Ref
- {Mus96} John D. Musa. Software-reliability-engineered testing. Computer, 29(11): 61--68, November 1996. Google ScholarDigital Library
- {MvdH03} Henry Muccini and Andr van der Hoek. Towards testing product line architectures. In Electronic Notes in Theoretical Computer Science, volume 82. Elsevier, 2003.Google Scholar
- {Nor02} Linda M. Northrop. SEI's software product line tenets. IEEE Software, 19(4): 32--40, July/August 2002. Google ScholarDigital Library
- {Nor03} Linda M. Northrop. A framework for software product line practice - version 4.1. Technical report, Software Engineering Institute, Carnegie Mellon University, 2003. URL: http://www.sei.cmu.edu/plp/framework.html {November 11, 2003}.Google Scholar
- {RRKP03} Andreas Reuys, Sacha Reis, Erik Kamsties, and Klaus Pohl. Derivation of domain test scenarios from activity diagrams. In Proceedings of the International Workshop on Product Line Engineering The Early Steps: Planning, Modeling, and Managing (PLEES'03), 2003.Google Scholar
- {Szy98} Clemens A. Szyperski. Component Software. Addison Wesley, 1998.Google Scholar
- {vdL02} Frank van der Linden. Software product families in Europe: The Esaps & Caféé Projects. IEEE Software, 19(4): 41--49, July/August 2002. Google ScholarDigital Library
- {vGB01} Jilles van Gurp and Jan Bosch. Design, implementation and evolution of object oriented frameworks: concepts and guidelines. Software - Practice and Experience, 31(3): 277--300, March 2001. Google ScholarDigital Library
- {Wey98} Elaine J. Weyuker. Testing component-based software: A cautionary tale. IEEE Software, 15(5): 54--59, September 1998. Google ScholarDigital Library
Index Terms
- Product family testing: a survey
Recommendations
Incremental model-based testing of delta-oriented software product lines
TAP'12: Proceedings of the 6th international conference on Tests and ProofsSoftware product line (SPL) engineering provides a promising approach for developing variant-rich software systems. But, testing of every product variant in isolation to ensure its correctness is in general not feasible due to the large number of ...
Multistage configuration trees for managing product family trees
SPLC '13: Proceedings of the 17th International Software Product Line ConferenceIt is not unusual for commercial product line organizations to manufacture millions of product instances every year, in thousands of different "flavors". The scale and scope of diversity in product lines of this size can be high, creating significant ...
Delta-oriented product prioritization for similarity-based product-line testing
VACE '17: Proceedings of the 2nd International Workshop on Variability and Complexity in Software DesignTesting every product of a software product line (SPL) is often not feasible due to the exponential number of products in the number of features. Thus, the order in which products are tested matters, because it can increase the early rate of fault ...
Comments