Shuai Wang
ABSTRACT
The Cisco Video Conferencing Systems (VCS) Product Line is composed of many distinct products that can be configured in many different ways. The validation of this product line is currently performed manually during test plan design and test executions' scheduling. For example, the testing of a specific VCS product leads to the manual selection of a set of test cases to be executed and scheduled, depending on the functionalities that are available on the product. In this paper, we develop an alternative approach where the variability of the VCS Product Line is captured by a feature model, while the variability within the set of test cases is captured by a component family model. Using the well-known pure::variants tool approach that establishes links between those two models through restrictions, we can obtain relevant test cases automatically for the testing of a new VCS product. The novelty in this paper lies in the design of a large component family model that organizes a complex test cases structure. We envision a large gain in terms of man-power when a new product is issued and needs to be tested before being marketed.
- Cisco Systems. Cisco telepresence codec c90. data sheet. available from http://www.cisco.com. 2010.Google Scholar
- David Benavides Cuevas. On the Automated Analysis of Software Product Lines Using Feature Models. PhD thesis, Universidad de Sevilla, 2007.Google Scholar
- S. Oster; F. Markert; P. Ritter. Automated incremental pairwise testing of software product lines. In Software Product Line Conference(SPLC'10), 2010. Google ScholarDigital Library
- D. R. Kuhn; D. R. Wallace; A. M. Gallo. Software fault interactions and implications for software testing. IEEE Trans. Softw. Eng., 30(6):418--421, 2004. Google ScholarDigital Library
- A. Tevanlinna; J. Taina; R. Kauppinen. Product family testing: a survey. SIGSOFT Softw. Eng. Notes, 29(2):12, 2004. Google ScholarDigital Library
- D. M. Cohen; S. R. Dalal; M. L. Fredman; G. C. Patton. The aetg system: an approach to testing based on combinatorial design. Software Engineering, IEEE Transactions on, 23:437--444, July 1997. Google ScholarDigital Library
- E. Uzuncaova; D. Garcia; S. Khurshid; D.batory. Testing software product lines using incremental test generations. ISSRE. IEEE Computer Society, pages 249--258, 2008. Google ScholarDigital Library
- D. Benavides; S. Segura; A. R. Cortés. Automated analysis of feature models 20 years later: A literature review. Information Systems, (35):615--636, 2010. Google ScholarDigital Library
- A. Metzger; K. Pohl; P. Heymans; P. Y. Schobbens; G. Saval. Disambiguating the documentation of variability in software product lines: A separation of concerns, formalization and automated analysis. In Requirements Engineering Conference, pages 243--253, 2007.Google ScholarCross Ref
- Pure systems GmbH. Variant management with pure::variants. technical white paper. available from http://web.pure-systems.com. 2006.Google Scholar
- K. Czarnecki; M. Antkiewicz. Mapping features to models: A template approach based on superimposed variants. Generative Programming and Component Engineering (GPCE), 3676:422--437, September 2005. Google ScholarDigital Library
- R. Rabiser; P. Grunbacher; D. Dhungana. Supporting product derivation by adapting and augmenting variability models. In Software Product Line Conference, (141--150), September 2007. Google ScholarDigital Library
- J. White; B. Doughtery; D. Schmidt; D. Benavides. Automated reasoning for multi-step software product-line configuration problems. In Software Product Line Conference, pages 11--20, 2009. Google ScholarDigital Library
- K. Czarnecki; S. Helsen; U. W. Eisenecker. Staged configuration through specialization and multilevel configuration of feature models. Software Process: Improvement and Practice, 10(2):143--169, June 2005.Google ScholarCross Ref
- D. Benavides; A. Ruiz-Cortés; P. Trinidad; S. Segura. A survey on the automated analyses of feature models. In Jornadas de Ingenieréa del Software y Bases de Datos (JISBD), pages 367--376, 2006.Google Scholar
- J. White; D. Benavides; D. C. Schmidt; P. Trinidad; B. Dougherty; A. Ruiz-Cortés. Automated diagnosis of feature model configurations. Joural of Systems and Software, 83(7):1094--1107, 2010. Google ScholarDigital Library
- K. Czarnecki; C. Kim; K. Kalleberg. Feature models are views on ontologies. In proceedings of the 10th International Software Product Line Conference (SPLC), pages 41--51, August 2006. Google ScholarDigital Library
- D. Beuche; H. Papajewski; W. Schröder-Preikschat. Variability management with feature models. Science of Computer Programming, 53(3):333--352, 2004. Google ScholarDigital Library
- M. B. Cohen; M. B. Dwyer; J. Shi. Constructing interaction test suites for highly-configurable systems in the presence of constraints: A greedy approach. IEEE Transactions on Software Engineering, 34(5):633--650, July 2008. Google ScholarDigital Library
- G. Perrouin; S. Sen; J. Klein; B. Baudry; Y. le Traon. Automated and scalable t-wise test case generation strategies for software product lines. Software Testing, Verification and Validation (ICST), pages 459--468, 2010. Google ScholarDigital Library
- Pure systems GmbH. pure::variant user's guide. available from http://web.pure-systems.com. 2011.Google Scholar
Index Terms
- Automatic selection of test execution plans from a video conferencing system product line
Recommendations
Automated product line test case selection: industrial case study and controlled experiment
Automated test case selection for a new product in a product line is challenging due to several reasons. First, the variability within the product line needs to be captured in a systematic way; second, the reusable test cases from the repository are ...
Regression Test Selection and Product Line System Testing
ICST '10: Proceedings of the 2010 Third International Conference on Software Testing, Verification and ValidationContext: Software product lines (SPL) are used in industry to achieve more efficient software development. To test a SPL is complex and costly and often becomes a bottleneck in the product line organization. Objective: This research aims to develop and ...
A systematic test case selection methodology for product lines: results and insights from an industrial case study
In the context of product lines, test case selection aims at obtaining a set of relevant test cases for a product from the entire set of test cases available for a product line. While working on a research-based innovation project on automated testing ...
Comments