skip to main content
10.1145/2791060.2791095acmotherconferencesArticle/Chapter ViewAbstractPublication PagessplcConference Proceedingsconference-collections
research-article

Test control algorithms for the validation of cyber-physical systems product lines

Published: 20 July 2015 Publication History

Abstract

Cyber-Physical Systems (CPSs) product lines appear in a wide range of applications of different domains (e.g., car's doors' windows, doors of a lift, etc.). The variability of these systems is large and as a result they can be configured into plenty of configurations. Testing each of the configurations can be time consuming as not only software has to be simulated, but also the hardware and the physical layer of the CPS, which is often modelled with complex mathematical models. Choosing the adequate test control strategy is critical when testing CPSs product lines. This paper presents a set of test control algorithms organized in an architecture of three layers (domain, application and simulation) for testing CPSs product lines. An illustrative example of a CPS product line is presented and three experiments are conducted to measure the performance of the proposed test control algorithms. We conclude that test scheduling and test suite minimization significantly help to reduce the overall test costs while preserving the test quality in CPSs product lines. In addition, we conclude that knowing the results of the previously tested configurations permits reducing the time for the detection of anomalous designs.

References

[1]
P. Derler, E. A. Lee, and A. Sangiovanni-Vincentelli, "Modeling cyber-physical systems," Proceedings of the IEEE (special issue on CPS), vol. 100, no. 1, pp. 13--28, January 2011.
[2]
J. V. Gurp, J. Bosch, and M. Svahnberg, "On the notion of variability in software product lines," in Proceedings of the Working IEEE/IFIP Conference on Software Architecture, ser. WICSA '01. Washington, DC, USA: IEEE Computer Society, 2001, pp. 45--54.
[3]
S. Thiel and A. Hein, "Systematic integration of variability into product line architecture design," in SPLC, 2002, pp. 130--153.
[4]
R. Kuhn, R. Kacker, Y. Lei, and J. Hunter, "Combinatorial software testing," Computer, vol. 42, pp. 94--96, 2009.
[5]
K. Nie, T. Yue, S. Ali, L. Zhang, and Z. Fan, "Constraints: The core of supporting automated product configuration of cyber-physical systems," in ACM/IEEE 16th International Conference on Model Driven Engineering Languages and Systems, 2013, pp. 370--387.
[6]
A. Heuer and K. Pohl, "Structuring variability in the context of embedded systems during software engineering," in Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems, ser. VaMoS '14. New York, NY, USA: ACM, 2014, pp. 21:1--21:8.
[7]
M. Galster, D. Weyns, D. Tofan, B. Michalik, and P. Avgeriou, "Variability in software systems - a systematic literature review," IEEE Transactions on Software Engineering, vol. 40, pp. 282--306, 2014.
[8]
D. Van Landuyt, S. Op de beeck, A. Hovsepyan, S. Michiels, W. Joosen, S. Meynckens, G. de Jong, O. Barais, and M. Acher, "Towards managing variability in the safety design of an automotive hall effect sensor," in Proceedings of the 18th International Software Product Line Conference - Volume 1, ser. SPLC '14. New York, NY, USA: ACM, 2014, pp. 304--309.
[9]
M. Al-Hajjaji, T. Thüm, J. Meinicke, M. Lochau, and G. Saake, "Similarity-based prioritization in software product-line testing," in Proceedings of the 18th International Software Product Line Conference - Volume 1, ser. SPLC '14. New York, NY, USA: ACM, 2014, pp. 197--206.
[10]
S. Wang, S. Ali, and A. Gotlieb, "Minimizing test suites in software product lines using weight-based genetic algorithms," in Proceedings of the 2013 Genetic and Evolutionary Computation Conference, Amsterdam, Netherlands, 2013, pp. 1493--1500.
[11]
T. Thuem, C. Kastner, F. Benduhn, J. Meinicke, G. Saake, and T. Leich, "Featureide: An extensible framework for feature-oriented software development," Science of Computer Programming, vol. 79, pp. 70--85, 2014.
[12]
M. F. Johansen, O. Haugen, and F. Fleurey, "An algorithm for generating t-wise covering arrays from large feature models," in Proceedings of the 16th International Software Product Line Conference - Volume 1, ser. SPLC '12. New York, NY, USA: ACM, 2012, pp. 46--55.
[13]
M. B. Cohen, M. B. Dwyer, and J. Shi, "Exploiting constraint solving history to construct interaction test suites," in Testing: Academic and Industrial Conference Practice and Research Techniques, TAIC PART-Mutation 2007, Windsor, United kingdom, 2007, pp. 121--130.
[14]
A. Arrieta, G. Sagardui, and L. Etxeberria, "A configurable test architecture for the automatic validation of variability-intensive cyber-physical systems," in VALID 2014: The Sixth International Conference on Advances in System Testing and Validation Lifecycle, 2014, pp. 79--83.
[15]
J. Zander-Nowicka, "Model-based testing of real-time embedded systems in the automotive domain," Ph.D. dissertation, Technical University Berlin, 2008.
[16]
A. B. Sánchez, S. Segura, and A. Ruiz-Cortés, "A comparison of test case prioritization criteria for software product lines," in IEEE International Conference on Software Testing, Verification, and Validation, 2014, pp. 41--50.
[17]
X. Qu, M. B. Cohen, and G. Rothermel, "Configuration-aware regression testing: An empirical study of sampling and prioritization," in Proceedings of the 2008 International Symposium on Software Testing and Analysis, ser. ISSTA '08. New York, NY, USA: ACM, 2008, pp. 75--86.
[18]
H. Wu, C. Nie, and F.-C. Kuo, "Test suite prioritization by switching cost," in The 3rd International Workshop on Combinatorial Testing (IWCT 2014), 2014.
[19]
C. Catal and D. Mishra, "Test case prioritization: A systematic mapping study," Software Quality Control, vol. 21, no. 3, pp. 445--478, Sep. 2013.

Cited By

View all
  • (2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
  • (2021)Survey on test case generation, selection and prioritization for cyber‐physical systemsSoftware Testing, Verification and Reliability10.1002/stvr.179432:1Online publication date: 15-Sep-2021
  • (2018)Internet of Medical Things: A Review of Recent Contributions Dealing With Cyber-Physical Systems in MedicineIEEE Internet of Things Journal10.1109/JIOT.2018.28490145:5(3810-3822)Online publication date: Oct-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SPLC '15: Proceedings of the 19th International Conference on Software Product Line
July 2015
460 pages
ISBN:9781450336130
DOI:10.1145/2791060
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

  • Vanderbilt University: Vanderbilt University
  • Biglever: BigLever Software, Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. cyber-physical systems product lines
  2. product line engineering
  3. testing
  4. validation

Qualifiers

  • Research-article

Conference

SPLC '15
Sponsor:
  • Vanderbilt University
  • Biglever

Acceptance Rates

SPLC '15 Paper Acceptance Rate 34 of 87 submissions, 39%;
Overall Acceptance Rate 167 of 463 submissions, 36%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)1
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Software product line testing: a systematic literature reviewEmpirical Software Engineering10.1007/s10664-024-10516-x29:6Online publication date: 2-Sep-2024
  • (2021)Survey on test case generation, selection and prioritization for cyber‐physical systemsSoftware Testing, Verification and Reliability10.1002/stvr.179432:1Online publication date: 15-Sep-2021
  • (2018)Internet of Medical Things: A Review of Recent Contributions Dealing With Cyber-Physical Systems in MedicineIEEE Internet of Things Journal10.1109/JIOT.2018.28490145:5(3810-3822)Online publication date: Oct-2018
  • (2018)A Systematic Mapping Study on the Verification of Cyber-Physical SystemsIEEE Access10.1109/ACCESS.2018.28720156(59043-59064)Online publication date: 2018
  • (2018)Automatic generation of test system instances for configurable cyber-physical systemsSoftware Quality Journal10.1007/s11219-016-9341-725:3(1041-1083)Online publication date: 24-Dec-2018
  • (2017)Multiplex: A co-simulation architecture for elevators validation2017 IEEE International Workshop of Electronics, Control, Measurement, Signals and their Application to Mechatronics (ECMSM)10.1109/ECMSM.2017.7945883(1-6)Online publication date: May-2017
  • (2016)Search-based test case selection of cyber-physical system product lines for simulation-based validationProceedings of the 20th International Systems and Software Product Line Conference10.1145/2934466.2946046(297-306)Online publication date: 16-Sep-2016
  • (2016)PLE for automotive braking system with management of impacts from equipment interactionsProceedings of the 20th International Systems and Software Product Line Conference10.1145/2934466.2934490(232-241)Online publication date: 16-Sep-2016
  • (2016)Test Case Prioritization of Configurable Cyber-Physical Systems with Weight-Based Search AlgorithmsProceedings of the Genetic and Evolutionary Computation Conference 201610.1145/2908812.2908871(1053-1060)Online publication date: 20-Jul-2016

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media