loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Muhammad Zafar ; Wasif Afzal and Eduard Enoiu

Affiliation: Mälardalen University, Sweden

Keyword(s): System-Level Tests, Safety-Critical Software, Fault Detection Effectiveness.

Abstract: Combinatorial Testing (CT) and Model-Based Testing (MBT) are two recognized test generation techniques. The evidence of their fault detection effectiveness and comparison with industrial state-of-the-practice is still scarce, more so at the system level for safety-critical systems, such as those found in trains. We use mutation analysis to perform a comparative evaluation of CT, MBT, and industrial manual testing in terms of their fault detection effectiveness using an industrial case study of the safety-critical train control management system. We examine the fault detection rate per mutant and relationship between the mutation scores and structural coverage using Modified Condition Decision Coverage (MC/DC). Our results show that CT 3-ways, CT 4-ways, and MBT provide higher mutation scores. MBT did not perform better in detecting ‘Logic Replacement Operator-Improved’ mutants when compared with the other techniques, while manual testing struggled to find ‘Logic Block Replacement Ope rator’ mutants. None of the test suites were able to find ‘Time Block Replacement Operator’ mutants. CT 2-ways was found to be the least effective test technique. MBT-generated test suite achieved the highest MC/DC coverage. We also found a generally consistent positive relationship between MC/DC coverage and mutation scores for all test suites. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.138.33.178

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Zafar, M.; Afzal, W. and Enoiu, E. (2023). An Empirical Evaluation of System-Level Test Effectiveness for Safety-Critical Software. In Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE; ISBN 978-989-758-647-7; ISSN 2184-4895, SciTePress, pages 293-305. DOI: 10.5220/0011756800003464

@conference{enase23,
author={Muhammad Zafar. and Wasif Afzal. and Eduard Enoiu.},
title={An Empirical Evaluation of System-Level Test Effectiveness for Safety-Critical Software},
booktitle={Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE},
year={2023},
pages={293-305},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011756800003464},
isbn={978-989-758-647-7},
issn={2184-4895},
}

TY - CONF

JO - Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE
TI - An Empirical Evaluation of System-Level Test Effectiveness for Safety-Critical Software
SN - 978-989-758-647-7
IS - 2184-4895
AU - Zafar, M.
AU - Afzal, W.
AU - Enoiu, E.
PY - 2023
SP - 293
EP - 305
DO - 10.5220/0011756800003464
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic