Abstract
The analysis of real software defects data not only helps to identify problems in a project, company, or industry but also enables continuous improvement in technologies and processes. In the Chinese aviation industry, a rigorous software quality assurance procedure is implemented, consisting of following a national process standard, conducting internal tests, expert milestone reviews, and formal documentation of all activities and results. After these quality assurance activities are completed, software systems undergo certification tests conducted by independent third-party centers. Discovering patterns of defects found in certification tests has significant practical implications for the industry on continuous improvement. This paper presents a taxonomy of defect forms based on the real defects found in 10 software systems, using Grounded Theory. The defect forms contain detailed information on how the defects are formed, compared to existing defect types. We then applied and validated this taxonomy on 9 additional software projects, using five software certification engineers independent of this paper. The results demonstrate that the developed taxonomy can describe the forms of 98% of defects found in certification tests. We recommend this taxonomy for process improvement and defect prevention in the aviation industry.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chillarege, R., et al.: Orthogonal defect classification-a concept for in-process measurements. IEEE Trans. Software Eng. 18, 943–956 (1992)
IEEE Standard Association: IEEE 1044–2009—IEEE Standard Classification for Software Anomalies (2009)
Patil, S., Ravindran, B.: Predicting software defect type using concept-based classification. Empir. Softw. Eng. 25(2), 1341–1378 (2020). https://doi.org/10.1007/s10664-019-09779-6
Leszak, M., Perry, D.E., Stoll, D.: Classification and evaluation of defects in a project retrospective. J. Syst. Softw. 61, 173–187 (2002)
Lutz, R.R., Mikulski, I.C.: Empirical analysis of safety-critical anomalies during operations. IEEE Trans. Software Eng. 30, 172–180 (2004)
Silva, N., Vieira, M.: Experience report: orthogonal classification of safety critical issues. In: IEEE 25th International Symposium on Software Reliability Engineering, pp. 156–166. IEEE (2014)
Huang, F., Liu, B., Wang, S., Li, Q.: The impact of software process consistency on residual defects. J. Softw. Evol. Process 27, 625–646 (2015)
IEEE: IEEE Standard Glossary of Software Engineering Terminology, vol. l EEE Std 610.121990. The Institute of Electrical and Electronics Engineers, New York (1990)
Glaser, B.G., Strauss, A.L.: The discovery of grounded theory: Strategies for qualitative research. Aldine, Chicago (1967)
Sjøberg, D.I.K., Dybå, T., Anda, B.C.D., Hannay, J.E.: Building theories in software engineering. In: Shull, F., Singer, J., Sjøberg, D.I.K. (eds.) Guide to advanced empirical software engineering, pp. 312–336. Springer London, London (2008). https://doi.org/10.1007/978-1-84800-044-5_12
Coleman, G., O’Connor, R.: Using grounded theory to understand software process improvement: a study of Irish software product companies. Inf. Softw. Technol. 49, 654–667 (2007)
Saldaña, J.: The coding manual for qualitative researchers. Sage (2012)
Huang, F., Smidts, C.: Causal mechanism graph ─ a new notation for capturing cause-effect knowledge in software dependability. Reliab. Eng. Syst. Saf. 158, 196–212 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Huang, F., Huang, B., Wang, Y., Wang, Y. (2023). A Taxonomy of Software Defect Forms for Certification Tests in Aviation Industry. In: Guiochet, J., Tonetta, S., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2023. Lecture Notes in Computer Science, vol 14181. Springer, Cham. https://doi.org/10.1007/978-3-031-40923-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-40923-3_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40922-6
Online ISBN: 978-3-031-40923-3
eBook Packages: Computer ScienceComputer Science (R0)