Abstract
Space systems are developed using conservative technologies and processes and respecting requirements and restrictions imposed by specific standards, domain policies, and design and optimization constraints. However, the artefacts produced at each lifecycle phase are not perfect. To overcome this, Independent Software Verification and Validation (ISVV) represents a valuable asset to detect issues, but, a proper and efficient issue classification system is necessary to analyze the root causes, identify the development processes to improve, and assess the efficiency of verification activities. The Orthogonal Defect Classification (ODC) is the most commonly used and adopted classification scheme, but was not originally targeted to engineering issues in critical systems. In this paper we present an empirical study where ODC has been used to classify space domain issues and propose an adaptation of the taxonomy for space systems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
ODC was selected since it was the only taxonomy claiming to be orthogonal, quite mature and widely used (several academic and industrial publications refer to and use ODC).
References
RTCA DO-178B (EUROCAE ED-12B), Software Considerations in Airborne Systems and Equipment Certification, RTCA Inc., Washington, DC, December 1992
CENELEC EN 50128: Railway applications - Communication, signalling and processing systems - Software for railway control and protection systems
ECSS-E-ST-40C, Space engineering - Software, ECSS, 06/03/2009
ECSS-Q-ST-80, Space Product Assurance - Software Product Assurance, ECSS, 06/03/2009
ESA ISVV Guide, issue 2.0, 29/12/2008, European Space Agency
Orthogonal Defect Classification v 5.2 for Software Design and Code, IBM, 12 September 2013
IEEE 1012-2004 - IEEE Standard for Software Verification and Validation. IEEE Computer Society
ISO/IEC 12207:2008 Systems and software engineering – Software life cycle processes
Jones, M.: Software Engineering: Are we getting better at it? ESA Bulletin 121, 52–57 (2005)
Leszak, M., Perry, D.E., Stoll, D.: Classification and evaluation of defects in a project retrospective. J. Syst. Softw. 61, 173–187 (2002)
Leszak, M., Perry, D.E., Stoll, D.: A case study in root cause defect analysis. In: Proceedings of 22nd International Conference SW Engineering (ICSE’OO), pp. 428–437. IEEE CS Press, Los Alamitos (2002)
Margarido, L., João Pascoal, I., Raul, F., Vidal, M., Vieira, M.: Classification of defect types in requirements specifications: literature review, proposal and assessment. In: 2011 6th Iberian Conference on Information Systems and Technologies (CISTI), pp. 1–6. IEEE (2011). http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5974237
Li, N., Li, Z., Sun, X.: Classification of software defect detected by black-box testing: an empirical study. In: 2010 Second World Congress on Software Engineering (WCSE), Wuhan, pp. 234–240 (2010). doi:10.1109/WCSE.2010.28
Lutz, R.R., Mikulski, I.C.: Empirical analysis of safety-critical anomalies during operations. IEEE Trans. Softw. Eng. 30(3), 172–180 (2004)
Lutz, R.: Analyzing software requirements errors in safety-critical, embedded systems. In: Proceedings of IEEE International Symposium Requirements Engineering, pp. 126–133. IEEE CS Press (1993)
Lutz, R., Mikulski, I.C.: Operational anomalies as a cause of safety-critical requirements evolution. J. Syst. Softw. 65, 155–161 (2003)
Seaman, C.B., Shull, F., Regardie, M., Elbert, D., Feldmann, R.L., Guo, Y., Godfrey, S.: Defect categorization: making use of a decade of widely varying historical data. In: Proceedings of the Second ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, pp. 149–57. ACM (2008). http://dl.acm.org/citation.cfm?id=1414030
Silva, N., Rui, L.: Independent test verification: what metrics have a word to say. In: 1st International Workshop on Software Certification (WoSoCER), ISSRE, Hiroshima, Japan, 30 November 2011
Silva, N.; Lopes, R.: Overview of 10 years of ISVV findings in safety-critical systems. In: 2012 IEEE 23rd International Symposium on Software Reliability Engineering Work-shops (ISSREW), p. 83, 27–30 November 2012
Silva, N.; Lopes, R.: Independent assessment of safety-critical systems: we bring data!. In: 2012 IEEE 23rd International Symposium on Software Reliability Engineering Workshops (ISSREW), p. 84, 27–30 November 2012
Silva, N., Lopes, R.: 10 years of ISVV: what’s next? In: 2012 IEEE 23rd International Symposium on Software Reliability Engineering Workshops (ISSREW), pp. 361–366, 27–30 November 2012
Diego, V., Grazioli, F., Herbert, J.: A framework to evaluate defect taxonomies. In: XV Congreso Argentino de Ciencias de La Computación (2009). http://sedici.unlp.edu.ar/handle/10915/20983
Stefan, W.: Defect classification and defect types revisited. In: Proceedings of the 2008 Workshop on Defects in Large Software Systems, pp. 39–40. ACM (2008). http://dl.acm.org/citation.cfm?id=1390829
Wagner, S.: A model and sensitivity analysis of the quality economics of defect-detection techniques. In: Proceedings of ISSTA 2006, pp. 73–83. ACM Press (2006)
Copeland L.: Software Defect Taxonomies. http://flylib.com/books/en/2.156.1.108/1/
Grady, R.B.: Practical Software Metrics For Project Management and Process Improvement. HP (1992)
IEEE: IEEE 1044-2009 Standard Classification for Software Anomalies. Institute of Electrical and Electronics Engineers, 7 January 2010
Acknowledgements
This work has been partially supported by the European Project FP7-2012-324334-CECRIS (CErtification of CRItical Systems).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Silva, N., Vieira, M. (2016). Adapting the Orthogonal Defect Classification Taxonomy to the Space Domain. In: Skavhaug, A., Guiochet, J., Bitsch, F. (eds) Computer Safety, Reliability, and Security. SAFECOMP 2016. Lecture Notes in Computer Science(), vol 9922. Springer, Cham. https://doi.org/10.1007/978-3-319-45477-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-45477-1_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-45476-4
Online ISBN: 978-3-319-45477-1
eBook Packages: Computer ScienceComputer Science (R0)