skip to main content
10.1145/2591062.2591178acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
Article

Objective safety compliance checks for source code

Published: 31 May 2014 Publication History

Abstract

Safety standards such as IEC 61508 are an important instrument for developing safety-critical systems. They provide requirements and recommendations to assist engineers in system and software development. Nevertheless, applying this standard in practice is difficult due to unclear requirements and unclear or missing acceptance criteria. We systematically developed a quality model including proper measurement support that covers the code-related parts of IEC 61508 in [20]. In this paper, we present the assessment approach for automatic compliance checks of the code-related parts of the standard. We find in a validation study that the assessment results obtained by applying this approach to real-world projects are in line with their externally granted certification. The results are valid for the vast majority of the modeled elements of the standard. Moreover, by drilling down into the assessment results, we are able to detect deficiencies in the certified real-world projects.

References

[1]
Barron, F.H. and Barrett, B.E. 1996. Decision Quality Using Ranked Attribute Weights. Management Science. 42, 11 (1996), 1515–1523.
[2]
Basili, V.R., Briand, L. and Melo, W.L. 1996. A validation of object-oriented design metrics as quality indicators. IEEE Transactions on Software Engineering. 22, 10 (Oct. 1996), 751–761.
[3]
Briand, L., Wüst, J., Daly, J.W. and Porter, D.V. 2000. Exploring the Relationships between Design Measures and Software Quality in Object-Oriented Systems. Journal of Systems and Software. 51, 3 (2000), 245–273.
[4]
CASS Scheme Ltd 2009. CASS Templates for Software Requirements in Relation to IEC 61508 Part 3 – Safety Function Assessment.
[5]
Dautovic, A. 2012. Automatic Measurement of Software Documentation Quality. Johannes Kepler University Linz.
[6]
de la Vara, J.L., Nair, S., Verhulst, E., Studzizba, J., Pepek, P., Lambourg, J. and Sabetzadeh, M. 2012. Towards a Model-Based Evolutionary Chain of Evidence for Compliance with Safety Standards. Computer Safety, Reliability, and Security. F. Ortmeier and P. Daniel, eds. Springer Berlin Heidelberg. 64–78.
[7]
Falessi, D., Sabetzadeh, M., Briand, L., Turella, E., Coq, T. and Panesar-Walawege, R.K. 2012. Planning for Safety Standards Compliance: A Model-Based Tool-Supported Approach. IEEE Software. 29, 3 (2012), 64–70.
[8]
Graydon, P., Habli, I., Hawkins, R., Kelly, T. and Knight, J. 2012. Arguing Conformance. IEEE Software. 29, 3 (2012), 50–57.
[9]
Gruber, H. 2010. Benchmarking-oriented Assessment of Source Code Quality - An Approach for Automatic Assessments using Static Code Analysis Tools. Johannes Kepler University Linz.
[10]
Habli, I., Hawkins, R. and Kelly, T. 2010. Software safety : relating software assurance and software integrity. International Journal of Critical Computer-Based Systems. 1, 4 (2010), 364–383.
[11]
Hawkins, R., Kelly, T., Knight, J. and Graydon, P. 2011. A New Approach to Creating Clear Safety Arguments. Advances in Systems Safety. C. Dale and T. Anderson, eds. Springer London. 3–23.
[12]
Huhn, M. and Zechner, A. 2010. Arguing for Software Quality in an IEC 62304 Compliant Development Process. Leveraging Applications of Formal Methods, Verification, and Validation. T. Margaria and B. Steffen, eds. Springer Berlin Heidelberg. 296–311.
[13]
IEC 61508:2010: Functional safety of electrical/electronical/programmable electronic safety-related systems.
[14]
Keeney, R.L. and Raiffa, H. 1993. Decisions with Multiple Objectives: Preferences and Value Tradeoffs. Cambridge University Press.
[15]
Kelly, T. 1998. Arguing Safety – A Systematic Approach to Managing Safety Cases. University of York.
[16]
Leveson, N.G. 2004. The Role of Software in Spacecraft Accidents. AIAA Journal. 41, 4 (2004), 1–27.
[17]
Lloyd, M.H. and Reeve, P.J. 2009. IEC 61508 and IEC 61511 assessments - some lessons learned. 4th IET International Conference on Systems Safety 2009. Incorporating the SaRS Annual Conference (2009), 1–6.
[18]
Lochmann, K. 2012. A Benchmarking-inspired Approach to Determine Threshold Values for Metrics. ACM SIGSOFT Software Engineering Notes. 37, 6 (Nov. 2012), 1–8.
[19]
Mayr, A. 2013. An Approach for Evaluating Functional Safety of Software in the Context of IEC 61508. Johannes Kepler University.
[20]
Mayr, A., Plösch, R. and Saft, M. 2013. Objective Measurement of Safety in the Context of IEC 61508-3. Proceedings of the 39th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) (Santander, 2013).
[21]
Mayr, A., Plösch, R., Kläs, M., Lampasona, C. and Saft, M. 2012. A Comprehensive Code-based Quality Model for Embedded Systems - Systematic Development and Validation by Industrial Projects. Proceedings of the IEEE 23rd International Symposium on Software Reliability Engineering (ISSRE 2012) (Dallas, USA, 2012).
[22]
Panesar-Walawege, R.K., Sabetzadeh, M. and Briand, L. 2011. A Model-Driven Engineering Approach to Support the Verification of Compliance to Safety Standards. 2011 IEEE 22nd International Symposium on Software Reliability Engineering (2011), 30–39.
[23]
Plösch, R., Gruber, H., Pomberger, G., Saft, M. and Schiffer, S. 2008. Tool Support for Expert-Centred Code Assessments. 2008 International Conference on Software Testing, Verification, and Validation. 1, 1 (Apr. 2008), 258– 267.
[24]
Shatnawi, R. 2010. A Quantitative Investigation of the Acceptable Risk Levels of Object-Oriented Metrics in Open-Source Systems. IEEE Transactions on Software Engineering. 36, 2 (2010), 216–225.
[25]
Trendowicz, A., Kläs, M., Lampasona, C., Münch, J., Körner, C. and Saft, M. 2010. Model-based Product Quality Evaluation with Multi-Criteria Decision Analysis. Proceedings of the joined International Conferences on Software Measurement. IWSM/MetriKon/Mensura 2010 (2010), 3–20.
[26]
Wagner, S., Lochmann, K., Heinemann, L., Kläs, M., Trendowicz, A., Plösch, R., Seidl, A., Göb, A. and Streit, J. 2012. The Quamoco Product Quality Modelling and Assessment Approach. Proceedings of the 34th International Conference on Software Engineering ICSE 12 (2012).
[27]
Watson, A.H. and McCabe, T.J. 1996. Structured Testing: A Testing Methodology Using Cyclomatic Complexity Metric.

Cited By

View all
  • (2019)WSQFProceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice10.1109/ICSE-SEIP.2019.00045(312-321)Online publication date: 27-May-2019
  • (2019)Software quality assessment model: a systematic mapping studyScience China Information Sciences10.1007/s11432-018-9608-362:9Online publication date: 26-Jul-2019
  • (2017)A Systematic Mapping Study of Quality Assessment Models for Software Products2017 International Conference on Software Analysis, Testing and Evolution (SATE)10.1109/SATE.2017.16(63-71)Online publication date: Nov-2017
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ICSE Companion 2014: Companion Proceedings of the 36th International Conference on Software Engineering
May 2014
741 pages
ISBN:9781450327688
DOI:10.1145/2591062
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

  • TCSE: IEEE Computer Society's Tech. Council on Software Engin.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. IEC 61508
  2. empirical validation
  3. quality assessment
  4. safety
  5. software quality model

Qualifiers

  • Article

Conference

ICSE '14
Sponsor:

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2019)WSQFProceedings of the 41st International Conference on Software Engineering: Software Engineering in Practice10.1109/ICSE-SEIP.2019.00045(312-321)Online publication date: 27-May-2019
  • (2019)Software quality assessment model: a systematic mapping studyScience China Information Sciences10.1007/s11432-018-9608-362:9Online publication date: 26-Jul-2019
  • (2017)A Systematic Mapping Study of Quality Assessment Models for Software Products2017 International Conference on Software Analysis, Testing and Evolution (SATE)10.1109/SATE.2017.16(63-71)Online publication date: Nov-2017
  • (2016)Complexity is the Only Constant: Trends in Computing and Their Relevance to Model Driven EngineeringGraph Transformation10.1007/978-3-319-40530-8_1(3-18)Online publication date: 22-Jun-2016
  • (2015)Operationalised product quality models and assessment: The Quamoco approachInformation and Software Technology10.1016/j.infsof.2015.02.00962(101-123)Online publication date: Jun-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media