skip to main content
10.1145/3143434.3143444acmotherconferencesArticle/Chapter ViewAbstractPublication Pagesiwsm-mensuraConference Proceedingsconference-collections
research-article

Autonomous real-time software & systems testing

Published:25 October 2017Publication History

ABSTRACT

For the Internet of Things (IoT), for safety in automotive, or for data protection, to be legally compliant requires testing the impact of any actions before allowing them to occur. However, system boundaries change at runtime. When adding a new, previously unknown device to an IoT orchestra, or when an autonomous car meets another, or with truck platooning, the original base system expands and needs being tested before it can do decisions with the potential of affecting harm to humans. This paper explains the theory and outlines the implementation approach a framework for autonomous real-time testing of a software-based system while in operation, with an example from IoT.

References

  1. E. Engeler, The Combinatory Programme, Basel, Switzerland: Birkhäuser, 1995. Google ScholarGoogle ScholarCross RefCross Ref
  2. M. Ebner, TTCN-3 Test Case Generation from Message Sequence Charts, Göttingen, Germany,: In Workshop on Integrated-reliability with Telecommunications and UML Languages (ISSRE04:WITUL}, 2004.Google ScholarGoogle Scholar
  3. T. M. Fehlmann and E. Kranich, "Transfer Functions, Eigenvectors and QFD in Concert," in Proceedings of the ISQFD 2011, Stuttgart, Germany, 2011.Google ScholarGoogle Scholar
  4. T. M. Fehlmann, Managing Complexity - Uncover the Mysteries with Six Sigma Transfer Functions, Berlin, Germany: Logos Press, 2016.Google ScholarGoogle Scholar
  5. ISO/IEC 14143--1:2007, "Information technology - Software measurement - Functional size measurement - Part 1: Definition of concepts," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2007.Google ScholarGoogle Scholar
  6. COSMIC and IFPUG, "Glossary of terms for Non-Functional Requirements and Project Requirements used in software project performance measurement, benchmarking and estimating," September 2015. [Online]. Available: http://cosmic-sizing.org/publications/glossary-of-terms-for-nf-and-project-requirements/. [Accessed 18 November 2015].Google ScholarGoogle Scholar
  7. ISO/IEC 20926:2009, "Software and systems engineering - Software measurement - IFPUG functional size measurement method," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2009.Google ScholarGoogle Scholar
  8. ISO/IEC 19761:2011, "Software engineering - COSMIC: a functional size measurement method," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2011.Google ScholarGoogle Scholar
  9. ISO/IEC Guide 99:2007, "International vocabulary of metrology - Basic and general concepts and associated terms (VIM)," TC/SC: ISO/TMBG, Geneva, Switzerland, 2007.Google ScholarGoogle Scholar
  10. ISO/IEC CD Guide 98-3, "Evaluation of measurement data - Part 3: Guide to uncertainty in measurement (GUM)," TC/SC: ISO/TMBG, Geneva, Switzerland, 2015.Google ScholarGoogle Scholar
  11. M. O. O. A. A. K. A. B. L. Abu Talib, "Scenario-based Black-Box Testing in COSMIC-FFP: A Case Study," Software Quality Professional - Journal of the American Society for Quality, vol. 8, no. 3, pp. 22--33, June 2006.Google ScholarGoogle Scholar
  12. COSMIC Measurement Practices Committee, "The COSMIC Functional Size Measurement Method - Version 4.0.1 - Measurement Manual," The COSMIC Consortium, Montréal, 2015.Google ScholarGoogle Scholar
  13. UKSMA, "Software Defect Measurement and Analysis Handbook (Draft)," United Kingdom Software Metrics Association, London, UK, 2015.Google ScholarGoogle Scholar
  14. SonarSource S.A, Switzerland - Open Source, "Documentation for SonarQube 6.3," 05 January 2017. [Online]. Available: https://docs.sonarqube.org/. [Accessed 21 April 2017].Google ScholarGoogle Scholar
  15. ISTQB, "ISTQB - Certifying Software Testers Worldwide," 31 March 2011. [Online]. Available: http://www.istqb.org/downloads/category/2-foundation-level-documents.html. [Accessed 24 April 2017].Google ScholarGoogle Scholar
  16. ISTQB, "Agile Tester Extension Syllabus," 30 Sept. 2014. [Online]. Available: http://www.istqb.org/downloads/send/5-agile-tester-extension-documents/41-agile-tester-extension-syllabus.html. [Accessed 24 April 2017].Google ScholarGoogle Scholar
  17. ISO 16355-1:2015, "ISO 16355-1:2015, 2015. Applications of Statistical and Related Methods to New Technology and Product Development Process - Part 1: General Principles and Perspectives of Quality Function Deployment (QFD), Geneva, Switzerland: ISO TC 69/SC 8/WG 2 N 14," ISO TC 69/SC 8/WG 2 N 14, Geneva, Switzerland, 2015.Google ScholarGoogle Scholar
  18. C. Creveling, J. Slutsky and D. Antis, Design for Six Sigma, New Jersey, NJ: Prentice Hall, 2003.Google ScholarGoogle Scholar
  19. T. M. Fehlmann, "The Impact of Linear Algebra on QFD," International Journal of Quality & Reliability Management, vol. 22, no. 9, pp. 83--96, 2005. Google ScholarGoogle ScholarCross RefCross Ref
  20. D. Kressner, "Numerical Methods for General and Structured Eigenvalue Problems," Lecture Notes in Computational Science and Engineering, vol. 46, 2005.Google ScholarGoogle Scholar
  21. T. L. Saaty, "Decision-making with the AHP: Why is the principal eigenvector necessary?," European Journal of Operational Research, vol. 145, pp. 85--91, 2003. Google ScholarGoogle ScholarCross RefCross Ref
  22. E. Engeler, "Algebras and Combinators," Algebra Universalis, vol. 13, pp. 389--392, 1981. Google ScholarGoogle ScholarCross RefCross Ref
  23. H. B. Curry, "Grundflagen der kombinatorischen Logik," Amer. J. Math., vol. 32, pp. 509--536, 789--834, 1930.Google ScholarGoogle ScholarCross RefCross Ref
  24. H. P. Barendregt, "The Type-Free Lambda-Calculus," in Handbook of Math. Logic, vol. 90, J. Barwise, Ed., Amsterdam, North Holland, 1977, pp. 1091--1132.Google ScholarGoogle Scholar
  25. J. Barwise, H. Keisler, A. Mostowski, A. Robinson, P. Suppes and A. Troelstra, Handbook of Mathematical Logic, Studies in Logic and the Foundations of Mathematics ed., vol. 90, J. Barwise, Ed., Amsterdam, NL: North-Holland Publishing Company, 1977.Google ScholarGoogle Scholar
  26. K. Ishikawa, Introduction to Quality Control, Translated by J. H. Loftus; distributed by Chapman & Hall, London ed., Tokyo, Japan: JUSE Press Ltd, 1990.Google ScholarGoogle Scholar
  27. Y. Akao, Ed., Quality Function Deployment - Integrating Customer Requirements into Product Design, Portland, OR: Productivity Press, 1990.Google ScholarGoogle Scholar
  28. T. M. Fehlmann, "Theorie und Anwendung der Kombinatorischen Logik," ETH Dissertation 3140-01, Zürich, CH, 1981.Google ScholarGoogle Scholar
  29. S. Schurr, "Evaluating AHP Questionnaire Feedback with Statistical Methods," Stuttgart, Germany, 2011.Google ScholarGoogle Scholar

Index Terms

  1. Autonomous real-time software & systems testing

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        IWSM Mensura '17: Proceedings of the 27th International Workshop on Software Measurement and 12th International Conference on Software Process and Product Measurement
        October 2017
        273 pages
        ISBN:9781450348539
        DOI:10.1145/3143434

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 October 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader