ABSTRACT
For the Internet of Things (IoT), for safety in automotive, or for data protection, to be legally compliant requires testing the impact of any actions before allowing them to occur. However, system boundaries change at runtime. When adding a new, previously unknown device to an IoT orchestra, or when an autonomous car meets another, or with truck platooning, the original base system expands and needs being tested before it can do decisions with the potential of affecting harm to humans. This paper explains the theory and outlines the implementation approach a framework for autonomous real-time testing of a software-based system while in operation, with an example from IoT.
- E. Engeler, The Combinatory Programme, Basel, Switzerland: Birkhäuser, 1995. Google ScholarCross Ref
- M. Ebner, TTCN-3 Test Case Generation from Message Sequence Charts, Göttingen, Germany,: In Workshop on Integrated-reliability with Telecommunications and UML Languages (ISSRE04:WITUL}, 2004.Google Scholar
- T. M. Fehlmann and E. Kranich, "Transfer Functions, Eigenvectors and QFD in Concert," in Proceedings of the ISQFD 2011, Stuttgart, Germany, 2011.Google Scholar
- T. M. Fehlmann, Managing Complexity - Uncover the Mysteries with Six Sigma Transfer Functions, Berlin, Germany: Logos Press, 2016.Google Scholar
- ISO/IEC 14143--1:2007, "Information technology - Software measurement - Functional size measurement - Part 1: Definition of concepts," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2007.Google Scholar
- COSMIC and IFPUG, "Glossary of terms for Non-Functional Requirements and Project Requirements used in software project performance measurement, benchmarking and estimating," September 2015. [Online]. Available: http://cosmic-sizing.org/publications/glossary-of-terms-for-nf-and-project-requirements/. [Accessed 18 November 2015].Google Scholar
- ISO/IEC 20926:2009, "Software and systems engineering - Software measurement - IFPUG functional size measurement method," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2009.Google Scholar
- ISO/IEC 19761:2011, "Software engineering - COSMIC: a functional size measurement method," ISO/IEC JTC 1/SC 7, Geneva, Switzerland, 2011.Google Scholar
- ISO/IEC Guide 99:2007, "International vocabulary of metrology - Basic and general concepts and associated terms (VIM)," TC/SC: ISO/TMBG, Geneva, Switzerland, 2007.Google Scholar
- ISO/IEC CD Guide 98-3, "Evaluation of measurement data - Part 3: Guide to uncertainty in measurement (GUM)," TC/SC: ISO/TMBG, Geneva, Switzerland, 2015.Google Scholar
- M. O. O. A. A. K. A. B. L. Abu Talib, "Scenario-based Black-Box Testing in COSMIC-FFP: A Case Study," Software Quality Professional - Journal of the American Society for Quality, vol. 8, no. 3, pp. 22--33, June 2006.Google Scholar
- COSMIC Measurement Practices Committee, "The COSMIC Functional Size Measurement Method - Version 4.0.1 - Measurement Manual," The COSMIC Consortium, Montréal, 2015.Google Scholar
- UKSMA, "Software Defect Measurement and Analysis Handbook (Draft)," United Kingdom Software Metrics Association, London, UK, 2015.Google Scholar
- SonarSource S.A, Switzerland - Open Source, "Documentation for SonarQube 6.3," 05 January 2017. [Online]. Available: https://docs.sonarqube.org/. [Accessed 21 April 2017].Google Scholar
- ISTQB, "ISTQB - Certifying Software Testers Worldwide," 31 March 2011. [Online]. Available: http://www.istqb.org/downloads/category/2-foundation-level-documents.html. [Accessed 24 April 2017].Google Scholar
- ISTQB, "Agile Tester Extension Syllabus," 30 Sept. 2014. [Online]. Available: http://www.istqb.org/downloads/send/5-agile-tester-extension-documents/41-agile-tester-extension-syllabus.html. [Accessed 24 April 2017].Google Scholar
- ISO 16355-1:2015, "ISO 16355-1:2015, 2015. Applications of Statistical and Related Methods to New Technology and Product Development Process - Part 1: General Principles and Perspectives of Quality Function Deployment (QFD), Geneva, Switzerland: ISO TC 69/SC 8/WG 2 N 14," ISO TC 69/SC 8/WG 2 N 14, Geneva, Switzerland, 2015.Google Scholar
- C. Creveling, J. Slutsky and D. Antis, Design for Six Sigma, New Jersey, NJ: Prentice Hall, 2003.Google Scholar
- T. M. Fehlmann, "The Impact of Linear Algebra on QFD," International Journal of Quality & Reliability Management, vol. 22, no. 9, pp. 83--96, 2005. Google ScholarCross Ref
- D. Kressner, "Numerical Methods for General and Structured Eigenvalue Problems," Lecture Notes in Computational Science and Engineering, vol. 46, 2005.Google Scholar
- T. L. Saaty, "Decision-making with the AHP: Why is the principal eigenvector necessary?," European Journal of Operational Research, vol. 145, pp. 85--91, 2003. Google ScholarCross Ref
- E. Engeler, "Algebras and Combinators," Algebra Universalis, vol. 13, pp. 389--392, 1981. Google ScholarCross Ref
- H. B. Curry, "Grundflagen der kombinatorischen Logik," Amer. J. Math., vol. 32, pp. 509--536, 789--834, 1930.Google ScholarCross Ref
- H. P. Barendregt, "The Type-Free Lambda-Calculus," in Handbook of Math. Logic, vol. 90, J. Barwise, Ed., Amsterdam, North Holland, 1977, pp. 1091--1132.Google Scholar
- J. Barwise, H. Keisler, A. Mostowski, A. Robinson, P. Suppes and A. Troelstra, Handbook of Mathematical Logic, Studies in Logic and the Foundations of Mathematics ed., vol. 90, J. Barwise, Ed., Amsterdam, NL: North-Holland Publishing Company, 1977.Google Scholar
- K. Ishikawa, Introduction to Quality Control, Translated by J. H. Loftus; distributed by Chapman & Hall, London ed., Tokyo, Japan: JUSE Press Ltd, 1990.Google Scholar
- Y. Akao, Ed., Quality Function Deployment - Integrating Customer Requirements into Product Design, Portland, OR: Productivity Press, 1990.Google Scholar
- T. M. Fehlmann, "Theorie und Anwendung der Kombinatorischen Logik," ETH Dissertation 3140-01, Zürich, CH, 1981.Google Scholar
- S. Schurr, "Evaluating AHP Questionnaire Feedback with Statistical Methods," Stuttgart, Germany, 2011.Google Scholar
Index Terms
- Autonomous real-time software & systems testing
Recommendations
Timed testing with torx
FM'05: Proceedings of the 2005 international conference on Formal MethodsTorX is a specification-based, on-the-fly testing tool that tests for ioco conformance of implementations w.r.t. a formal specification. This paper describes an extension of TorX to not only allow testing for functional correctness, but also for ...
The Study on an Intelligent General-Purpose Automated Software Testing Suite
ICICTA '10: Proceedings of the 2010 International Conference on Intelligent Computation Technology and Automation - Volume 03To make the labor intensive manual software testing automated, we present the design and implementation of an intelligent general-purpose automated software testing suite. With the two main tools in the suite: an automated software testing scheduler, ...
Environment modeling and simulation for automated testing of soft real-time embedded software
Given the challenges of testing at the system level, only a fully automated approach can really scale up to industrial real-time embedded systems (RTES). Our goal is to provide a practical approach to the model-based testing of RTES by allowing system ...
Comments