Skip to main content
SpringerLink
Log in
Book cover

European Conference on Software Process Improvement

EuroSPI 2020: Systems, Software and Services Process Improvement pp 275–288Cite as

A Framework for Automated Testing

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1251))

Abstract

Autonomous Real-time Testing requires test automation. Test automation is closely related to Continuous Integration/ Continuous Delivery (CI/CD).

However, test automation is a difficult undertaking. While many tools exist that automate the execution of tests, the generation of tests remains manual even though complex systems require a high number of test cases.

This paper explains how to generate new test cases by recombination, distinguish relevant test cases from redundant test cases and proposes a framework for how to automate test generation and execution.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Erich, F., Amrit, C., Daneva, M.: A qualitative study of DevOps usage in practice. J. Softw. Evol. Process 29(6), June 2017

    Google Scholar 

  2. Booch, G., et al.: Object-Oriented Analysis and Design with Applications. The Addison-Wesley Object Technology Series, vol. 3. Addison-Wesley, Upper Saddle River (2007)

    MATH  Google Scholar 

  3. Beck, K.: eXtreme Programming Explained. Addison-Wesley, Boston (2000)

    Google Scholar 

  4. Fehlmann, T.M.: Autonomous Real-time Testing - Testing Artificial Intelligence and Other Complex Systems. Logos Press, Berlin (2020)

    Google Scholar 

  5. Korsaa, M., et al.: The SPI manifesto and the ECQA SPI manager certification scheme. J. Softw. Evol. Process 24(5), 525–540 (2012)

    Article  Google Scholar 

  6. CloudBees, Inc. Jenkins - Build great things at any scale. https://jenkins.io. Accessed 31 Mar 2020

  7. Atlassian. Inc. Atlassian Software Development. https://www.atlassian.com/?tab=code-build-and-ship. Accessed 31 Mar 2020

  8. JUnit Team. The new major version of the programmer-friendly testing framework for Java, Open Source Development. https://junit.org/junit5/. Accessed 8 Apr 2020

  9. Poppendieck, M., Poppendieck, T.: Implementing Lean Software Development. Addison-Wesley, New York (2007)

    Google Scholar 

  10. Engeler, E.: Algebras and combinators. Algebra Universalis 13, 389–392 (1981). https://doi.org/10.1007/BF02483849

    Article  MathSciNet  MATH  Google Scholar 

  11. Engeler, E.: Neural algebra on “how does the brain think?”. Theor. Comput. Sci. 777, 296–307 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  12. ETSI European Telecoms Standards Institute. TTCN-3 Standards, ETSI, Sophia-Antipolis Cedex, France (2018). http://www.ttcn-3.org/index.php/downloads/standards. Accessed 11 Dec 2018

  13. Ebner, M.: TTCN-3 test case generation from message sequence charts, Göttingen, Germany. In: Workshop on Integrated-reliability with Telecommunications and UML Languages (ISSRE04:WITUL) (2004)

    Google Scholar 

  14. Fehlmann, T.M.: Managing Complexity - Uncover the Mysteries with Six Sigma Transfer Functions. Logos Press, Berlin (2016)

    MATH  Google Scholar 

  15. Engeler, E.: The Combinatory Programme. Birkhäuser, Basel (1995)

    Book  MATH  Google Scholar 

  16. Turing, A.: On computable numbers, with an application to the Entscheidungsproblem. In: Proceedings of the London Mathematical Society, vol. 42, no. 2, pp 230–265 (1937)

    Google Scholar 

  17. Curry, H., Feys, R.: Combinatory Logic, vol. I. North-Holland, Amsterdam (1958)

    MATH  Google Scholar 

  18. Curry, H., Hindley, J., Seldin, J.: Combinatory Logic, vol. II. North-Holland, Amsterdam (1972)

    MATH  Google Scholar 

  19. Barendregt, H.P.: The type-free lambda-calculus. In: Barwise, J. (ed.) Handbook of Math Logic, vol. 90, Amsterdam, North Holland, pp. 1091–1132 (1977)

    Google Scholar 

  20. Fehlmann, T.M.: Theorie und Anwendung des Graphmodells der Kombinatorischen Logik, ETH Dissertation 3140-01, Zürich, CH (1981)

    Google Scholar 

  21. Barwise, J., et al.: Handbook of mathematical logic. In: Barwise, J. (ed.) Studies in Logic and the Foundations of Mathematics, vol. 90. North-Holland Publishing Company, Amsterdam (1977)

    Google Scholar 

  22. Fehlmann, T., Kranich, E.: Theoretical aspects of consumer metrics for safety & privacy. In: Larrucea, X., Santamaria, I., O’Connor, Rory V., Messnarz, R. (eds.) EuroSPI 2018. CCIS, vol. 896, pp. 640–653. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-97925-0_54

    Chapter  Google Scholar 

  23. Fehlmann, T.M., Kranich, E.: Practical aspects of consumer metrics for safety & privacy. In: Proceedings der GI-Informatik 2018 (proposed), Zurich, Switzerland (2018)

    Google Scholar 

  24. ISO/IEC 19761. Software engineering - COSMIC: a functional size measurement method, ISO/IEC JTC 1/SC 7, Geneva, Switzerland (2011)

    Google Scholar 

  25. COSMIC Measurement Practices Committee. The COSMIC Measurement Manual for ISO 19761 – Version 5.0, Part 1–3, The COSMIC Consortium, Montréal (2020)

    Google Scholar 

  26. ISO/IEC 14143-1. Information technology - Software measurement - Functional size measurement - Part 1: Definition of concepts, ISO/IEC JTC 1/SC 7, Geneva, Switzerland (2007)

    Google Scholar 

  27. ISO 16355-1:2015. ISO 16355-1:2015, 2015. Applications of Statistical and Related Methods to New Technology and Product Development Process - Part 1: General Principles and Perspectives of Quality Function Deployment (QFD), Geneva, Switzerland: ISO TC 69/SC 8/WG 2 N 14, ISO TC 69/SC 8/WG 2 N 14, Geneva, Switzerland (2015)

    Google Scholar 

  28. Fehlmann, T.: Testing artificial intelligence. In: Walker, A., O’Connor, Rory V., Messnarz, R. (eds.) EuroSPI 2019. CCIS, vol. 1060, pp. 709–721. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-28005-5_55

    Chapter  Google Scholar 

  29. Saaty, T.L.: Decision-making with the AHP: Why is the principal eigenvector necessary? Eur. J. Oper. Res. 145, 85–91 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  30. Fehlmann, T.M., Kranich, E.: Uncovering Customer Needs from Net Promoter Scores, Istanbul, Turkey (2014)

    Google Scholar 

  31. Fehlmann, T.M., Kranich, E.: Testing artificial intelligence by customers’ needs. Athens J. Sci. 6(4), 265–286 (2019)

    Article  Google Scholar 

  32. Fehlmann, T.M., Kranich, E.: Intuitionism and computer science – why computer scientists do not like the axiom of choice. Athens J. Sci., Submitted

    Google Scholar 

  33. Pupale, R.: Support Vector Machines (SVM)  -  An Overview, 16 June 2018. https://towardsdatascience.com/https-medium-com-pupalerushikesh-svm-f4b42800e989. Accessed 28 Mar 2019

  34. Fehlmann, T.M., Kranich, E.: A Sensitivity Analysis Procedure for QFD, Duisburg (2020, to appear)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Euro Project Office, 8032, Zurich, Switzerland

    Thomas Fehlmann

  2. Euro Project Office, 47051, Duisburg, Germany

    Eberhard Kranich

Authors
  1. Thomas Fehlmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eberhard Kranich
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Thomas Fehlmann .

Editor information

Editors and Affiliations

  1. School of Computing, Dublin City University, Dublin, Ireland

    Murat Yilmaz

  2. University of Applied Sciences Düsseldorf, Düsseldorf, Germany

    Jörg Niemann

  3. School of Computing, Dublin City University, Dublin, Ireland

    Paul Clarke

  4. I.S.C.N. GesmbH, Graz, Steiermark, Austria

    Richard Messnarz

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fehlmann, T., Kranich, E. (2020). A Framework for Automated Testing. In: Yilmaz, M., Niemann, J., Clarke, P., Messnarz, R. (eds) Systems, Software and Services Process Improvement. EuroSPI 2020. Communications in Computer and Information Science, vol 1251. Springer, Cham. https://doi.org/10.1007/978-3-030-56441-4_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-56441-4_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-56440-7

  • Online ISBN: 978-3-030-56441-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation