Skip to main content
Log in

Advances in test generation for testing software and systems

An introduction to selected papers from ICTSS 2013

  • Introduction
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

Among the software quality assurance techniques, testing stands out as one of the most frequently used techniques in practice. Consequently, testing is also widely studied in research. An important aspect in testing that receives much attention is the problem of automated test generation. This introductory paper summarizes the papers selected from the 25th IFIP International Conference on Testing Software and Systems (ICTSS 2013), which all deal with this topic. The field is briefly introduced by pointing out to some of the existing survey articles and relating the selected papers in this issue to each other and to the known body of knowledge.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Anand, S., Burke, E.K., Chen, T.Y., Clark, J.A., Cohen, M.B., Grieskamp, W., Harman, M., Harrold, M.J., McMinn, P.: An orchestrated survey of methodologies for automated software test case generation. J. Syst. Softw. 86(8), 1978–2001 (2013)

    Article  Google Scholar 

  2. Binder, R.V., Legeard, B., Kramer, A.: Model-based testing: where does it stand? Commun. ACM 58(2), 52–56 (2015)

    Article  Google Scholar 

  3. Broy, M., Jonsson, B., Katoen, J., Leucker, M., Pretschner, A. (eds.): Model-Based Testing of Reactive Systems, Advanced Lectures, Lecture Notes in Computer Science, vol. 3472. Springer, Berlin (2005)

    Google Scholar 

  4. Chow, T.S.: Testing software design modeled by finite-state machines. IEEE Trans. Softw. Eng. 4(3), 178–187 (1978)

    Article  MATH  Google Scholar 

  5. Dias Neto, A.C., Subramanyan, R., Vieira, M., Travassos, G.H.: A survey on model-based testing approaches: a systematic review. In: Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies, WEASELTech 2007, pp. 31–36. ACM (2007)

  6. Dijkstra, E.W.: Notes on Structured Programming. http://www.cs.utexas.edu/users/EWD/ewd02xx/EWD249.PDF (1970) (circulated privately)

  7. Enoiu, E.P., Čaušević, A., Ostrand, T.J., Weyuker, E.J., Sundmark, D., Pettersson, P.: Automated test generation using model checking: an industrial evaluation. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0355-9

  8. Faria, J.P., Paiva, A.C.R.: A toolset for conformance testing against uml sequence diagrams based on event-driven colored petri nets. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0354-x

  9. Frantzen, L., Tretmans, J., Willemse, T.A.C.: Test generation based on symbolic specifications. In: J. Grabowski, B. Nielsen (eds.) Formal Approaches to Software Testing, 4th International Workshop, FATES 2004, Linz, Austria, September 21, 2004, Revised Selected Papers, Lecture Notes in Computer Science, vol. 3395, pp. 1–15. Springer (2005)

  10. Fraser, G., Wotawa, F., Ammann, P.: Testing with model checkers: a survey. Softw. Test. Verif. Reliab. 19(3), 215–261 (2009)

    Article  Google Scholar 

  11. Hierons, R.M., Merayo, M.G., Núñez, M.: Implementation relations for the distributed test architecture. In: Suzuki, K., Higashino, T., Ulrich, A., Hasegawa, T. (eds.) Testing of Software and Communicating Systems, 20th IFIP TC 6/WG 6.1 International Conference, TestCom 2008, 8th International Workshop, FATES 2008, Tokyo, Japan Proceedings, 10–13 June 2008, Lecture Notes in Computer Science, vol. 5047, pp. 200–215. Springer (2008)

  12. Hierons, R.M., Ural, H.: Optimizing the length of checking sequences. IEEE Trans. Comput. 55(5), 618–629 (2006)

    Article  MathSciNet  Google Scholar 

  13. Huang, W.l., Peleska, J.: Complete model-based equivalence class testing. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0356-8

  14. Kurshan, R. P.: Lecture Notes in Computer Science. In: Grumberg, O., Veith, H. (eds.) 25 Years of Model Checking, vol. 5000, pp. 46–64. Springer, Heidelberg (2008)

  15. Kushik, N., El-Fakih, K., Yevtushenko, N., Cavalli, A.R.: On adaptive experiments for nondeterministic finite state machines. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0357-7

  16. Larsen, K.G., Mikucionis, M., Nielsen, B.: Online testing of real-time systems using UPPAAL: status and future work. In: E. Brinksma, W. Grieskamp, J. Tretmans (eds.) Perspectives of Model-Based Testing, 5–10 September 2004, Dagstuhl Seminar Proceedings, vol. 04371. IBFI, Schloss Dagstuhl, Germany (2005)

  17. Lee, D., Yannakakis, M.: Principles and methods of testing finite state machines-a survey. Proc. IEEE 84(8), 1090–1123 (1996)

    Article  Google Scholar 

  18. Ponce de León, H., Haar, S., Longuet, D.: Model-based testing for concurrent systems: unfolding-based test selection. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0353-y

  19. Moore, E.F.: Gedanken-experiments on sequential machines. In: Shannon, C., McCarthy, J. (eds.) Automata Studies, pp. 129–153. Princeton University Press, Princeton (1956)

    Google Scholar 

  20. Nielsen, B., Skou, A.: Automated test generation from timed automata. Softw. Tools Technol. Transf. 5(1), 59–77 (2003)

    Article  MATH  Google Scholar 

  21. Orso, A., Rothermel, G.: Software testing: a research travelogue (2000–2014). In: 36th International Conference on on Software Engineering, ICSE, Future of Software Engineering Track, FOSE, Hyderabad, India, pp. 117–132 (2014)

  22. Ovatman, T., Aral, A., Polat, D., Ünver, A.O.: An overview of model checking practices on verification of plc software. Softw. Syst. Model. 1–24 (2014). doi:10.1007/s10270-014-0448-7

  23. Petrenko, A., da Silva Simão, A., Maldonado, J.C.: Model-based testing of software and systems: recent advances and challenges. Softw. Tools Technol. Transf. 14(4), 383–386 (2012)

    Article  Google Scholar 

  24. Petrenko, A., Yevtushenko, N.: Adaptive testing of nondeterministic systems with FSM. In: 15th International IEEE Symposium on High-Assurance Systems Engineering, HASE 2014, Miami Beach, FL, USA, 9–11 January 2014, pp. 224–228. IEEE Computer Society (2014)

  25. Petrenko, A., Yevtushenko, N., von Bochmann, G.: Testing deterministic implementations from nondeterministic fsm specifications. In: Selected Proceedings of the IFIP TC6 9th International Workshop on Testing of Communicating Systems, pp. 125–140. Chapman & Hall, Ltd., London (1996)

  26. Schrammel, P., Melham, T., Kroening, D.: Generating test case chains for reactive systems. Int. J. Softw. Tools Technol. Transfer. doi:10.1007/s10009-014-0358-6

  27. Shafique, M., Labiche, Y.: A systematic review of state-based test tools. Softw. Tools Technol. Transf. 17(1), 59–76 (2015)

    Article  Google Scholar 

  28. da Silva Simão, A., Petrenko, A.: Generating checking sequences for partial reduced finite state machines. In: K. Suzuki, T. Higashino, A. Ulrich, T. Hasegawa (eds.) Testing of Software and Communicating Systems, 20th IFIP TC 6/WG 6.1 International Conference, TestCom 2008, 8th International Workshop, FATES 2008, Tokyo, Japan, Proceedings, 10–13 June 2008, Lecture Notes in Computer Science, vol. 5047, pp. 153–168. Springer (2008)

  29. Tretmans, J.: Model based testing with labelled transition systems. In: Hierons, R.M., Bowen, J.P., Harman, M. (eds.) Formal Methods and Testing. Lecture Notes in Computer Science, vol. 4949, pp. 1–38. Springer, Berlin, Heidelberg (2008)

  30. Ural, H., Wu, X., Zhang, F.: On minimizing the lengths of checking sequences. IEEE Trans. Comput. 46(1), 93–99 (1997)

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank the authors of the selected articles for their motivation to provide extended versions of their work originally submitted to ICTSS 2013, the reviewers of the articles for their relentless efforts on providing feedback and holding up the quality of the submitted work, and all members of the technical program committee of ICTSS 2013.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hüsnü Yenigün.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yenigün, H., Yilmaz, C. & Ulrich, A. Advances in test generation for testing software and systems. Int J Softw Tools Technol Transfer 18, 245–249 (2016). https://doi.org/10.1007/s10009-015-0404-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-015-0404-z

Keywords

Navigation