Skip to main content
SpringerLink
Log in

The UniTesK Approach to Designing Test Suites

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

Principles of the UniTesK test development technology based on the use of formal models of target software are presented. This technology was developed by the RedVerst group in the Institute for System Programming, Russian Academy of Sciences (ISPRAS) [1], which obtained rich experience in testing and verification of complex commercial software.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. http://www.ispras.ru/groups/rv/rv.html.

  2. Meyer, B., Applying“Design by Contract,” IEEE Computer, 1992, vol. 25, no. 10, pp. 40-51.

    Google Scholar 

  3. Meyer, B., Object-Oriented Software Construction, Prentice Hall, 1997, Second edition.

  4. Meyer, B., Eiffel: The Language, Prentice Hall, 1992.

  5. Peters, D. and Parnas, D. Using Test Oracles Generated from Program Documentation, IEEE Transactions on Software Engineering, 1998, vol. 24, no. 3, pp. 161-173.

    Google Scholar 

  6. Bourdonov, I., Kossatchev, A., Petrenko, A., and Gaiter, D., KVEST: Automated Generation of Test Suites from Formal Specifications, Proc. of FM'99, Lect. Notes Comput. Sci., Springer-Verlag, 1999, vol. 1708, pp. 608-621.

  7. Obayashi, M., Kubota, H., McCarron, S.P., and Mallet, L., The Assertion Based Testing Tool for OOP: ADL2, http://adl.opengroup.org/.

  8. Kossatchev, A., Petrenko, A., Zelenov, S., and Zelenova, S., Using Model-Based Approach for Automated Testing of Optimizing Compilers, Proc. Int. Workshop on Program Understanding, Gorno-Altaisk, 2003.

  9. Bourdonov, L., Kossatchev, A., Kuliamin, V., and Petrenko, A., UniTesK Test Suite Architecture, Proc. of FME 2002, Lect. Notes Comput. Sci., Springer-Verlag, 2002, vol. 2391, pp. 77-88.

  10. Zafiropulo, P., West, C.H., Rudin, H., Cowan, D.D., and Brand, D., Towards Analysing and Synthesizing Protocols, IEEE Trans. Commun., 1980, vol. 28, no. 4, pp. 651-660.

    Google Scholar 

  11. Chilenski, J.J. and Miller, S.P., Applicability of modified condition/decision coverage to software testing, Software Eng. J., 1994, September, pp. 193-200.

  12. Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Application of Finite Automata to Program Testing, Programmirovanie, 2000, no. 2, pp. 61-73.

    Google Scholar 

  13. Lee, D. and Yannakakis, M., Principles and Methods of Testing Finite-State Machines: A Survey, Proc. IEEE, 1996, vol. 84, no. 8, pp. 1090-1123.

    Google Scholar 

  14. von Bochmann, G. and Petrenko, A., Protocol Testing: Review of Methods and Relevance for Software Testing, Proc. ACM Int. Symp. on Software Testing and Analysis, Seattle, 1994, pp. 109-123.

  15. Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Irredundant Algorithms for Traversing Directed Graphs: The Deterministic Case, Programmirovanie, 2003, no. 5, pp. 11-30.

    Google Scholar 

  16. Fujiwara, S. and von Bochmann, G., Testing Nondeterministic Finite State Machine with Fault Coverage, Kroon, J., Heijink, R.J., and Brinksma, E., Eds., Proc. IFIP TC6 Fourth Int. Workshop on Protocol Test Systems, 1991, North-Holland, 1992, pp. 267-280.

  17. Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Irredundant Algorithms for Traversing Directed Graphs: The Deterministic Case, Programmirovanie (in press).

  18. http://www.junit.org/index.htm.

  19. Kramer, R., iContract-The Java Design by Contract Tool, Proc. of TOOLS26: Technology of Object-Oriented Languages and Systems, IEEE Computer Society, 1998, pp. 295-307.

  20. http://www.reliable-systems.com/.

  21. http://www.mmsindia.com/JMSAssert.html.

  22. Bhorkar, A., A Run-time Assertion Checker for Java using JML, Techn. Report 00-08, Department of Computer Science, Iowa State University, 2000.

  23. http://www.cs.iastate.edu/ leavens/JML.html.

  24. Karaorman, M., Holzle, U., and Bruno, J., jContractor: A Reflective Java Library to Support Design by Contract, Techn. Report TRCCS98-31, University of California, Santa Barbara, Computer Science, January 19, 1999.

    Google Scholar 

  25. http://jcontractor.sourceforge.net/.

  26. Bartetzko, D., Fisher, C., Moller, M., and Wehrheim, H., Jass-Java with Assertions, Proc. of the First Workshop on Runtime Verification RV'O1, Havelund, K. and Rosu, G., Eds., Electronic Notes in Theoretical Computer Science, Elsevier Science, 2001, vol.55.

  27. http://semantik.informatik.uni-oldenburg.de/~jass.

  28. Duncan, A. and Hlzle, U., Adding Contracts to Java with Handshake, Techn. Report TRCS98-32, University of California, Santa Barbara, 1998.

    Google Scholar 

  29. Muller, P., Meyer, J., and Poetzsch-Heffter, A., Making Executable Interface Specifications More Expressive, JIT'99 Java-Informations-Tage 1999, Cap, C.H., Ed., Informatik Aktuell, Springer-Verlag, 1999.

  30. Barneit, M. and Schulte, W., Contracts, Components, and Their Runtime Verification on the NET Platform, Techn. Report TR-2001-56, Microsoft Research.

  31. Baresi, L. and Young, M., Test Oracles, Techn. Report CISTR-01-02, http://www.cs.uoregon.edu/~michal/pubs/ oracles.html.

  32. Ball, T. and Rajamani, S., SLIC: A Specification Language for Interface Checking (of C), Techn. Report MSR-TR-2001-21, Microsoft Research, 2002.

  33. http://www.rational.com.

  34. http://www.parasoft.com.

  35. Boyapati, C., Khurshid, S., and Marinov, D., Korat: Automated Testing Based on Java Predicates, Proc. of ISSTA 2002, Rome, 2002.

  36. http://www.time-rover.com.

  37. http://www.t-vec.com.

  38. Heitmeyer, C., Software Cost Reduction, Encyclopedia of Software Engineering, Marciniak, J.J., Ed., 2 vols., 2002.

  39. http://mulsaw.lcs.mit.edu/.

  40. Ellsberger, J., Hogrefe, D., and Sarma, A., SDL-Formal Object-Oriented Language for Communicating Systems, Prentice Hall, 1997.

  41. ITU-T Recommendation Z.100: Specification and Description Language (SDL), Geneva: ITU-T, 1996.

  42. ITU-T Recommendation Z.100 Annex Fl: SDL formal definition-General, Geneva: ITU-T, 2000.

  43. Information Processing Systems: Open Systems Interconnection-LOTOS-A Formal Description Technique Based on the Temporal Ordering of Observational Behaviour, ISO/IEC 8807:1989, Geneva, 1989.

  44. ISO/TC97/SC21. Information Processing Systems: Open Systems Interconnection-Estelle-A Formal Description Technique Based on an Extended State Transition Model, ISO 9074:1997, Geneva, 1997.

  45. Berry, G., The Foundations of Esterel, Proof, Language and Interaction: Essays in Honour of Robin Milner, Plotkin, G., Stirling, C., and Tofte, M., Eds., MIT Press, 1998.

  46. Boussinot, F. and de Simone, R., The Esterel Language, Proc. IEEE, 1991, vol. 79, pp. 1293-1304.

    Google Scholar 

  47. 47. Halbwachs, N., Caspi, P., Raymond, P., and Pilaud, D., The Synchronous Data Flow Programming Language LUSTRE, Proc. IEEE, 1991, vol. 79, pp. 1305-1320.

    Google Scholar 

  48. Grabowski, J., Hogrefe, D., and Nahm, R., Test case generation with test purpose specification by MSCs, 6th SDL Forum, Faergemand, O. and Sarma, A., Eds., Darmstadt, Germany: North-Holland, 1993, pp. 253-266.

    Google Scholar 

  49. Wang, C.J. and Liu, M.T., Automatic Test Case Generation for Estelle, Int. Conf. on Network Protocols, San Francisco, 1993, pp. 225-232.

  50. Caravel, H., Lang, F., and Mateescu, R., An overview of CADP 2001, INRIA Techn. Report TR-254, 2001.

  51. Fernandez, J.-C., Jard, C., Jeron, T., and Viho, C., An Experiment in Automatic Generation of Test Suites for Protocols with Verification Technology, Special Issue on Industrially Relevant Applications of Formal Analysis Techniques, Groote, J.F. and Rem, M., Eds., Elsevier Science, 1996.

  52. Tretmans, J. and Belinfante, A., Automatic Testing with Formal Methods, EuroSTAR'99: 7th European Int. Conf. on Software Testing: Analysis and Review, Barcelona, 1999, EuroStar Conferences, Galway, Ireland, Techn. Report TRCTIT-17, Centre for Telematics and Information Technology, University of Twente.

  53. Bourhfir, C., Aboulhamid, E., Dssouli, R., and Rico, N., A Test Case Generation Approach for Conformance Testing of SDL Systems, Computer Commun., 2001, vol. 24, nos. 3-4, pp. 319-333.

    Google Scholar 

  54. Chun, W. and Amer, P.D., Test Case Generation for Protocols Specified in Estelle, Formal Description Techniques III, Que-mada, J., Manas, J., and Vazquez, E., Eds., Madrid: North-Holland, 1990, pp. 191-206.

    Google Scholar 

  55. Farchi, E., Hartman, A., and Pinter, S.S., Using a Modelbased Test Generator to Test for Standard Conformance, IBM Syst. J., 2002, vol. 41, no. 1, pp. 89-110.

    Google Scholar 

  56. http://www.haifa.il.ibm.com/projects/verification/gtcb/ documentation.html.

  57. Gronau, L., Hartmair, A., Klrshin, A., Nagin, K., and Olvovsky, S., A Methodology and Architecture for Automated Software Testing, http://www.haifa.il.ibm.com/ projects/verification/gtcb/papers/gtcbmanda.pdf.

  58. http://www.agedis.de/.

  59. Grieskamp, W., Gurevich, Y., Schulte, W., and Veanes, M., Testing with Abstract State Machines, Moreno-Diaz, R. and Quesada-Arencibia, A., Eds., Formal Methods and Tools for Computer Science (Proc. of Eurocast 2001), Universidad de Las Palmas de Gran Canaria, Canary Islands, Spain, 2001, pp. 257-261.

    Google Scholar 

  60. http://research.microsoft.com/fse/asml/.

  61. http://verify.stanford.edu/dill/murphi.html.

  62. Gurevich, Y., Evolving Algebras: An Attempt to Discover Semantics, Current Trends in Theoretical Computer Science, Rozenberg, G. and Salomaa, A., Eds., World Scientific, 1993, pp. 266-292.

  63. Borger, E. and Stark, R., Abstract State Machines: A Method for High-Level System Design and Analysis, Springer-Verlag, 2003.

  64. Friedman, G., Hartman, A., Nagin, K., and Shiran, T., Projected State Machine Coverage for Software Testing, Proc. of ISSTA 2002, Rome, 2002.

  65. Grieskamp, W., Gurevich, Y., Schulte, W., and Veanes, M., Generating Finite State Machines from Abstract State Machines, Proc. of ISSTA'2002, Techn. Report, MSRTR-2001-97, Microsoft Research

  66. http://www.frneurope.org/databases/fmadb088.html.

  67. http://www.atssoft.com.

  68. Bourdonov, I.B., Demakov, A.V., Jarov, A.A., Kossatchev, A.S., Kuliamin, V.V., Petrenko, A.K., and Zelenov, S.V., Java Specification Extension for Automated Test Development, Proc. of PSI'O1,Lect. Notes Comput. Sci., Springer-Verlag, 2001, vol. 2244, pp. 301-307.

  69. http://unitesk.ispras.ru.

  70. http://www.ispras.ru/~RedVerst/RedVerst/White Papers/ MSRIPv6 Verification Project/Main.html.

  71. Kuliamin, V., Petrenko, A., Pakoulin, N., Kossatchev, A., and Bourdonov, I., Integration of Functional and Timed Testing of Real-time and Concurrent Systems, Proc. of PSI'03, Novosibirsk, 2003.

Download references

Author information

Authors and Affiliations

  1. Institute for System Programming, Russian Academy of Sciences, ul. Bol'shaya Kommunisticheskaya 25, Moscow, 109004, Russia

    V. V. Kuliamin, A. K. Petrenko, A. S. Kossatchev & I. B. Burdonov

Authors
  1. V. V. Kuliamin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. K. Petrenko
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. S. Kossatchev
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. I. B. Burdonov
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kuliamin, V.V., Petrenko, A.K., Kossatchev, A.S. et al. The UniTesK Approach to Designing Test Suites. Programming and Computer Software 29, 310–322 (2003). https://doi.org/10.1023/B:PACS.0000004131.54590.fb

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:PACS.0000004131.54590.fb

Keywords

Search

Navigation