Skip to main content
SpringerLink
Log in

Evolution of the UniTESK test development technology

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

The basic principles of UniTESK technology designed for constructing tests on the basis of formal models are presented. Experience in using UniTESK in large test development projects for software and hardware systems, including telecommunication protocols, basic and standard interfaces of operating systems, and microprocessor units, is summarized. The paper provides an overview of possible directions for the development of the technology with a view to providing higher scalability of test suites.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Bourdonov, I., Kossatchev, A., Kuliamin, V., and Petrenko, A., UniTesK test suite architecture, Proceedings of FME’2002, Kopenhagen, Denmark, in Lecture Notes Comput. Sci., Springer, 2002, vol. 2391, pp. 77–88.

    Article  Google Scholar 

  2. Kulyamin, V.V., Petrenko, A.K., Kossatchev, A.S., and Burdonov, I.B., A UniTesK approach to the analysis of texts, Programmirovanie, 2003, vol. 29, no. 6, pp. 25–43.

    Google Scholar 

  3. ISO/IEC TR 19759 Software Engineering — Guide to the Software Engineering Body of Knowledge (SWEBOK), Geneva: ISO, 2005.

  4. Baresi, L., and Young, M., Test Oracles, Tech. Report CIS-TR-01-02, 2001. http://www.cs.uoregon.edu/michal/pubs/oracles.html

    Google Scholar 

  5. Kulyamin V.V., Organization of complex test sets, Tr. Inst. Sist. Program., Ross. Akad. Nauk, 2009, vol. 17, pp. 9–24.

    Google Scholar 

  6. Meyer, B., Applying design by contract, IEEE Computer, 1992, vol. 25, no. 10, pp. 40–51.

    Article  Google Scholar 

  7. Bourdonov, I., Kossatchev, A., Petrenko, and Galter, D., KVEST: Automated generation of test suites from formal specifications, Proc. FM’99, Toulouse, France, in Lecture Notes Comput. Sci., Springer, 1999, vol. 1708, pp. 608–621.

    Article  Google Scholar 

  8. Bourdonov, I.B., Demakov, A.V., Jarov, A.A., Kossatchev, A.S., Kuliamin, V.V., Petrenko, A.K., and Zelenov, S.V., Java specification extension for automated test development, Proc. PSI’2001, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2001, vol. 2244, pp. 301–307.

    Article  MathSciNet  Google Scholar 

  9. Klyuchnikov, G.V., Kossatchev, A.S., Pakulin, N.V., Petrenko, A.K., and Shnitman, V.Z., Using formal methods for testing an implementation of IPv6, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2003, vol. 4, pp. 121–140.

    Google Scholar 

  10. Kulyamin V.V., Component architecture of environment for model-based testing, Programmirovanie, 2010, vol. 36, no. 5, pp. 54–75.

    Google Scholar 

  11. Kuliamin V.V., Petrenko, A.K., Pakulin, N.V., Kossatchev, A.S., and Bourdonov, I.B., Integration of functional and timed testing of real-time and concurrent systems, Proc. PSI’2003, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2003, vol. 2890, pp. 450–461.

    Article  Google Scholar 

  12. Kuliamin, V., Petrenko, A., and Pakoulin, N., Practical approach to specification and conformance testing of distributed network applications, Proc. ISAS’2005, Berlin, Germany, in Lecture Notes Comput. Sci., Springer, 2005, vol. 3694, pp. 68–83.

    Article  Google Scholar 

  13. Khoroshilov, A.V., Specification and testing components with asynchronous interface, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2006.

    Google Scholar 

  14. Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Application of finite automata to program testing, Programmirovanie, 2000, vol. 26, no. 2, pp. 61–73.

    MathSciNet  Google Scholar 

  15. Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Irredundant algorithms for traversing directed graphs: Deterministic case, Programmirovanie, 2003, vol. 29, no. 5, pp. 59–69.

    Google Scholar 

  16. Zhu, H., Hall, P.A.V., and May, J.H.R, Software unit test coverage and adequacy, ACM Comput. Surv., 1997, vol. 29, no. 4, pp. 366–427.

    Article  Google Scholar 

  17. Grinevich, A., Khoroshilov, A., Kuliamin, V., Markovtsev, D., Petrenko, A., and Rubanov, V., Formal methods in industrial software standards enforcement, Proc. PSI’2006, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2006, vol. 4378, pp. 459–469.

    Google Scholar 

  18. Project OLVER, http://linuxtesting.org

  19. Maksimov, A., Requirements-based conformance testing of ARINC 653 real-time operating systems, Proc. Data Systems in Aerospace (DASIA) 2010, ESA SP-682, 2010, ISBN 978-92-9221-246-9.

    Google Scholar 

  20. Klyuchnikov, G.V., Kossatchev, A.S., Pakulin, N.V., Petrenko, A.K., and Shnitman, V.Z., Application of formal methods for testing Mobile IPv6, Sbornik tezisov vtoroi mezhdunarodnoi konferentsii “Internet novogo pokoleniya” (Collection of Abstratcs of the 2-nd Int. Conf. “Internet of new generation”), Yaroslavl, 2003, pp. 20–25.

    Google Scholar 

  21. Ivannikov, V.P., Kamkin, A.S., Kossatchev, A.S., Kulyamin, V.V., and Petrenko, A.K., Application of contract specifications for representing requirements and functional testing of hardware models, Programmirovanie, 2007, vol. 33, no. 5, pp. 47–61.

    Google Scholar 

  22. Grieskamp, W., Microsoft’s protocol documentation program: A success story for model-based testing. Testing — practice and research techniques, in Lecture Notes Comput. Sci., Springer, 2010, vol. 6303, p. 7.

    Article  Google Scholar 

  23. Godefroid, P., Klarlund, N., and Sen, K., DART: Directed automated random testing, ACM SIGPLAN Notices — Proceedings of PLDI-2005, 2005, vol. 40, no. 6, pp. 213–223.

    Google Scholar 

  24. Sen, K., Marinov, D., and Agha, G., CUTE: A concolic unit testing engine for C, Proc. ESES/FSE, 2005, pp. 263–272.

    Google Scholar 

  25. Cadar, C., Ganesh, V., Pawloski, P., Dill, D., and Engler, D., EXE: Automatically generating inputs of death, Proc. 13-th Int. Conf. on Computer and Communications Security CCS, 2006, pp. 322–335.

    Google Scholar 

  26. Pacheco, C., Lahiri, S.K., Ernst, M.D., and Ball, T., Feedback-directed random test generation, Proc. Int. Conf. on Software Engineering, 2007, pp. 75–84.

    Google Scholar 

  27. Bourdonov, I.B., Groshev, S.G., Demakov, A.V., Kamkin, A.S., Kossatchev, A.S., and Sortov, A.A., Parallel testing of large model of automata, Vestn. NNGU, 2011, no. 3, pp. 187–193.

    Google Scholar 

  28. Bourdonov, I. and Kossatchev, A., Traversing an unknown graph by a group of automata, Trudy mezhdunarodnoi superkomp’yuternoi konferentsii “Nauchnyi servis v seti Internet: vse grani parallelizma” (Proc. Int. Supercomput. Conf. “Scientific service in Internet: All faces of parallelism”), 2013, pp. 228–232.

    Google Scholar 

  29. Flanagan, C. and Godefroid, P., Dynamic partial-order reduction for model checking software, ACM SIGPLAN Notices-Proceedings of POPL 2005, 2005, vol. 40, no. 1, pp. 110–121.

    Google Scholar 

  30. Yang, Y., Chen, X., Gopalakrishnan, G., and Kirby, R., Efficient stateful dynamic partial order reduction, Proc. SPIN 2008, in Lecture Notes Comput. Sci., Springer, 2008, vol. 5156, pp. 288–305.

    Google Scholar 

  31. Ivannikov, V.P., Petrenko, A.K., Kulyamin, V.V., and Maksimov A.V., Experience in using UniTESK as the mirror of the development of testing model-based technologies, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2013, vol. 23, pp. 207–218.

    Google Scholar 

  32. Bourdonov, I.B. and Kossatchev, A.S., Development of conformance theory: Semantics, Formal models, and algorithms, Tr. Inst. Syst. Program., Ross. Akad. Nauk,, 2014.

    Google Scholar 

  33. Gerlits, E.A., Kulyamin, V.V., Maksimov, A.V., Petrenko, A.K., Khoroshilov, A.V., and Tsyvarev, A.V., Testing operating systems, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.

    Google Scholar 

  34. Pakulin, N.V. and Shnitman, V.Z., Automation of conformance testing for telecommunication protocols, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.

    Google Scholar 

  35. Kamkin, A.S., Kotsynyak, A.M., Smolov, S.A., Tatarnikov, A.D., and Chupilko, M.M., Means for the functional verification of microprocessors, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.

    Google Scholar 

  36. Zelenov, S.V., Petrenko, A.K., Pakulin, N.V., Ugnenko, A.A., and Khoroshilov, A.V., Hardware design tools for systems of integrated modular avionics, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.

    Google Scholar 

  37. Pakulin, N.V. and Khoroshilov, A.V., Development of formal models and conformance testing for systems with asynchronous interfaces and telecommunication protocols, Programmirovanie, 2007, vol. 33, no. 6, pp. 26–55.

    Google Scholar 

  38. The Linux Foundation consortium. LSB certification test suite, http://ispras.linuxbase.org/index.php/LSB_Certification_System

  39. Chupilko, M.M., Developing test systems of multi-modules hardware designs, Program. Comput. Software, 2012, vol. 38, no. 1, pp. 34–42.

    Article  Google Scholar 

  40. Zelenov, S.V. and Zelenova, S.A., Model-based testing of optimizing compilers, Proc. 19th IFIP TC6/WG6.1 Int. Conf. on Testing of Software and Communicating Systems — 7th International Workshop on Formal 2007), in Lecture Notes Comput. Sci., Berlin: Springer, 2007, vol. 4581, pp. 365–377.

    Google Scholar 

  41. Zelenov, S.V., Silakov, D.V., Petrenko, A.K., Conrad, M., and Fey I., Automatic test generation for model-based code generators, IEEE ISoLA 2006 Second Intern. Symposium on Leveraging Applications of Formal Methods, Verification and Validation, Paphos, Cyprus, 2006, pp. 68–75.

    Google Scholar 

  42. Kamkin, A.S., Method for automated imitative testing microprocessors with pipelined architecture on the basis of formal specifications, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2009.

    Google Scholar 

  43. Kornykhin, E.V., Method for automated generation of test programs for the verification of MMU, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2010.

    Google Scholar 

  44. Kamkin, A.S. and Tatarnikov, A., MicroTESK: An ADL-based reconfigurable test program generator for microprocessors, in Proc. 6th Spring/Summer Young Researchers’ Colloquium on Software Engineering (SYR-CoSE 2012), May 30–31, 2012, Perm, Russia, 2012.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Systems Programming, Russian Academy of Sciences, ul. A. Solzhenitsyna 25, Moscow, 109004, Russia

    V. V. Kulyamin & A. K. Petrenko

Authors
  1. V. V. Kulyamin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. K. Petrenko
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. V. Kulyamin.

Additional information

Original Russian Text © V.V. Kulyamin, A.K. Petrenko, 2014, published in Proceedings of the Institute for System Programming of RAS, 2014, Vol. 26, I. 1, pp. 9–26.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kulyamin, V.V., Petrenko, A.K. Evolution of the UniTESK test development technology. Program Comput Soft 40, 296–304 (2014). https://doi.org/10.1134/S0361768814050065

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768814050065

Keywords

Search

Navigation