Abstract
The protocol testing technology used in the next generation Internet should satisfy some new challenges and requirements. This paper focuses on the test suite description and test implementation techniques. TTCN-3 is chosen as the test suite description language and extended in both syntax and semantics to satisfy the requirements of protocol robustness testing. PITSv3, a protocol integrated testing system based on TTCN-3, is developed, and the extensions for robustness testing are implemented. Finally, two practical test applications are presented.
Similar content being viewed by others
References
ETSI: ETSI standard ES 201 873-1 V3.2.1 (2007-03): The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis, France. 2007
Piatkowski T F. An engineering discipline for distributed protocol systems. In: Proceedings of IFIP Workshop on Protocol Testing. 1981
Yin X. Research on theory and application of protocol integrated testing (in Chinese). Ph.D Thesis. Beijing: Tsinghua University, 2000
ISO/IEC: ISO/IEC 9646. Information Technology, Open Systems Interconnection, Conformance Testing Methodology and Framework. Geneva: ISO/IEC, 1991
Grabowski J, Hogrefe D, Rethy G, et al. An introduction to the testing and test control notation (TTCN-3). COMPUT NETW, 2003, 42(3): 375–403
Grabowski J, Wiles A, Willcock C, et al. On the design of the new testing language TTCN-3. In: Ural H, Probert R L, Bochmann G V, eds. Proc. of 13th IFIP International Conference on Testing of Communicating Systems (TestCom 2000). Ottawa: Kluwer Academic Publishers, 2000. 161–176
Baker P, Rudolph E, Schieferdecker I. Graphical test specification—The graphical format of TTCN-3. In: Reed R, Reed J, eds. Proc. of the 10th International SDL Forum (SDL 2001). Lecture Notes in Computer Science, vol. 2078. Copenhagen: Springer, 2001. 148–167
Schulz S, Vassiliou-Gioles T. Implementation of TTCN-3 test systems using the TRI. In: Schieferdecker I, König H, Wolisz A, eds. Proc. of the 14th IFIP International Conference on Testing of Communicating Systems (TestCom 2002). Berlin: Kluwer Academic Publishers, 2002. 425–442
Schieferdecker I, Vassiliou-Gioles T. Realizing distributed TTCN-3 test systems with TCI. In: Hogrefe D, Wiles A, eds. Proc. of the 15th IFIP International Conference on Testing of Communicating Systems (TestCom 2003). Lecture Notes in Computer Science, vol. 2644. Sophia Antipolis: Springer, 2003. 95–109
Telelogic TAU/Tester, http://www.telelogic.com
OpenTTCN, http://www.openttcn.com
Danet’s TTCN-3 Toolbox, http://www.danet.com
Testing Technology, http://www.testingtech.de
Floch A, Roudaut F, Sabiguero A, et al. Some lessons from an experiment using TTCN-3 for the RIPng testing. In: Khendek F, Dssouli R, eds. Proc. of the 17th IFIP International Conference of Testing of Communicating Systems (TestCom 2005). Lecture Notes in Computer Science, vol. 3502. Montreal: Springer, 2005. 318–332
Noudem F N, Viho C. Modeling, verifying and testing mobility protocol from SDL language. In: Prinz A, Reed R, Reed J, eds. Proc. of the 12th International SDL Forum (SDL 2005). Lecture Notes in Computer Science, vol. 3530. Grimstad, Norway: Springer, 2005. 198–209
Dibuz S, Szabo T, Torpis Z. BCMP performance test with TTCN-3 mobile node emulator. In: Groz R, Hierons R M, eds. Proc. of the 16th IFIP International Conference of Testing of Communicating Systems (TestCom 2004), Lecture Notes in Computer Science, vol. 2978. Oxford: Springer, 2004. 50–59
Din G, Tolea S, Schieferdecker I. Distributed load tests with TTCN-3. In: Uyar M Ü, Duale A Y, Fecko M A, eds. Proc. of the 18th IFIP International Conference on Testing of Communicating Systems (TestCom 2006), Lecture Notes in Computer Science, vol. 3964. New York: Springer, 2006. 177–196
Deussen P H, Din G, Schieferdecker I. A TTCN-3 based online test and validation platform for Internet services. In: Proc. of the 6th International Symposium on Autonomous Decentralized Systems (ISADS 2003). Pisa: IEEE Computer Society, 2003. 177–184
Nyberg A J. Use of TTCN-3 for software module testing. In: Uyar M Ü, Duale A Y, Fecko M A, eds. Proc. of the 18th IFIP International Conference on Testing of Communicating Systems (TestCom 2006). Lecture Notes in Computer Science, vol. 3964. New York: Springer, 2006. 161–176
Blom S, Deiß T, Ioustinova N, et al. TTCN-3 for distributed testing embedded software. In: Virbitskaite I, Voronkov A, eds. Proc. of the 6th International Andrei Ershov Memorial Conference—Perspectives of System Informatics (PSI 2006). Lecture Notes in Computer Science, vol. 4378. Novosibirsk, Russia: Springer, 2007. 98–111
Brzezinski K M. Intrusion detection as passive testing-linguistic support with TTCN-3 (Extended Abstract). In: Hämmerli B M, Sommer R, eds. Proc. of the 4th International Conference on Detection of Intrusions and Malware, and Vulnerability Assessment (DIMVA 2007). Lecture Notes in Computer Science, vol 4579. Lucerne: Springer, 2007. 79–88
Qian X H. Research on TTCN-3 compiling techniques and implementation (in Chinese). Master Thesis. Chengdu: Southwest Jiaotong University, 2004
Sa Z H. The design and implementation of test manager in TTCN-3 test system (in Chinese). Master Thesis. Huhhot: Inner Mongolia University, 2005
Jiang F, Zhang H. Design and implementation of TTCN-3 test executor using language translation (in Chinese). J Univ Sci Tech China, 2007, 37(9): 1155–1158
Zhang H, Jiang F. Design and implementation of TTCN-3 test system using C++ language translation (in Chinese). Comput Syst Appl, 2007, 10: 64–67
Huang C D, Jiang F. TTCN-3 based conformance testing of SIP (in Chinese). J Chin Comput Syst, 2007, 28(9): 1614–1618
Wu J P, Chen X H, Hao R B, et al. Protocol integrated test system based on formal technology-PITS (in Chinese). J Tsinghua Univ (Sci Tech), 1998, 38(S1): 26–29
Wang Z L. Design and implementation of core modules of IPv6 protocol test system (in Chinese). Master Thesis. Beijing: Tsinghua University, 2003
Dai Z R, Grabowski J, Neukirchen H. TIMEDTTCN-3—a real-time extension for TTCN-3. In: Schieferdecker I, König H, Wolisz A, eds. Proc. of the 14th IFIP International Conference on Testing of Communicating Systems (TestCom 2002). Berlin: Kluwer Academic Publishers, 2002. 407–424
Dai Z R, Grabowski J, Neukirchen H. TIMEDTTCN-3 based graphical real-time test specification. In: Hogrefe D, Wiles A, eds. Proc. of the 15th IFIP International Conference on Testing of Communicating Systems (TestCom 2003). Lecture Notes in Computer Science, vol. 2644. Sophia Antipolis: Springer, 2003. 110–127
Wang Z L, Wu J P, Yin X, et al. Using TIMEDTTCN-3 in interoperability testing for real-time communication systems. In: Uyar M Ü, Duale A Y, Fecko M A, eds. Proc. of the 18th IFIP International Conference on Testing of Communicating Systems (TestCom 2006). Lecture Notes in Computer Science, vol. 3964. New York: Springer, 2006. 324–340
Probert R, Xiong P, Stepien B. Life-cycle e-commerce testing with OO-TTCN-3. In: Núñez M, Maamar Z, Pelayo F L, et al., eds. Proc. of FORTE 2004 Workshops on the FormEMC, EPEW, ITM. Lecture Notes in Computer Science, vol. 3236. Toledo: Springer, 2004. 16–29
Schieferdecker I, Großmann J. Testing embedded control systems with TTCN-3—an overview on TTCN-3 continuous. In: Obermaisser R, Nah Y, Puschner P P, et al., eds. Proc. of the 5th IFIP Workshop on Software Technologies for Future Embedded and Ubiquitous Systems (SEUS 2007). Lecture Notes in Computer Science, vol. 4761. Santorini Island: Springer, 2007. 125–136
Lei Y, Tai K C. In-parameter-order: a test generation strategy for pairwise testing. In: Proc. of the 3rd IEEE International Symposium on High-Assurance Systems Engineering (HASE 1998). Washington, DC: Proceedings. IEEE Computer Society, 1998. 254–261
Tai K C, Lei Y. A test generation strategy for pairwise testing. IEEE T Software Eng, 2002, 28(1): 109–111
ETSI: ETSI Standard ES 201 873-6 (V3.2.1): Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 6: TTCN-3 Control Interface, 2007
ETSI: ETSI Standard ES 201 873-5 (V3.2.1): Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 5: TTCN-3 Runtime Interface, 2007
Rekhter Y, Li T, Hares S. A Border Gateway Protocol 4 (BGP-4), RFC 4271. 2006
Bates T, Rekhter Y, Chandra R, et al. Multiprotocol extensions for BGPv4, RFC 2858. 2000
Moy J. OSPF Version 2, RFC 2328. 1998
Zebra-0.94. Available: http://www.zebra.org
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Basic Research Program of China (973 Program) (Grant No. 2003CB314801), and the National Natural Science Foundation of China (Grant No. 60572082)
Rights and permissions
About this article
Cite this article
Yin, X., Wang, Z., Jing, C. et al. A TTCN-3-based protocol testing system and its extension. Sci. China Ser. F-Inf. Sci. 51, 1703–1722 (2008). https://doi.org/10.1007/s11432-008-0156-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11432-008-0156-4