Skip to main content

NTS: A Scalable Virtual Testbed Architecture with Dynamic Scheduling and Backpressure

  • Conference paper
  • First Online:
Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom 2019)

Abstract

Experimental platforms perform a key role in evaluating the proof-of-concept and innovations. Nowadays, researchers from academia and industries rely on expensive physical testbeds to evaluate their experiments, while there are very limited software testbeds in market, which usually not available or costly. In addition, the applications of existing traffic generators are restricted to their single function and performance in network area. It has come to a point that lack of validation and testing tools has tremendously jeopardized the innovation in this field. In this paper, we propose NTS, which is a scalable software-based virtual testbed architecture. The scheduling and management framework can dynamically schedule resource of services. The scheduling algorithm adopts the concept of cost proportional fairness scheduling, which takes the evaluated traffic proportion and packet arrival rate into account. By leveraging container technology, the resources of services are restrictedly managed and fully isolated without tampering the OS kernel’s scheduling mechanisms. Another advantage of the proposed testbed architecture is that the software can generate most kinds of backbone network traffic and can also be extended easily for customized protocol or traffic patterns. Our experiments show that the virtual testbed is generic scalable and cost-efficient, which is suitable and affordable for researchers in the field of network.

This work is partially supported by National Key R&D Program 2016 (Grant No. 2016YFB0801300), Strategic Priority Research Program of the Chinese academy of Sciences (Grant No. XDC02030000) and Youth Innovation Promotion Association CAS.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Xia, W., Wen, Y., Foh, C.H., Niyato, D., Xie, H.: A survey on software-defined networking. IEEE Commun. Surv. Tutorials 17(1), 27–51 (2015)

    Article  Google Scholar 

  2. ETSI, N.F.V.: Network functions virtualisation (nfv). Management and Orchestration, vol. 1, V1 (2014)

    Google Scholar 

  3. Intel: Data plane development kit (2018)

    Google Scholar 

  4. Olsson, R.: Pktgen the Linux packet generator. In: Proceedings of the Linux Symposium, Ottawa, Canada, vol. 2, pp. 11–24 (2005)

    Google Scholar 

  5. Goel, U., Wittie, M.P., Claffy, K.C., Le, A.: Survey of end-to-end mobile network measurement testbeds, tools, and services. IEEE Commun. Surv. Tutorials 18(1), 105–123 (2016)

    Article  Google Scholar 

  6. Merkel, D.: Docker: lightweight Linux containers for consistent development and deployment. Linux J. 2014(239), 2 (2014)

    Google Scholar 

  7. Olson, M., Christensen, K., Lee, S., Yun, J.: Hybrid web server: traffic analysis and prototype. In: 2011 IEEE 36th Conference on Local Computer Networks, pp. 131–134. IEEE (2011)

    Google Scholar 

  8. Menage, P.: Linux kernel documentation: Cgroups (2017)

    Google Scholar 

  9. Yan, J., Jin, D.: Vt-mininet: Virtual-time-enabled mininet for scalable and accurate software-define network emulation. In: Proceedings of the 1st ACM SIGCOMM Symposium on Software Defined Networking Research, vol. 27. ACM (2015)

    Google Scholar 

  10. Molnar, I.: Linux kernel documentation: CFS scheduler design (2017)

    Google Scholar 

  11. Kulkarni, S.G., et al.: NFVnice: dynamic backpressure and scheduling for NFV service chains. In: Proceedings of the Conference of the ACM Special Interest Group on Data Communication, pp. 71–84. ACM (2017)

    Google Scholar 

  12. Kanhere, S.S., Sethu, H., Parekh, A.B.: Fair and efficient packet scheduling using elastic round robin. IEEE Trans. Parallel Distrib. Syst. 13(3), 324–336 (2002)

    Article  Google Scholar 

  13. Emmerich, P., Gallenmüller, S., Raumer, D., Wohlfart, F., Carle, G.: MoonGen: a scriptable high-speed packet generator. In: Proceedings of the 2015 Internet Measurement Conference, pp. 275–287. ACM (2015)

    Google Scholar 

  14. Rotsos, C., Sarrar, N., Uhlig, S., Sherwood, R., Moore, A.W.: OFLOPS: an open framework for openflow switch evaluation. In: Taft, N., Ricciato, F. (eds.) PAM 2012. LNCS, vol. 7192, pp. 85–95. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-28537-0_9

    Chapter  Google Scholar 

  15. Muelas, D., Ramos, J., López de Vergara, J.E.: Software-driven definition of virtual testbeds to validate emergent network technologies. Information 9(2), 45 (2018)

    Article  Google Scholar 

  16. Weigle, M.C., Adurthi, P., Hernández-Campos, F., Jeffay, K., Smith, F.D.: Tmix: a tool for generating realistic TCP application workloads in ns-2. ACM SIGCOMM Comput. Commun. Rev. 36(3), 65–76 (2006)

    Article  Google Scholar 

  17. Julián-Moreno, G., Leira, R., de Vergara, J.E.L., Gómez-Arribas, F.J., González, I.: On the feasibility of 40 gbps network data capture and retention with general purpose hardware. In: Proceedings of the 33rd Annual ACM Symposium on Applied Computing, pp. 970–978. ACM (2018)

    Google Scholar 

  18. Shalabi, Y., Yan, M., Honarmand, N., Lee, R.B., Torrellas, J.: Record-replay architecture as a general security framework. In: 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA), pp. 180–193. IEEE (2018)

    Google Scholar 

  19. Gad, R., Kappes, M., Mueller-Bady, R., Medina-Bulo, I.: Header field based partitioning of network traffic for distributed packet capturing and processing. In: 2014 IEEE 28th International Conference on Advanced Information Networking and Applications (AINA), pp. 866–874. IEEE (2014)

    Google Scholar 

  20. Lee, J., Lee, S., Lee, J., Yi, Y., Park, K.: Flosis: A highly scalable network flow capture system for fast retrieval and storage efficiency. In: USENIX Annual Technical Conference, pp. 445–457 (2015)

    Google Scholar 

  21. Frömmgen, A., Stohr, D., Fornoff, J., Effelsberg, W., Buchmann, A.: Capture and replay: reproducible network experiments in mininet. In: Proceedings of the 2016 ACM SIGCOMM Conference, pp. 621–622. ACM (2016)

    Google Scholar 

  22. Kim, W., Roopakalu, A., Li, K.Y., Pai, V.S.: Understanding and characterizing planetlab resource usage for federated network testbeds. In: Proceedings of the 2011 ACM SIGCOMM Conference on Internet Measurement Conference, pp. 515–532. ACM (2011)

    Google Scholar 

  23. Aschenbruck, N., Bauer, J., Bieling, J., Bothe, A., Schwamborn, M.: Let’s move: adding arbitrary mobility to WSN testbeds. In: 2012 21st International Conference on Computer Communications and Networks (ICCCN), pp. 1–7. IEEE (2012)

    Google Scholar 

  24. Nils, A., Jan Bauer, J.B.A.B.M.S.: WSNLab - a security testbed and security architecture for WSNS. In: 2011 IEEE 36th Conference on Local Computer Networks, pp. 4–7. IEEE (2011)

    Google Scholar 

  25. Zheng, C., Tang, Q., Lu, Q., Li, J., Zhou, Z., Liu, Q.: Janus: a user-level TCP stack for processing 40 million concurrent TCP connections. In: 2018 IEEE International Conference on Communications (ICC), pp. 1–7. IEEE (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhou Zhou .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhong, Y. et al. (2019). NTS: A Scalable Virtual Testbed Architecture with Dynamic Scheduling and Backpressure. In: Wang, X., Gao, H., Iqbal, M., Min, G. (eds) Collaborative Computing: Networking, Applications and Worksharing. CollaborateCom 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 292. Springer, Cham. https://doi.org/10.1007/978-3-030-30146-0_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30146-0_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30145-3

  • Online ISBN: 978-3-030-30146-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics