Skip to main content
SpringerLink
Log in

NfvInsight: A Framework for Automatically Deploying and Benchmarking VNF Chains

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

With the advent of virtualization techniques and software-defined networking (SDN), network function virtualization (NFV) shifts network functions (NFs) from hardware implementations to software appliances, between which exists a performance gap. How to narrow the gap is an essential issue of current NFV research. However, the cumbersomeness of deployment, the water pipe effect of virtual network function (VNF) chains, and the complexity of the system software stack together make it tough to figure out the cause of low performance in the NFV system. To pinpoint the NFV system performance issues, we propose NfvInsight, a framework for automatic deployment and benchmarking VNF chains. Our framework tackles the challenges in NFV performance analysis. The framework components include chain graph generation, automatic deployment, and fine granularity measurement. The design and implementation of each component have their advantages. To the best of our knowledge, we make the first attempt to collect rules forming a knowledge base for generating reasonable chain graphs. NfvInsight deploys the generated chain graphs automatically, which frees the network operators from executing at least 391 lines of bash commands for a single test. To diagnose the performance bottleneck, NfvInsight collects metrics from multiple layers of the software stack. Specifically, we collect the network stack latency distribution ingeniously, introducing only less than 2.2% overhead. We showcase the convenience and usability of NfvInsight in finding bottlenecks for both VNF chains and the underlying system. Leveraging our framework, we find several design flaws of the network stack, which are unsuitable for packet forwarding inside one single server under the NFV circumstance. Our optimization for these flaws gains at most 3x performance improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Hwang J, Ramakrishnan K K, Wood T. NetVM: High performance and flexible networking using virtualization on commodity platforms. IEEE Transactions on Network and Service Management, 2015, 12(1): 34-47. https://doi.org/10.1109/TNSM.2015.2401568.

    Article  Google Scholar 

  2. Zhang W, Liu G, Zhang W, Shah N, Lopreiato P, Todeschi G, Ramakrishnan K, Wood T. OpenNetVM: A platform for high performance network service chains. In Proc. the 2016 ACM SIGCOMM Workshop on Hot Topics in Middleboxes and Network Function Virtualization, August 2016, pp.26-31. https://doi.org/10.1145/2940147.2940155.

  3. Gember-Jacobson A, Viswanathan R, Prakash C, Grandl R, Khalid J, Das S, Akella A. OpenNF: Enabling innovation in network function control. ACM SIGCOMM Computer Communication Review, 2014, 44(4): 163-174. https://doi.org/10.1145/2740070.2626313.

    Article  Google Scholar 

  4. Bremler-Barr A, Harchol Y, Hay D. Openbox: A software-defined framework for developing, deploying, and managing network functions. In Proc. the 2016 ACM SIGCOMM Conference, August 2016, pp.511-524. https://doi.org/10.1145/2934872.2934875.

  5. Katsikas G P, Barbette T, Kostic D, Steinert R, Maguire G Q. Metron: NFV service chains at the true speed of the underlying hardware. In Proc. the 15th USENIX Symposium on Networked Systems Design and Implementation, April 2018, pp.171-186.

  6. Sun C, Bi J, Zheng Z, Yu H, Hu H. NFP: Enabling network function parallelism in NFV. In Proc. the Conference of the ACM Special Interest Group on Data Communication, August 2017, pp.43-56. https://doi.org/10.1145/3098822.3098826.

  7. Yi X, Duan J, Wu C. GPUNFV: A GPU-accelerated NFV system. In Proc. the 1st Asia-Pacific Workshop on Networking, August 2017, pp.85-91. https://doi.org/10.1145/3106989.3106990.

  8. Bronstein Z, Roch E, Xia J, Molkho A. Uniform handling and abstraction of NFV hardware accelerators. IEEE Network, 2015, 29(3): 22-29. https://doi.org/10.1109/MNET.2015.7113221.

    Article  Google Scholar 

  9. Kachris C, Sirakoulis G, Soudris D. Network function virtualization based on FPGAs: A framework for all-programmable network devices. arXiv:1406.0309, 2014. https://arxiv.org/ftp/arxiv/papers/1406/1406.0309.pdf, Dec. 2021.

  10. Ersue M. ETSI NFV management and orchestration—An overview. https://www.ietf.org/proceedings/88/slides/slides-88-opsawg-6.pdf, Dec. 2021.

  11. Ma W, Sandoval O, Beltran J, Pan D, Pissinou N. Traffic aware placement of interdependent NFV middleboxes. In Proc. the 2017 IEEE Conference on Computer Communications, May 2017. https://doi.org/10.1109/INFOCOM.2017.8056993.

  12. Nam J, Seo J, Shin S. Probius: Automated approach for VNF and service chain analysis in software-defined NFV. In Proc. the Symposium on SDN Research, March 2018, Article No. 14. https://doi.org/10.1145/3185467.3185495.

  13. Sherry J, Hasan S, Scott C, Krishnamurthy A, Ratnasamy S, Sekar V. Making middleboxes someone else’s problem: Network processing as a cloud service. ACM SIGCOMM Computer Communication Review, 2012, 42(4): 13-24. https://doi.org/10.1145/2377677.2377680.

    Article  Google Scholar 

  14. Koshy T. Catalan Numbers with Applications. Oxford University Press, 2008.

  15. Prakash C, Lee J, Turner Y, Kang J M, Akella A, Banerjee S, Clark C, Ma Y, Sharma P, Zhang Y. PGA: Using graphs to express and automatically reconcile network policies. ACM SIGCOMM Computer Communication Review, 2015, 45(4): 29-42. https://doi.org/10.1145/2829988.2787506.

    Article  Google Scholar 

  16. Hubert B, Maxwell G, Van Mook R et al. Linux advanced routing & traffic control HOWTO. https://tldp.org/HOWTO/pdf/Adv-Routing-HOWTO.pdf, Dec. 2021.

  17. Blake G, Saidi A G. Where does the time go? Characterizing tail latency in memcached. In Proc. the 2015 IEEE International Symposium on Performance Analysis of Systems and Software, March 2015, pp.21-31. https://doi.org/10.1109/IS-PASS.2015.7095781.

  18. Moradi F, Flinta C, Johnsson A, Meirosu C. ConMon: An automated container based network performance monitoring system. In Proc. the 2017 IFIP/IEEE Symposium on Integrated Network and Service Management, May 2017, pp.54-62. https://doi.org/10.23919/INM.2017.7987264.

  19. Naik P, Shaw D K, Vutukuru M. NFVPerf: Online performance monitoring and bottleneck detection for NFV. In Proc. the 2016 IEEE Conference on Network Function Virtualization and Software Defined Networks, November 2016, pp.154-160. https://doi.org/10.1109/NFV-SDN.2016.7919491.

  20. Peuster M, Karl H. Understand your chains: Towards performance profile-based network service management. In Proc. the 5th European Workshop on Software-Defined Networks, October 2016, pp.7-12. https://doi.org/10.1109/EWSDN.2016.9.

  21. Katsikas G P, Maguire G Q, Kostić D. Profiling and accelerating commodity NFV service chains with SCC. Journal of Systems and Software, 2017, 127: 12-27. https://doi.org/10.1016/j.jss.2017.01.005.

    Article  Google Scholar 

  22. Rajagopalan S, Williams D, Jamjoom H, Warfield A. Split/merge: System support for elastic execution in virtual middleboxes. In Proc. the 10th USENIX Symposium on Networked Systems Design and Implementation, April 2013, pp.227-240.

  23. Zhang Y, Anwer B, Gopalakrishnan V, Han B, Reich J, Shaikh A, Zhang Z L. ParaBox: Exploiting parallelism for virtual network functions in service chaining. In Proc. the Symposium on SDN Research, April 2017, pp.143-149. https://doi.org/10.1145/3050220.3050236.

  24. Duan Q. Cloud service performance evaluation: Status, challenges, and opportunities—A survey from the system modeling perspective. Digital Communications and Networks, 2017, 3(2): 101-111. https://doi.org/10.1016/j.dcan.2016.12.002.

    Article  Google Scholar 

  25. Feng H, Llorca J, Tulino A M, Raz D, Molisch A F. Approximation algorithms for the NFV service distribution problem. In Proc. the 2017 IEEE Conference on Computer Communications, May 2017. https://doi.org/10.1109/INFO-COM.2017.8057039.

  26. Agarwal S, Malandrino F, Chiasserini C F, De S. Joint VNF placement and CPU allocation in 5G. In Proc. the 2018 IEEE Conference on Computer Communications, April 2018, pp.1943-1951. https://doi.org/10.1109/INFOCOM.2018.8485943.

  27. Cziva R, Anagnostopoulos C, Pezaros D P. Dynamic, latency-optimal vNF placement at the network edge. In Proc. the 2018 IEEE Conference on Computer Communications, April 2018, pp.693-701. https://doi.org/10.1109/INFOCOM.2018.8486021.

  28. Luizelli M C, Raz D, Sa’ar Y. Optimizing NFV chain deployment through minimizing the cost of virtual switching. In Proc. the 2018 IEEE Conference on Computer Communications, April 2018, pp.2150-2158. https://doi.org/10.1109/INFOCOM.2018.8486315.

  29. Bari M F, Chowdhury S R, Ahmed R, Boutaba R. On orchestrating virtual network functions. In Proc. the 11th International Conference on Network and Service Management, November 2015, pp.50-56. https://doi.org/10.1109/CNSM.2015.7367338.

Download references

Acknowledgements

We thank all the anonymous shepherd and reviewers for their valuable comments. We are especially grateful to Zhi-Cheng Yao (Institute of Computing Technology, Chinese Academy of Sciences, Beijing) for his generous help.

Author information

Authors and Affiliations

  1. State Key Laboratory of Computer Architecture, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100190, China

    Tian-Ni Xu, Hai-Feng Sun, Di Zhang, Xiao-Ming Zhou, Sa Wang & Yun-Gang Bao

  2. University of Chinese Academy of Sciences, Beijing, 100049, China

    Tian-Ni Xu, Hai-Feng Sun, Di Zhang, Xiao-Ming Zhou, Sa Wang & Yun-Gang Bao

  3. School of Information and Electronics, Beijing Institute of Technology, Beijing, 100081, China

    Xiu-Feng Sui

  4. Peng Cheng Laboratory, Shenzhen, 518055, China

    Sa Wang & Yun-Gang Bao

  5. Department of Computer Science and Technology, Peking University, Beijing, 100871, China

    Qun Huang

Authors
  1. Tian-Ni Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hai-Feng Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Di Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiao-Ming Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiu-Feng Sui
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sa Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Qun Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Yun-Gang Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yun-Gang Bao.

Supplementary Information

ESM 1

(PDF 293 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, TN., Sun, HF., Zhang, D. et al. NfvInsight: A Framework for Automatically Deploying and Benchmarking VNF Chains. J. Comput. Sci. Technol. 37, 680–698 (2022). https://doi.org/10.1007/s11390-020-0434-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-020-0434-1

Keywords

Search

Navigation