skip to main content
10.1145/2396556.2396567acmconferencesArticle/Chapter ViewAbstractPublication PagesancsConference Proceedingsconference-collections
research-article

NetBump: user-extensible active queue management with bumps on the wire

Published: 29 October 2012 Publication History

Abstract

Engineering large-scale data center applications built from thousands of commodity nodes requires both an underlying network that supports a wide variety of traffic demands, and low latency at microsecond timescales. Many ideas for adding innovative functionality to networks, especially active queue management strategies, require either modifying packets or performing alternative queuing to packets in-flight on the data plane. However, configuring packet queuing, marking, and dropping is challenging, since buffering in commercial switches and routers is not programmable.
In this work, we present NetBump, a platform for experimenting with, evaluating, and deploying a wide variety of active queue management strategies to network data planes with minimal intrusiveness and at low latency. NetBump leaves existing switches and endhosts unmodified by acting as a "bump on the wire," examining, marking, and forwarding packets at line rate in tens of microseconds to implement a variety of virtual active queuing disciplines and congestion control mechanisms. We describe the design of NetBump, and use it to implement several network functions and congestion control protocols including DCTCP and 802.1Qau quantized congestion notification.

References

[1]
M. Alizadeh, B. Atikoglu, A. Kabbani, A. Lakshmikantha, R. Pan, B. Prabhakar, and M. Seaman. Data Center Transport Mechanisms: Congestion Control Theory and IEEE Standardization. In Allerton CCC, 2008.
[2]
M. Alizadeh, A. Greenberg, D. A. Maltz, J. Padhye, P. Patel, B. Prabhakar, S. Sengupta, and M. Sridharan. Data center TCP (DCTCP). In ACM SIGCOMM 2010.
[3]
M. B. Anwer, M. Motiwala, M. b. Tariq, and N. Feamster. SwitchBlade: A Platform for Rapid Deployment of Network Protocols on Programmable Hardware. In ACM SIGCOMM 2010.
[4]
J. Aweya, M. Ouellette, D. Y. Montuno, and K. Felske. Rate-based Proportional-integral Control Scheme for Active Queue Management. IJNM, 16, 2006.
[5]
P. Buonadonna, A. Geweke, and D. Culler. An Implementation and Analysis of the Virtual Interface Architecture. In ACM/IEEE CDROM 1998.
[6]
Chelsio Network Interface. http://www.chelsio.com.
[7]
M. Dobrescu, K. Argyraki, G. Iannaccone, M. Manesh, and S. Ratnasamy. Controlling Parallelism in a Multicore Software Router. In ACM Presto 2010.
[8]
M. Dobrescu, N. Egi, K. Argyraki, B.-G. Chun, K. Fall, G. Iannaccone, A. Knies, M. Manesh, and S. Ratnasamy. RouteBricks: Exploiting Parallelism to Scale Software Routers. In ACM SOSP 2009.
[9]
N. Egi, A. Greenhalgh, M. Handley, M. Hoerdt, F. Huici, L. Mathy, and P. Papadimitriou. Forwarding Path Architectures for Multicore Software Routers. In ACM Presto 2010.
[10]
D. Ely, S. Savage, and D. Wetherall. Alpine: A User-level Infrastructure for Network Protocol Development. In USITS 2001.
[11]
S. Floyd. TCP and Explicit Congestion Notification. ACM SIGCOMM CCR, 24(5), 1994.
[12]
S. Floyd and V. Jacobson. Random Early Detection Gateways for Congestion Avoidance. IEEE/ACM TON, 1(4), 1993.
[13]
R. J. Gibbens and F. Kelly. Distributed Connection Acceptance Control for a Connectionless Network. In Teletraffic Engineering in a Competitive World. Elsevier, 1999.
[14]
N. Gude, T. Koponen, J. Pettit, B. Pfaff, M. Casado, N. McKeown, and S. Shenker. NOX: Towards an Operating System for Networks. ACM SIGCOMM CCR, 38(3), 2008.
[15]
A. Kabbani and M. Alizadeh. Personal Communication, 2011.
[16]
A. Kabbani, M. Alizadeh, M. Yasuda, R. Pan, and B. Prabhakar. AF-QCN: Approximate Fairness with Quantized Congestion Notification for Multi-tenanted Data Centers. In IEEE Hot Interconnects 2010.
[17]
S. Karandikar, S. Kalyanaraman, P. Bagal, and B. Packer. TCP Rate Control. In ACM SIGCOMM 2000.
[18]
D. Katabi, M. Handley, and C. Rohrs. Congestion Control for High Bandwidth-delay Product Networks. In ACM SIGCOMM 2002.
[19]
A. D. Keromytis and J. L. Wright. Transparent Network Security Policy Enforcement. In USENIX ATC 2000.
[20]
E. Kohler, R. Morris, B. Chen, J. Jannotti, and M. F. Kaashoek. The Click Modular Router. ACM ToCS, 18(3), 2000.
[21]
S. Kunniyur and R. Srikant. An Adaptive Virtual Queue (AVQ) Algorithm for Active Queue Management. IEEE/ACM TON, 12(2), 2004.
[22]
A. Kuzmanovic. The Power of Explicit Congestion Notification. In ACM SIGCOMM 2005.
[23]
Linux Traffic Control howto. http://tldp.org/HOWTO/Traffic-Control-HOWTO.
[24]
G. Lu, C. Guo, Y. Li, Z. Zhou, T. Yuan, H. Wu, Y. Xiong, R. Gao, and Y. Zhang. ServerSwitch: A Programmable and High Performance Platform for Data Center Networks. In USENIX NSDI 2011.
[25]
G. Lu, Y. Shi, C. Guo, and Y. Zhang. CAFE: A Configurable Packet Forwarding Engine for Data Center Networks. In ACM PRESTO 2009.
[26]
M. Manesh, K. Argyraki, M. Dobrescu, N. Egi, K. Fall, G. Iannaccone, E. Kohler, and S. Ratnasamy. Evaluating the Suitability of Server Network Cards for Software Routers. In ACM PRESTO 2010.
[27]
N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. OpenFlow: Enabling Innovation in Campus Networks. ACM SIGCOMM CCR, 38(2), 2008.
[28]
Myricom Sniffer10G. http://www.myricom.com/support/downloads/sniffer.html.
[29]
J. Naous, G. Gibb, S. Bolouki, and N. McKeown. NetFPGA: Reusable Router Architecture for Experimental Research. In ACM PRESTO 2008.
[30]
NEC/Stanford: 10G QCN Implementation on Hardware. http://www.ieee802.org/1/files/public/docs2009/au-yasuda-10G-QCN-Implementation-1109.pdf.
[31]
OpenOnload. http://www.openonload.org.
[32]
J. Padhye, V. Firoiu, D. Towsley, and J. Kurose. Modeling TCP Throughput: A Simple Model and its Empirical Validation. In ACM SIGCOMM 1998.
[33]
PF\_RING Direct NIC Access. http://www.ntop.org/products/pf_ring/dna/.
[34]
G. Porter, R. Kapoor, S. Das, M. Al-Fares, H. Weatherspoon, B. Prabhakar, and A. Vahdat. NetBump: User-extensible Active Queue Management with Bumps on the Wire. Technical report, CSE, University of California, San Diego, La Jolla, CA, USA, 2012.
[35]
L. Rizzo. Netmap: A Novel Framework for Fast Packet I/O. In USENIX ATC 2012.
[36]
L. Rizzo and M. Landi. Netmap: Memory-mapped Access to Network Devices. In ACM SIGCOMM 2011.
[37]
E. Rubow, R. McGeer, J. Mogul, and A. Vahdat. Chimpp: A Click-based Programming and Simulation Environment for Reconfigurable Networking Hardware. In ACM/IEEE ANCS 2010.
[38]
J. Shafer and S. Rixner. RiceNIC: A Reconfigurable Network Interface for Experimental Research and Education. In ACM ExpCS 2007.
[39]
N. Shah. Understanding Network Processors. Master's thesis, University of California, Berkeley, Calif., 2001.
[40]
A. Shieh, S. Kandula, and E. G. Sirer. SideCar: Building Programmable Datacenter Networks without Programmable Switches. In ACM Hotnets 2010.
[41]
SMC SMC10GPCIe-10BT Network Adapter. http://www.smc.com/files/AY/DS_SMC10GPCIe-10BT.pdf.
[42]
SolarFlare Solarstorm Network Adapters. http://www.solarflare.com/Enterprise-10GbE-Adapters.
[43]
J. Turner. New Directions in Communications (or which way to the Information Age?). IEEE Communications Magazine, 24(10), 2002.
[44]
T. von Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A User-level Network Interface for Parallel and Distributed Computing. In ACM SOSP 1995.
[45]
Z. Wang. Internet QoS: Architectures and Mechanisms for Quality of Service. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1st edition, 2001.
[46]
M. Welsh, A. Basu, and T. von Eicken. ATM and Fast Ethernet Network Interfaces for User-level Communication. In IEEE HPCA 1997.
[47]
Q. Wu, D. J. Mampilly, and T. Wolf. Distributed Runtime Load-balancing for Software Routers on Homogeneous Many-core Processors. In ACM Presto 2010.

Cited By

View all
  • (2021)MimicNetProceedings of the 2021 ACM SIGCOMM 2021 Conference10.1145/3452296.3472926(287-304)Online publication date: 9-Aug-2021
  • (2018)Fast Network Simulation Through Approximation orProceedings of the 17th ACM Workshop on Hot Topics in Networks10.1145/3286062.3286083(141-147)Online publication date: 15-Nov-2018
  • (2017)FlexplaneProceedings of the 14th USENIX Conference on Networked Systems Design and Implementation10.5555/3154630.3154666(437-451)Online publication date: 27-Mar-2017

Index Terms

  1. NetBump: user-extensible active queue management with bumps on the wire

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ANCS '12: Proceedings of the eighth ACM/IEEE symposium on Architectures for networking and communications systems
    October 2012
    270 pages
    ISBN:9781450316859
    DOI:10.1145/2396556
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. congestion control
    2. datapath programming
    3. vaqm

    Qualifiers

    • Research-article

    Conference

    ANCS '12

    Acceptance Rates

    Overall Acceptance Rate 88 of 314 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 22 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)MimicNetProceedings of the 2021 ACM SIGCOMM 2021 Conference10.1145/3452296.3472926(287-304)Online publication date: 9-Aug-2021
    • (2018)Fast Network Simulation Through Approximation orProceedings of the 17th ACM Workshop on Hot Topics in Networks10.1145/3286062.3286083(141-147)Online publication date: 15-Nov-2018
    • (2017)FlexplaneProceedings of the 14th USENIX Conference on Networked Systems Design and Implementation10.5555/3154630.3154666(437-451)Online publication date: 27-Mar-2017

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media