Efficient Policy-Rich Rate Enforcement with Phantom Queues
Authors: 
Ammar Tahir, Prateesh Goyal, Ilias Marinos, Mike Evans, Radhika MittalAuthors Info & Claims
Ammar Tahir, Prateesh Goyal, Ilias Marinos, Mike Evans, Radhika MittalAuthors Info & ClaimsPages 1000 - 1013
Abstract
ISPs routinely rate-limit user traffic. In addition to correctly enforcing the desired rates, rate-limiting mechanisms must be able to support rich rate-sharing policies within each traffic aggregate (e.g. per-flow fairness, weighted fairness, and prioritization). This must be done at scale to support the vast magnitude of users efficiently. There are two primary rate-limiting mechanisms - traffic shaping (that buffers packets in queues to enforce the desired rates and policies) and traffic policing (that filters packets as per the desired rates without buffering them). Policers are lightweight and scalable but don't support rich policy enforcement and often provide poor rate enforcement (being notoriously hard to configure). Shapers, on the other hand, achieve desired rates and policies, but at the cost of high system resource (memory and CPU) utilization impacting scalability. This paper explores whether we can get the best of both worlds. We present our system BC-PQP, which augments a policer with (i) multiple phantom queues that simulate buffer occupancy using counters and enable rich policy enforcement, and (ii) a novel burst-control mechanism that enables auto-configuration of the queues for correct rate enforcement. Our system achieves the rate and policy enforcement properties close to that of a shaper with 7× higher efficiency.
References
[1]
[n. d.]. AT&T: Learn About Video Management. https://www.att.com/support/article/wireless/KM1169198/. ([n. d.]).
[2]
[n. d.]. Linux Hierarchical Token Buckets. http://luxik.cdi.cz/~devik/qos/htb/. ([n. d.]).
[3]
[n. d.]. TCP BBR congestion control comes to GCP - your internet just got faster | google cloud blog. ([n. d.]).
[4]
[n. d.]. VMWare SD-WAN. https://docs.vmware.com/en/VMware-SD-WAN/3.3/VMware-SD-WAN-by-VeloCloud-Administration-Guide/GUID-EE8C35B8-FA4E-4C59-9AC2-4FD14509F60C.html. ([n. d.]).
[5]
[n. d.]. What Is SD-WAN? https://www.cisco.com/c/en/us/solutions/enterprise-networks/sd-wan/what-is-sd-wan.html. ([n. d.]).
[6]
2023. (Sep 2023). https://www.cisco.com/c/en/us/support/docs/quality-of-service-qos/qos-policing/19645-policevsshape.html#traffic
[7]
Saamer Akhshabi, Lakshmi Anantakrishnan, Constantine Dovrolis, and Ali C Begen. 2013. Server-based traffic shaping for stabilizing oscillating adaptive streaming players. In 23rd ACM Workshop on Network and Operating Systems Support for Digital Audio and Video.
[8]
Mohammad Alizadeh, Abdul Kabbani, Tom Edsall, Balaji Prabhakar, Amin Vahdat, and Masato Yasuda. 2012. Less is more: Trading a little bandwidth for {Ultra-Low} latency in the data center. In 9th USENIX Symposium on Networked Systems Design and Implementation.
[9]
Guido Appenzeller, Isaac Keslassy, and Nick McKeown. 2004. Sizing router buffers. ACM SIGCOMM Computer Communication Review (2004).
[10]
Eneko Atxutegi, Fidel Liberal, Habtegebreil Kassaye Haile, Karl-Johan Grinnemo, Anna Brunstrom, and Ake Arvidsson. 2018. On the use of TCP BBR in cellular networks. IEEE Communications Magazine (2018).
[11]
Ralph P Boas Jr and John W Wrench Jr. 1971. Partial sums of the harmonic series. The American Mathematical Monthly (1971).
[12]
Ilker Nadi Bozkurt, Yilun Zhou, Theophilus Benson, Bilal Anwer, Dave Levin, Nick Feamster, Aditya Akella, Balakrishnan Chandrasekaran, Cheng Huang, Bruce Maggs, et al. 2015. Dynamic prioritization of traffic in home networks. In CoNEXT Student Workshop.
[13]
Lawrence S. Brakmo, Sean W. O'Malley, and Larry L. Peterson. 1994. TCP Vegas: New Techniques for Congestion Detection and Avoidance. In ACM Conference on Communications Architectures, Protocols and Applications.
[14]
Lloyd Brown, Yash Kothari, Akshay Narayan, Arvind Krishnamurthy, Aurojit Panda, Justine Sherry, and Scott Shenker. 2023. How I Learned To Stop Worrying About CCA Contention. In 31st Workshop on Hot Topics in Networks.
[15]
Milena Butto, Elisa Cavallero, and Alberto Tonietti. 1991. Effectiveness of the'leaky bucket'policing mechanism in ATM networks. IEEE Journal on selected areas in communications (1991).
[16]
Frank Cangialosi, Akshay Narayan, Prateesh Goyal, Radhika Mittal, Mohammad Alizadeh, and Hari Balakrishnan. 2021. Site-to-site internet traffic control. In 16th European Conference on Computer Systems.
[17]
Neal Cardwell, Yuchung Cheng, C. Stephen Gunn, Soheil Hassas Yeganeh, and Van Jacobson. 2016. BBR: Congestion-Based Congestion Control. ACM Queue (2016).
[18]
Saoussen Chaabnia and Aref Meddeb. 2018. Slicing aware QoS/QoE in software defined smart home network. In IEEE/IFIP Network Operations and Management Symposium.
[19]
Saahil Claypool, Jae Chung, and Mark Claypool. 2021. Measurements comparing TCP cubic and TCP BBR over a satellite network. In IEEE 18th Annual Consumer Communications & Networking Conference (CCNC).
[20]
Alan Demers, Srinivasan Keshav, and Scott Shenker. 1989. Analysis and simulation of a fair queueing algorithm. ACM SIGCOMM Computer Communication Review (1989).
[21]
Tobias Flach, Pavlos Papageorge, Andreas Terzis, Luis Pedrosa, Yuchung Cheng, Tayeb Karim, Ethan Katz-Bassett, and Ramesh Govindan. 2016. An Internet-Wide Analysis of Traffic Policing. In ACM Conference on Special Interest Group on Data Communication (SIGCOMM).
[22]
G Gallassi, G Rigolio, and Luigi Fratta. 1989. ATM: Bandwidth assignment and bandwidth enforcement policies. In IEEE Global Telecommunications Conference and Exhibition'Communications Technology for the 1990s and Beyond'.
[23]
Leonidas Georgiadis, Roch Guérin, Vinod Peris, and Kumar N Sivarajan. 1996. Efficient network QoS provisioning based on per node traffic shaping. IEEE/ACM transactions on networking (1996).
[24]
Hassan Habibi Gharakheili, Jacob Bass, Luke Exton, and Vijay Sivaraman. 2014. Personalizing the home network experience using cloud-based SDN. In Proceeding of IEEE International symposium on a world of wireless, mobile and multimedia networks 2014.
[25]
Sangtae Ha, Injong Rhee, and Lisong Xu. 2008. CUBIC: a New TCP-friendly High-Speed TCP Variant. ACM SIGOPS Operating System Review (2008).
[26]
Joseph SM Ho, Hüseyin Uzunalioglu, and Ian F Akyildiz. 1995. Cooperating leaky bucket for average rate enforcement of VBR video traffic in ATM networks. In Proceedings of INFOCOM'95.
[27]
Rajendra K Jain, Dah-Ming W Chiu, William R Hawe, et al. 1984. A quantitative measure of fairness and discrimination. Eastern Research Laboratory, Digital Equipment Corporation, Hudson, MA (1984).
[28]
Arash Molavi Kakhki, Fangfan Li, David Choffnes, Ethan Katz-Bassett, and Alan Mislove. 2016. Bingeon under the microscope: Understanding t-mobiles zero-rating implementation. In Proceedings of the 2016 workshop on QoE-based Analysis and Management of Data Communication Networks.
[29]
Alok Kumar, Sushant Jain, Uday Naik, Anand Raghuraman, Nikhil Kasinadhuni, Enrique Cauich Zermeno, C Stephen Gunn, Jing Ai, Björn Carlin, Mihai Amarandei-Stavila, et al. 2015. BwE: Flexible, hierarchical bandwidth allocation for WAN distributed computing. In ACM Conference on Special Interest Group on Data Communication (SIGCOMM).
[30]
Himal Kumar, Hassan Habibi Gharakheili, and Vijay Sivaraman. 2013. User control of quality of experience in home networks using SDN. In 2013 IEEE International conference on advanced networks and telecommunications systems (ANTS).
[31]
Srisankar Kunniyur and Rayadurgam Srikant. 2001. Analysis and design of an adaptive virtual queue (AVQ) algorithm for active queue management. ACM SIGCOMM Computer Communication Review (2001).
[32]
Srisankar S Kunniyur and Rayadurgam Srikant. 2004. An adaptive virtual queue (AVQ) algorithm for active queue management. IEEE/ACM Transactions on networking (2004).
[33]
Fangfan Li, Arian Akhavan Niaki, David Choffnes, Phillipa Gill, and Alan Mislove. 2019. A large-scale analysis of deployed traffic differentiation practices. In Proceedings of the ACM Special Interest Group on Data Communication. 130--144.
[34]
Robert MacDavid, Xiaoqi Chen, and Jennifer Rexford. 2023. Scalable real-time bandwidth fairness in switches. IEEE/ACM Transactions on Networking (2023).
[35]
Matthew Mathis, Jeffrey Semke, Jamshid Mahdavi, and Teunis Ott. 1997. The macroscopic behavior of the TCP congestion avoidance algorithm. ACM SIGCOMM Computer Communication Review (1997).
[36]
Rong Pan, Lee Breslau, Balaji Prabhakar, and Scott Shenker. 2003. Approximate fairness through differential dropping. ACM SIGCOMM Computer Communication Review (2003).
[37]
Abhay K Parekh and Robert G Gallager. 1993. A generalized processor sharing approach to flow control in integrated services networks: the single-node case. IEEE/ACM transactions on networking (1993).
[38]
S. Blake and D. Black and M. Carlson and E. Davies and Z. Wang and W. Weiss. 1998. An Architecture for Differentiated Services. RFC 2475. (1998).
[39]
Ahmed Saeed, Nandita Dukkipati, Vytautas Valancius, Vinh The Lam, Carlo Contavalli, and Amin Vahdat. 2017. Carousel: Scalable traffic shaping at end hosts. In ACM Special Interest Group on Data Communication (SIGCOMM).
[40]
Ahmed Saeed, Yimeng Zhao, Nandita Dukkipati, Ellen Zegura, Mostafa Ammar, Khaled Harras, and Amin Vahdat. 2019. Eiffel: Efficient and flexible software packet scheduling. In 16th USENIX Symposium on Networked Systems Design and Implementation.
[41]
Danfeng Shan, Linbing Jiang, Peng Zhang, Wanchun Jiang, Hao Li, Yazhe Tang, and Fengyuan Ren. 2023. Enforcing Fairness in the Traffic Policer Among Heterogeneous Congestion Control Algorithms. IEEE/ACM Transactions on Networking (2023).
[42]
Danfeng Shan, Peng Zhang, Wanchun Jiang, Hao Li, and Fengyuan Ren. 2021. Towards the Fairness of Traffic Policer. In 40th IEEE Conference on Computer Communications, INFOCOM.
[43]
Naveen Kr Sharma, Ming Liu, Kishore Atreya, and Arvind Krishnamurthy. 2018. Approximating fair queueing on reconfigurable switches. In 15th USENIX Symposium on Networked Systems Design and Implementation.
[44]
M. Shreedhar and George Varghese. 1995. Efficient Fair Queueing Using Deficit Round Robin. ACM SIGCOMM Computer Communication Review (1995).
[45]
Madhavapeddi Shreedhar and George Varghese. 1995. Efficient fair queueing using deficit round robin. In Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication.
[46]
Madhavapeddi Shreedhar and George Varghese. 1996. Efficient fair queuing using deficit round-robin. IEEE/ACM Transactions on networking (1996).
[47]
Bruce Spang, Shravya Kunamalla, Renata Teixeira, Te-Yuan Huang, Grenville Armitage, Ramesh Johari, and Nick McKeown. 2023. Sammy: smoothing video traffic to be a friendly internet neighbor. In ACM SIGCOMM.
[48]
T-Mobile. 2024. Unlimited video streaming with Binge On™. (2024). https://www.t-mobile.com/tv-streaming/binge-on
[49]
Ammar Tahir and Radhika Mittal. 2023. Enabling Users to Control their Internet. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). 555--573.
[50]
Ronald van Haalen and Richa Malhotra. 2007. Improving TCP performance with bufferless token bucket policing: A TCP friendly policer. In 2007 15th IEEE Workshop on Local & Metropolitan Area Networks.
[51]
George Varghese and Anthony Lauck. 1987. Hashed and Hierarchical Timing Wheels: Data Structures for the Efficient Implementation of a Timer Facility. In 11th ACM Symposium on Operating System Principles, SOSP.
[52]
Verizon. 2024. Verizon customers can save more in 2024. (2024). https://www.verizon.com/about/news/verizon-customers-can-save-more-2024
[53]
Gary R Wright and W Richard Stevens. 1995. TCP/IP Illustrated, Volume 2 (paperback): The Implementation. Addison-Wesley Professional.
[54]
Yiannis Yiakoumis, Sachin Katti, Te-Yuan Huang, Nick McKeown, Kok-Kiong Yap, and Ramesh Johari. 2012. Putting home users in charge of their network. In ACM Conference on Ubiquitous Computing.
[55]
Yiannis Yiakoumis, Sachin Katti, and Nick McKeown. 2016. Neutral Net Neutrality. In Proceedings of the 2016 ACM SIGCOMM Conference.
Index Terms
- Efficient Policy-Rich Rate Enforcement with Phantom Queues
Recommendations
Efficient Network Security Policy Enforcement With Policy Space Analysis
Network operators rely on security services to protect their IT infrastructures. Different kinds of network security policies are defined globally and distributed among multiple security middleboxes deployed in networks. However, due to the complexity ...
An Adaptive XACMLv3 Policy Enforcement Point
COMPSACW '14: Proceedings of the 2014 IEEE 38th International Computer Software and Applications Conference WorkshopsPolicies are rules that govern the choices in behavior of a system. Policy based management aims at supporting dynamic adaptability of behavior by changing policy without recoding or stopping the system. The common accepted architecture of such systems ...
Comments
Information & Contributors
Information
Published In
August 2024
1033 pages
ISBN:9798400706141
DOI:10.1145/3651890
- Co-chairs:
- Aruna Seneviratne,
- Darryl Veitch,
- Program Co-chairs:
- Vyas Sekar,
- Minlan Yu
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 August 2024
Check for updates
Badges
Author Tags
Qualifiers
- Research-article
Funding Sources
Conference
ACM SIGCOMM '24
Sponsor:
Acceptance Rates
Overall Acceptance Rate 462 of 3,389 submissions, 14%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 762Total Downloads
- Downloads (Last 12 months)762
- Downloads (Last 6 weeks)138
Reflects downloads up to 03 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in