research-article

Beating BGP is Harder than we Thought

Authors:

Harsha V. Madhyastha,

Michael Schapira,

Ethan Katz-BassettAuthors Info & Claims

HotNets '19: Proceedings of the 18th ACM Workshop on Hot Topics in Networks

Pages 9 - 16

https://doi.org/10.1145/3365609.3365865

Published: 14 November 2019 Publication History

Abstract

Online services all seek to provide their customers with the best Quality of Experience (QoE) possible. Milliseconds of delay can cause users to abandon a cat video or move onto a different shopping site, which translates into lost revenue. Thus, minimizing latency between users and content is crucial. To reduce latency, content and cloud providers have built massive, global networks. However, their networks must interact with customer ISPs via BGP, which has no concept of performance.

The shortcomings of BGP are many and well documented, but in this paper we ask the community to take a step back and rethink what we know about BGP. We examine three separate studies of performance using large content and cloud provider networks and find that performance-aware routing schemes rarely achieve lower latency than BGP. We lay out a map for research to further study the idea that beating BGP may be more difficult than previously thought.

Supplementary Material

MP4 File (p9-arnold.mp4)

Download
235.94 MB

References

[1]

Aditya Akella, Jeffrey Pang, Bruce Maggs, Srinivasan Seshan, and Anees Shaikh. 2004. A Comparison of Overlay Routing and Multihoming Route Control. In Proceedings of the 2004 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM '04).

Digital Library

[2]

David Andersen, Hari Balakrishnan, Frans Kaashoek, and Robert Morris. 2001. Resilient Overlay Networks. In Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles (SOSP '01).

Digital Library

[3]

APNIC. 2019. Visible ASNs: Customer Populations (Est.). (2019). https://stats.labs.apnic.net/aspop/.

[4]

Matt Calder, Xun Fan, Zi Hu, Ethan Katz-Bassett, John Heidemann, and Ramesh Govindan. 2013. Mapping the Expansion of Google's Serving Infrastructure. In Proceedings of the ACM Internet Measurement Conference (IMC '13).

Digital Library

[5]

Matt Calder, Xun Fan, and Liang Zhu. 2019. A Cloud Provider's View of EDNS Client-Subnet Adoption. In Proceedings of the Network Traffic Measurement and Analysis Conference (TMA '19).

[6]

Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. 2015. Analyzing the Performance of an Anycast CDN. In Proceedings of the ACM Internet Measurement Conference (IMC '15).

Digital Library

[7]

Matt Calder, Ryan Gao, Manuel Schröder, Ryan Stewart, Jitendra Padhye, Ratul Mahajan, Ganesh Ananthanarayanan, and Ethan Katz-Bassett. 2018. Odin: Microsoft's Scalable Fault-Tolerant CDN Measurement System. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI '18).

[8]

Yi-Ching Chiu, Brandon Schlinker, Abhishek Balaji Radhakrishnan, Ethan Katz-Bassett, and Ramesh Govindan. 2015. Are We One Hop Away from a Better Internet?. In Proceedings of the ACM Internet Measurement Conference (IMC '15).

Digital Library

[9]

CloudLab. 2019. (2019). http://www.cloudlab.us/.

[10]

Ricardo de Oliveira Schmidt, John Heidemann, and Jan Harm Kuipers. 2017. Anycast latency: How many sites are enough?. In International Conference on Passive and Active Network Measurement (PAM '17).

[11]

Marcelo Torres Fangfei Chen, Ramesh K. Sitaraman. 2015. End-User Mapping: Next Generation Request Routing for Content Delivery. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '15).

[12]

Tobias Flach, Nandita Dukkipati, Andreas Terzis, Barath Raghavan, Neal Cardwell, Yuchung Cheng, Ankur Jain, Shuai Hao, Ethan Katz-Bassett, and Ramesh Govindan. 2013. Reducing Web Latency: The Virtue of Gentle Aggression. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '13).

Digital Library

[13]

Ashley Flavel, Pradeepkumar Mani, David Maltz, Nick Holt, Jie Liu, Yingying Chen, and Oleg Surmachev. 2015. FastRoute: A Scalable Load-Aware Anycast Routing Architecture for Modern CDNs. In 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI '15).

[14]

Ashley Flavel, Pradeepkumar Mani, and David A Maltz. 2014. Reevaluating the responsiveness of dns-based network control. In IEEE 20th International Workshop on Local & Metropolitan Area Networks (LANMAN '14).

[15]

Google. 2019. Google Network Service Tiers. https://cloud.google.com/network-tiers/. (2019).

[16]

Archana Kesavan. 2019. Comparing the Network Performance of AWS, Azure and GCP. (2019). https://pc.nanog.org/static/published/meetings/NANOG75/1909/20190218KesavancomparingTheNetworkv1.pdf.

[17]

Farhan Khan. 2015. The Cost of Latency. (2015). https://www.digitalrealty.com/blog/the-cost-of-latency

[18]

Zhihao Li, Dave Levin, Neil Spring, and Bobby Bhattacharjee. 2018. Internet Anycast: Performance, Problems, & Potential. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '18).

Digital Library

[19]

Greg Linden. 2006. Make Data Useful. http://sites.google.com/site/glinden/Home/StanfordDataMining.2006-11-28.ppt. (2006).

[20]

Hariharan Rahul, Mangesh Kasbekar, Ramesh Sitaraman, and Arthur Berger. 2005. Towards Realizing the Performance and Availability Benefits of a Global Overlay Network. Technical Report. Massachusetts Institute of Technology.

[21]

Hariharan Rahul, Mangesh Kasbekar, Ramesh Sitaraman, and Arthur Berger. 2006. Towards Realizing the Performance and Availability Benefits of a Global Overlay Network. In Proceedings of International Conference on Passive and Active Network Measurement (PAM '06).

[22]

Stefan Savage, Andy Collins, Eric Hoffman, John Snell, and Thomas Anderson. 1999. The End-to-end Effects of Internet Path Selection. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '99).

Digital Library

[23]

Brandon Schlinker, Todd Arnold, Ítalo Cunha, and Ethan Katz-Bassett. 2019. PEERING: Virtualizing BGP at the Edge for Research. In Proceedings of Conference on emerging Networking Experiments and Technologies (CoNEXT '19).

Digital Library

[24]

Brandon Schlinker, Ítalo Cunha, Yi-Ching Chiu, Srikanth Sundaresan, and Ethan Katz-Bassett. 2019. A View of Internet Performance from a Global Content Provider's Edge. In Proceedings of the ACM Internet Measurement Conference (IMC '19).

Digital Library

[25]

Brandon Schlinker, Hyojeong Kim, Timothy Cui, Ethan Katz-Bassett, Harsha V Madhyastha, Italo Cunha, James Quinn, Saif Hasan, Petr Lapukhov, and Hongyi Zeng. 2017. Engineering Egress with Edge Fabric. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '17).

Digital Library

[26]

Pavlos Sermpezis and Vasileios Kotronis. 2019. Inferring Catchment in Internet Routing. Proceedings of the ACM on Measurement and Analysis of Computing Systems (POMACS) (2019).

Digital Library

[27]

Speedchecker. 2019. http://probeapi.speedchecker.com/. (2019).

[28]

Neil T. Spring, Ratul Mahajan, and Thomas E. Anderson. 2003. The Causes of Path Inflation. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '03).

[29]

ThousandEyes. 2018. Public Cloud Performance Benchmark Report. (2018). https://marketo-web.thousandeyes.com/rs/thousandeyes/images/ThousandEyes-2018-Public-Cloud-Performance-Benchmark-Report.pdf.

[30]

Florian Wohlfart, Nikolaos Chatzis, Caglar Dabanoglu, Georg Carle, and Walter Willinger. 2018. Leveraging Interconnections for Performance: The Serving Infrastructure of a Large CDN. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '18).

Digital Library

[31]

Kok-Kiong Yap, Murtaza Motiwala, Jeremy Rahe, Steve Padgett, Matthew Holliman, Gary Baldus, Marcus Hines, Taeeun Kim, Ashok Narayanan, Ankur Jain, et al. 2017. Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '17).

Digital Library

[32]

Kyriakos Zarifis, Tobias Flach, Srikanth Nori, David R. Choffnes, Ramesh Govindan, Ethan Katz-Bassett, Zhuoqing Morley Mao, and Matt Welsh. 2014. Diagnosing Path Inflation of Mobile Client Traffic. In International Conference on Passive and Active Network Measurement (PAM '14).

Cited By

Darwich OPelsser CVermeulen K(2025)Detecting Traffic Engineering from Public BGP DataPassive and Active Measurement10.1007/978-3-031-85960-1_13(307-334)Online publication date: 7-Mar-2025
https://doi.org/10.1007/978-3-031-85960-1_13
Soltani SAmanlou AShojafar MTafazolli R(2024)Security of Topology Discovery Service in SDN: Vulnerabilities and CountermeasuresIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34064895(3410-3450)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3406489
TOYOTA YMISHIMA WKANAYA KNAKAMURA O(2023)Performance Aware Egress Path Discovery for Content Provider with SRv6 Egress Peer EngineeringIEICE Transactions on Information and Systems10.1587/transinf.2022NTP0003E106.D:5(927-939)Online publication date: 1-May-2023
https://doi.org/10.1587/transinf.2022NTP0003
Show More Cited By

Index Terms

Beating BGP is Harder than we Thought
1. Networks

Recommendations

The impact of BGP dynamics on intra-domain traffic
SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systems

Recent work in network traffic matrix estimation has focused on generating router-to-router or PoP-to-PoP (Point-of-Presence) traffic matrices within an ISP backbone from network link load data. However, these estimation techniques have not considered ...
The impact of BGP dynamics on intra-domain traffic

Recent work in network traffic matrix estimation has focused on generating router-to-router or PoP-to-PoP (Point-of-Presence) traffic matrices within an ISP backbone from network link load data. However, these estimation techniques have not considered ...
A model of BGP routing for network engineering
SIGMETRICS '04/Performance '04: Proceedings of the joint international conference on Measurement and modeling of computer systems

The performance of IP networks depends on a wide variety of dynamic conditions. Traffic shifts, equipment failures, planned maintenance, and topology changes in other parts of the Internet can all degrade performance. To maintain good performance, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '19: Proceedings of the 18th ACM Workshop on Hot Topics in Networks

November 2019

176 pages

ISBN:9781450370202

DOI:10.1145/3365609

Copyright © 2019 ACM.

© 2019 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HotNets '19

Sponsor:

SIGCOMM

HotNets '19: The 18th ACM Workshop on Hot Topics in Networks

November 13 - 15, 2019

NJ, Princeton, USA

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
729
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)6

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Darwich OPelsser CVermeulen K(2025)Detecting Traffic Engineering from Public BGP DataPassive and Active Measurement10.1007/978-3-031-85960-1_13(307-334)Online publication date: 7-Mar-2025
https://doi.org/10.1007/978-3-031-85960-1_13
Soltani SAmanlou AShojafar MTafazolli R(2024)Security of Topology Discovery Service in SDN: Vulnerabilities and CountermeasuresIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34064895(3410-3450)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3406489
TOYOTA YMISHIMA WKANAYA KNAKAMURA O(2023)Performance Aware Egress Path Discovery for Content Provider with SRv6 Egress Peer EngineeringIEICE Transactions on Information and Systems10.1587/transinf.2022NTP0003E106.D:5(927-939)Online publication date: 1-May-2023
https://doi.org/10.1587/transinf.2022NTP0003
Soltani SShojafar MMostafaei HTafazolli R(2023)Real-Time Link Verification in Software-Defined NetworksIEEE Transactions on Network and Service Management10.1109/TNSM.2023.323869120:3(3596-3611)Online publication date: Sep-2023
https://doi.org/10.1109/TNSM.2023.3238691
Nakamura RShimizu KKamata TPelsser C(2022)A First Measurement with BGP Egress Peer EngineeringPassive and Active Measurement10.1007/978-3-030-98785-5_9(199-215)Online publication date: 22-Mar-2022
https://doi.org/10.1007/978-3-030-98785-5_9
Moura GHeidemann JHardaker WCharnsethikul PBulten JCeron JHesselman C(2022)Old but Gold: Prospecting TCP to Engineer and Live Monitor DNS AnycastPassive and Active Measurement10.1007/978-3-030-98785-5_12(264-292)Online publication date: 22-Mar-2022
https://doi.org/10.1007/978-3-030-98785-5_12
Corneo LMohan NZavodovski AWong WRohner CGunningberg PKangasharju J(2021)(How Much) Can Edge Computing Change Network Latency?2021 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking52078.2021.9472847(1-9)Online publication date: 21-Jun-2021
https://doi.org/10.23919/IFIPNetworking52078.2021.9472847
Soltani SShojafar MMostafaei HPooranian ZTafazolli R(2021)Link Latency Attack in Software-Defined Networks2021 17th International Conference on Network and Service Management (CNSM)10.23919/CNSM52442.2021.9615598(187-193)Online publication date: 25-Oct-2021
https://doi.org/10.23919/CNSM52442.2021.9615598
Dang TMohan NCorneo LZavodovski AOtt JKangasharju JLevin DMislove AAmann JLuckie M(2021)Cloudy with a chance of short RTTsProceedings of the 21st ACM Internet Measurement Conference10.1145/3487552.3487854(62-79)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3487552.3487854
Koch TKatz-Bassett EHeidemann JCalder MArdi CLi KKuipers FCaesar M(2021)Anycast In contextProceedings of the 2021 ACM SIGCOMM 2021 Conference10.1145/3452296.3472891(398-417)Online publication date: 9-Aug-2021
https://dl.acm.org/doi/10.1145/3452296.3472891
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten