Vasileios Giotsas
ABSTRACT
Many systems rely on traceroutes to monitor or characterize the Internet. The quality of the systems' inferences depends on the completeness and freshness of the traceroutes, but the refreshing of traceroutes is constrained by limited resources at vantage points. Previous approaches predict which traceroutes are likely out-of-date in order to allocate measurements, or monitor BGP feeds for changes that overlap traceroutes. Both approaches miss many path changes for reasons including the difficulty in predicting changes and the coarse granularity of BGP paths.
This paper presents techniques to identify out-of-date traceroutes without issuing any measurements, even if a change is not visible at BGP granularity. We base our techniques on two observations. First, although BGP updates encode routes at AS granularity, routers issue updates when they change intra-domain routes or peering points within the same AS path. Second, route changes correlate across paths, and many publicly available traceroutes exist. Our techniques maintain an atlas of traceroutes by monitoring BGP updates and publicly available traceroutes for signals to mark overlapping atlas traceroutes as stale. We focus our analysis of traceroute path changes at the granularity of border router IPs which provides an abstraction finer than AS- or PoP-level but is not affected by the periodicity of intra-domain load balancers. Our evaluation indicates that 80% of the traceroutes that our techniques signal as stale have indeed changed, even though the AS hops remained the same. Our techniques combine to identify 79% of all border IP changes, without issuing a single online measurement.
Supplemental Material
- Emile Aben. 2014. OpenIPMap Update. (2014).Google Scholar
- Sharad Agarwal, Antonio Nucci, and Supratik Bhattacharyya. 2005. Measuring the shared fate of IGP engineering and interdomain traffic. In IEEE International Conference on Network Protocols. IEEE, Boston, MA, USA.Google ScholarDigital Library
- Rafael L. C.Almeida. 2019. Classification of Load Balancing in the Internet. Master's thesis. UFMG.Google Scholar
- Rafael L. C. Almeida, Italo Cunha, Renata Teixeira, Darryl Veitch, and Christophe Diot. 2020. Classification of Load Balancing in the Internet. In INFOCOM. IEEE.Google Scholar
- David Andersen, Hari Balakrishnan, Frans Kaashoek, and Robert Morris. 2001. Resilient Overlay Networks. In Proceedings on the Symposium on Operating System Principles. ACM, Banff, Alberta, Canada.Google ScholarDigital Library
- Brice Augustin, Timur Friedman, and Renata Teixeira. 2011. Measuring multipath routing in the Internet. IEEE/ACM Transactions on Networking 19 (2011).Google Scholar
- Robert Beverly, Arthur Berger, and Geoffrey G. Xie. 2010. Primitives for Active Internet Topology Mapping: Toward High-frequency Characterization. In Proceedings of the 2010 Internet Measurement Conference. ACM, Melbourne, Australia.Google Scholar
- Mohammad Braei and Sebastian Wagner. 2020. Anomaly Detection in Univariate Time-series: A Survey on the State-of-the-Art. arXiv preprint arXiv:2004.00433 (2020).Google Scholar
- Randy Bush, Olaf Maennel, Matthew Roughan, and Steve Uhlig. 2009. Internet Optometry: Assessing the Broken Glasses in Internet Reachability. In Proceedings of the 2009 Internet Measurement Conference. ACM, Chicago, Illinois, USA.Google ScholarDigital Library
- Matthew Caesar, L Subramanian, and Randy H Katz. 2003. Root cause analysis of BGP dynamics. In Proceedings of the 2003 Internet Measurement Conference. ACM, Miami, FL, USA.Google Scholar
- CAIDA. 2014. DNS Decoding daatabase. https://ddec.caida.org. (2014).Google Scholar
- CAIDA. 2019. Archipelago (Ark) Measurement Infrastructure. http://www.caida.org/projects/ark/. (2019).Google Scholar
- Massimo Candela. 2019. RIPE IPmap - What's Under the Hood? https://labs.ripe.net/Members/massimo_candela/ripe-ipmap-whats-under-the-hood. (January 2019).Google Scholar
- Jin Cao, Drew Davis, Scott Vander Wiel, and Bin Yu. 2000. Time-Varying Network Tomography: Router Link Data. J. Amer. Statist. Assoc. 95 (2000).Google Scholar
- Fangfei Chen, Ramesh K Sitaraman, and Marcelo Torres. 2015. End-user mapping: Next generation request routing for content delivery. In Proceedings of the 2015 ACM SIGCOMM Conference. ACM, London, UK.Google ScholarDigital Library
- K. Chen, D. R. Choffnes, R. Potharaju, Y. Chen, F. E. Bustamante, D. Pei, and Y. Zhao. 2014. Where the Sidewalk Ends: Extending the Internet AS Graph Using Traceroutes from P2P Users. IEEE/ACM Transactions on Computers 63 (2014).Google Scholar
- Kokyo Choy. 2001. Outlier detection for stationary time series. Journal of Statistical Planning and Inference 99 (2001).Google Scholar
- Ítalo Cunha, Pietro Marchetta, Matt Calder, Yi-Ching Chiu, Bruno VA Machado, Antonio Pescapè, Vasileios Giotsas, Harsha V Madhyastha, and Ethan Katz-Bassett. 2016. Sibyl: a practical Internet route oracle. In Symposium on Networked Systems Design and Implementation. USENIX, Boston, MA, USA.Google Scholar
- Italo Cunha, Renata Teixeira, Darryl Veitch, and Christophe Diot. 2011. Predicting and Tracking Internet Path Changes. In Proceedings of the 2011 ACM SIGCOMM Conference. ACM, Toronto, Ontario, Canada.Google ScholarDigital Library
- Amogh Dhamdhere, David D Clark, Alexander Gamero-Garrido, Matthew Luckie, Ricky KP Mok, Gautam Akiwate, Kabir Gogia, Vaibhav Bajpai, Alex C Snoeren, and KC Claffy. 2018. Inferring persistent interdomain congestion. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication. ACM, New York, NY, USA.Google ScholarDigital Library
- Benoit Donnet. 2009. Incentives for BGP Guided IP-Level Topology Discovery. In International Workshop on Traffic Monitoring and Analysis. TMA, Zurich, Switzerland.Google Scholar
- Benoit Donnet, Philippe Raoult, Timur Friedman, and Mark Crovella. 2005. Efficient Algorithms for Large-scale Topology Discovery. In Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. ACM, Banff, Alberta, Canada.Google ScholarDigital Library
- Ben Du, Massimo Candela, Bradley Huffaker, Alex C. Snoeren, and KC Claffy. 2020. RIPE IPmap active geoaddress: mechanism and performance evaluation. ACM SIGCOMM Computer Communication Review 50 (2020).Google Scholar
- Rodérick Fanou, Pierre Francois, and Emile Aben. 2015. On the Diversity of Interdomain Routing in Africa. In International Conference on Passive and Active Network Measurement. PAM, New York, NY, USA.Google Scholar
- Elverton Fazzion, Ítalo Cunha, Dorgival Guedes, Wagner Meira Jr., Renata Teixeira, Darryl Veitch, and Christophe Diot. 2016. Efficient Remapping of Internet Routing Events. In ACM SIGCOMM Posters and Demos. ACM, Florianopolis, Brazil.Google Scholar
- Nick Feamster, David G Andersen, Hari Balakrishnan, and M Frans Kaashoek. 2003. Measuring the Effects of Internet Path Faults on Reactive Routing. ACM SIGMETRICS Performance Evaluation Review 31 (2003).Google Scholar
- Anja Feldmann, Olaf Maennel, Z Morley Mao, Arthur Berger, and Bruce Maggs. 2004. Locating Internet Routing Instabilities. In Proceedings of the 2004 ACM SIGCOMM Conference. ACM, Austin, TX, USA.Google ScholarDigital Library
- T. Flach, E. Katz-Bassett, and R. Govindan. 2012. Quantifying Violations of Destination-based Forwarding on the Internet. In Proceedings of the 2012 Internet Measurement Conference. ACM, Boston, MA, USA.Google Scholar
- Romain Fontugne, Cristel Pelsser, Emile Aben, and Randy Bush. 2017. Pinpointing Delay and Forwarding Anomalies using Large-Scale Traceroute Measurements. In Proceedings of the 2017 Internet Measurement Conference. ACM, London, United Kingdom.Google ScholarDigital Library
- D. Ghita, C. Karakus, K. Argyraki, and P. Thiran. 2011. Shifting Network Tomography Toward a Practical Goal. In CoNEXT. ACM, Tokyo, Japan.Google Scholar
- Vasileios Giotsas, Georgios Smaragdakis, Christoph Dietzel, Philipp Richter, Anja Feldmann, and Arthur Berger. 2017. Inferring BGP Blackholing Activity in the Internet. In Proceedings of the 2017 Internet Measurement Conference. ACM, London, United Kingdom.Google ScholarDigital Library
- Vasileios Giotsas, Georgios Smaragdakis, Bradley Huffaker, Matthew Luckie, and KC Claffy. 2015. Mapping peering interconnections to a facility. In CoNEXT. ACM, Heidelberg, Germany.Google Scholar
- G. Gürsun, N. Ruchansky, E. Terzi, and M. Crovella. 2012. Routing State Distance: A Path-based Metric for Network Analysis. In Proceedings of the 2012 Internet Measurement Conference. ACM, Boston, MA, USA.Google Scholar
- David Hauweele, Bruno Quoitin, Cristel Pelsser, and Randy Bush. 2018. What do parrots and BGP routers have in common?. In Proceedings of the 2018 ACM SIGCOMM Conference. ACM, Budapest, Hungary.Google ScholarDigital Library
- Thomas Holterbach, Cristel Pelsser, Randy Bush, and Laurent Vanbever. 2015. Quantifying interference between measurements on the RIPE Atlas platform. In Proceedings of the 2015 Internet Measurement Conference. ACM, Tokyo, Japan.Google ScholarDigital Library
- Bradley Huffaker, Marina Fomenkov, and KC Claffy. 2014. DRoP: DNS-based router positioning. ACM SIGCOMM Computer Communication Review 44 (2014).Google Scholar
- B Iglewicz and D Hoaglin. 1993. The ASQC basic references in quality control: statistical techniques. How to detect and handle outliers 16 (1993).Google Scholar
- Mattia Iodice, Massimo Candela, and Giuseppe Di Battista. 2019. Periodic Path Changes in RIPE Atlas. IEEE Access 7 (2019).Google Scholar
- Costas Iordanou, Georgios Smaragdakis, Ingmar Poese, and Nikolaos Laoutaris. 2018. Tracing cross border web tracking. In Proceedings of the 2018 Internet Measurement Conference. ACM, Boston, MA, USA.Google ScholarDigital Library
- Quentin Jacquemart, Guillaume Urvoy-Keller, and Ernst Biersack. 2016. Behind IP prefix overlaps in the BGP routing table. In International Conference on Passive and Active Network Measurement. PAM, Heraklion, Crete, Greece.Google ScholarCross Ref
- Umar Javed, Italo Cunha, David Choffnes, Ethan Katz-Bassett, Thomas Anderson, and Arvind Krishnamurthy. 2013. PoiRoot: Investigating the root cause of interdomain path changes. In Proceedings of the 2013 ACM SIGCOMM Conference. ACM, Hong Kong.Google ScholarDigital Library
- Xing Jin, Wanqing Tu, and S-HG Chan. 2008. Traceroute-based topology inference without network coordinate estimation. In International Conference on Communications. IEEE, Beijing, China.Google ScholarCross Ref
- Min Suk Kang and Virgil D Gligor. 2014. Routing bottlenecks in the Internet: Causes, exploits, and countermeasures. In Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security. ACM, Scottsdale, AZ, USA.Google ScholarDigital Library
- Ethan Katz-Bassett, Harsha V Madhyastha, Vijay Kumar Adhikari, Colin Scott, Justine Sherry, Peter Van Wesep, Thomas E Anderson, and Arvind Krishnamurthy. 2010. Reverse traceroute. In Symposium on Networked Systems Design and Implementation. USENIX, Boston, MA, USA.Google Scholar
- Ethan Katz-Bassett, Harsha V Madhyastha, John P John, Arvind Krishnamurthy, David Wetherall, and Thomas E Anderson. 2008. Studying Black Holes in the Internet with Hubble. In Symposium on Networked Systems Design and Implementation. USENIX, San Francisco, CA, USA.Google Scholar
- E. Katz-Bassett, C. Scott, D. R. Choffnes, Í. Cunha, V. Valancius, N. Feamster, H. V. Madhyastha, T. Anderson, and A. Krishnamurthy. 2012. LIFEGUARD: Practical Repair of Persistent Route Failures. In Proceedings of the 2012 ACM SIGCOMM Conference. ACM, Helsinki, Finland.Google Scholar
- K. Keys, Y. Hyun, M. Luckie, and K. Claffy. 2013. Internet-scale IPv4 Alias Resolution with MIDAR. IEEE/ACM Transactions on Networking 21 (2013).Google Scholar
- Leiwen Deng and A. Kuzmanovic. 2008. Monitoring persistently congested Internet links. In 2008 IEEE International Conference on Network Protocols. IEEE, Orlando, FL, USA.Google Scholar
- Matthew Luckie, Bradley Huffaker, Amogh Dhamdhere, Vasileios Giotsas, and others. 2013. AS relationships, customer cones, and validation. In Proceedings of the 2013 Internet Measurement Conference. ACM, Barcelona, Spain.Google ScholarDigital Library
- Harsha V Madhyastha, Tomas Isdal, Michael Piatek, Colin Dixon, Thomas Anderson, Arvind Krishnamurthy, and Arun Venkataramani. 2006. iPlane: An information plane for distributed services. In Proceedings of the Symposium on Operating Systems Design and Implementation. USENIX, Berkely, CA, USA.Google Scholar
- Alexander Marder, Matthew Luckie, Amogh Dhamdhere, Bradley Huffaker, KC Claffy, and Jonathan M. Smith. 2018. Pushing the Boundaries with bdrmapIT: Mapping Router Ownership at Internet Scale. In Proceedings of the 2018 Internet Measurement Conference. ACM, Boston, MA, USA.Google Scholar
- Alexander Marder and Jonathan M Smith. 2016. MAP-IT: Multipass accurate passive inferences from traceroute. In Proceedings of the 2016 Internet Measurement Conference. ACM, Santa Monica, CA, USA.Google ScholarDigital Library
- Richard McCleary, Richard A Hay, Erroll E Meidinger, and David McDowall. 1980. Applied time series analysis for the social sciences. Sage Publications, Beverly Hills, CA, USA.Google Scholar
- Measurement-Lab. 2019. Paris traceroute dataset. https://www.measurementlab. net/tests/paris_traceroute/. (2019).Google Scholar
- Ricky KP Mok, Vaibhav Bajpai, Amogh Dhamdhere, and KC Claffy. 2018. Revealing the Load-Balancing Behavior of YouTube Traffic on Interdomain Links. In International Conference on Passive and Active Network Measurement. PAM, Berlin, Germany.Google Scholar
- R. Motamedi, B. Yeganeh, B. Chandrasekaran, R. Rejaie, B. M. Maggs, and W. Willinger. 2019. On Mapping the Interconnections in Today's Internet. IEEE/ACM Transactions on Networking 27 (2019).Google Scholar
- H. Nguyen, R. Teixeira, P. Thiran, and C. Diot. 2009. Minimizing Probing Cost for Detecting Interface Failures: Algorithms and Scalability Analysis. In INFOCOM. IEEE, Rio de Janeiro, Brazil.Google Scholar
- Init7 NOC. 2019. BGP Communities for Init7 Customers. https://as13030.net/static/pdf/as13030_bgp_communities.pdf. (2019).Google Scholar
- George Nomikos and Xenofontas Dimitropoulos. 2016. traIXroute: Detecting IXPs in traceroute paths. In International Conference on Passive and Active Network Measurement. PAM, Heraklion, Crete, Greece.Google ScholarCross Ref
- George Nomikos, Vasileios Kotronis, Pavlos Sermpezis, Petros Gigis, Lefteris Manassakis, Christoph Dietzel, Stavros Konstantaras, Xenofontas Dimitropoulos, and Vasileios Giotsas. 2018. O Peer, Where Art Thou? Uncovering Remote Peering Interconnections at IXPs. In Proceedings of the 2018 Internet Measurement Conference. ACM, Boston, MA, USA.Google ScholarDigital Library
- Chiara Orsini, Alistair King, Danilo Giordano, Vasileios Giotsas, and Alberto Dainotti. 2016. BGPStream: a software framework for live and historical BGP data analysis. In Proceedings of the 2016 Internet Measurement Conference. ACM, Santa Monica, CA, USA.Google ScholarDigital Library
- Jong Han Park, Dan Jen, Mohit Lad, Shane Amante, Danny McPherson, and Lixia Zhang. 2010. Investigating occurrence of duplicate updates in BGP announcements. In International Conference on Passive and Active Network Measurement. PAM, Zurich, Switzerland.Google ScholarCross Ref
- PeeringDB. 2019. Route Server ASNs. https://www.peeringdb.com/advanced_search?info_type_in=Route+Server&reftag=net. (2019).Google Scholar
- Philipp Richter, Georgios Smaragdakis, Anja Feldmann, Nikolaos Chatzis, Jan Boettger, and Walter Willinger. 2014. Peering at peerings: On the role of IXP route servers. In Proceedings of the 2014 Internet Measurement Conference. ACM, Vancouver, BC, Canada.Google ScholarDigital Library
- RIPE NCC. 2019. How much bandwidth will the probe consume? https://atlas.ripe.net/about/faq/. (2019).Google Scholar
- RIPE NCC. 2019. ID Space Layout for Built-In Measurements. https://atlas.ripe.net/docs/built-in/. (2019).Google Scholar
- RIPE NCC. 2019. RIPE Atlas. https://atlas.ripe.net. (2019).Google Scholar
- Rachee Singh and Phillipa Gill. 2016. PathCache: A Path Prediction Toolkit. In ACM SIGCOMM Posters and Demos. ACM, Florianopolis, Brazil.Google Scholar
- SpeedChecker Ltd. 2019. SpeedChecker. https://www.speedchecker.com/. (2019).Google Scholar
- Neil Spring, Ratul Mahajan, and Thomas Anderson. 2003. The causes of path inflation. In Proceedings of the 2003 ACM SIGCOMM Conference. ACM, Karlsruhe, Germany.Google ScholarDigital Library
- Neil Spring, Ratul Mahajan, and David Wetherall. 2002. Measuring ISP topologies with Rocketfuel. IEEE/ACM Transactions On Networking 12 (2002).Google Scholar
- Claudia Tebaldi and Mike West. 1998. Bayesian Inference on Network Traffic Using Link Count Data. J. Amer. Statist. Assoc. 93 (1998).Google Scholar
- Renata Teixeira, Aman Shaikh, Tim Griffin, and Jennifer Rexford. 2004. Dynamics of hot-potato routing in IP networks. ACM SIGMETRICS Performance Evaluation Review 32 (2004).Google Scholar
- Renata Teixeira, Aman Shaikh, Timothy G Griffin, and Jennifer Rexford. 2008. Impact of hot-potato routing changes in IP networks. IEEE/ACM Transactions On Networking 16 (2008).Google Scholar
- Ruey S Tsay. 1988. Outliers, level shifts, and variance changes in time series. Journal of forecasting 7 (1988).Google Scholar
- Yehuda Vardi. 2004. Metrics useful in network tomography studies. IEEE Signal Processing Letters 11 (2004).Google Scholar
- Kevin Vermeulen, Justin P Rohrer, Robert Beverly, Olivier Fourmaux, and Timur Friedman. 2020. Diamond-Miner: Comprehensive Discovery of the Internet's Topology Diamonds. In Symposium on Networked Systems Design and Implementation. USENIX, Santa Clara, CA, USA.Google Scholar
- K. Vermeulen, S. D. Strowes, O. Fourmaux, and T. Friedman. 2018. Multilevel MDA-Lite Paris Traceroute. In Proceedings of the 2018 Internet Measurement Conference. ACM, Boston, MA, USA.Google Scholar
- Li Wei, Nitin Kumar, Venkata Nishanth Lolla, Eamonn J Keogh, Stefano Lonardi, and Chotirat (Ann) Ratanamahatana. 2005. Assumption-Free Anomaly Detection in Time Series.. In SSDBM. SSDBM, Santa Barbara, CA, USA.Google Scholar
- Jian Wu, Zhuoqing Morley Mao, Jennifer Rexford, and Jia Wang. 2005. Finding a needle in a haystack: Pinpointing significant BGP routing changes in an IP network. In Symposium on Networked Systems Design and Implementation. USENIX, Berkeley, CA, USA.Google Scholar
- Y Zhang, N Duffield, V Paxson, and S Shenker. 2001. On the consistency of Internet path properties. In ACM SIGCOMM IMW. ACM, San Fransisco, CA, USA.Google Scholar
- Zheng Zhang, Ming Zhang, Albert Greenberg, Y. Charlie Hu, Ratul Mahajan, and Blaine Christian. 2010. Optimizing Cost and Performance in Online Service Provider Networks. In Symposium on Networked Systems Design and Implementation. USENIX, San Jose, CA, USA.Google Scholar
- Zheng Zhang, Ying Zhang, Y Charlie Hu, Z Morley Mao, and Randy Bush. 2008. iSPY: detecting IP prefix hijacking on my own. In Proceedings of the 2008 ACM SIGCOMM Conference, Vol. 38. ACM, Seattle, WA, USA.Google ScholarDigital Library
Index Terms
- Reduce, Reuse, Recycle: Repurposing Existing Measurements to Identify Stale Traceroutes
Recommendations
Cloud Provider Connectivity in the Flat Internet
IMC '20: Proceedings of the ACM Internet Measurement ConferenceThe Tier-1 ISPs have been considered the Internet's backbone since the dawn of the modern Internet 30 years ago, as they guarantee global reachability. However, their influence and importance are waning as Internet flattening decreases the demand for ...
Quantifying violations of destination-based forwarding on the internet
IMC '12: Proceedings of the 2012 Internet Measurement ConferenceInitially, packet forwarding in the Internet was destination-based -- that is, a router would forward all packets with the same destination address to the same next hop. In this paper, we use active probing methods to quantify and characterize ...
Measured impact of crooked traceroute
Data collected using traceroute-based algorithms underpins research into the Internet's router-level topology, though it is possible to infer false links from this data. One source of false inference is the combination of per-flow load-balancing, in ...
Comments