skip to main content
10.1145/3005745.3005762acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article

Mille-Feuille: Putting ISP traffic under the scalpel

Published: 09 November 2016 Publication History

Abstract

For Internet Service Provider (ISP) operators, getting an accurate picture of how their network behaves is challenging. Given the traffic volumes that their networks carry and the impossibility to control end-hosts, ISP operators are typically forced to randomly sample traffic, and rely on aggregated statistics. This provides coarse-grained visibility, at a time resolution that is far from ideal (seconds or minutes). In this paper, we present Mille-Feuille, a novel monitoring architecture that provides fine-grained visibility over ISP traffic. Mille-Feuille schedules activation and deactivation of traffic-mirroring rules, that are then provisioned network-wide from a central location, within milliseconds. By doing so, Mille-Feuille combines the scalability of sampling with the visibility and controllability of traffic mirroring. As a result, it supports a set of monitoring primitives, ranging from checking key performance indicators (e.g., one-way delay) for single destinations to estimating traffic matrices in sub-seconds. Our preliminary measurements on existing routers confirm that Mille-Feuille is viable in practice.

References

[1]
Cisco Systems. Configuring erspan, 2016. https://goo.gl/h3qaGL.
[2]
B. Claise. Cisco Systems NetFlow Services Export Version 9. RFC 3954 (Informational), Oct. 2004. http://www.ietf.org/rfc/rfc3954.txt.
[3]
A. Fogel, S. Fung, L. Pedrosa, M. Walraed-Sullivan, R. Govindan, R. Mahajan, and T. Millstein. A General Approach to Network Configuration Analysis. In NSDI, 2015.
[4]
R. Fonseca, G. Porter, R. H. Katz, S. Shenker, and I. Stoica. X-trace: a pervasive network tracing framework. In NSDI, 2007.
[5]
C. Guo, L. Yuan, D. Xiang, Y. Dang, R. Huang, D. Maltz, Z. Liu, V. Wang, B. Pang, H. Chen, Z.-W. Lin, and V. Kurien. Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis. In SIGCOMM, 2015.
[6]
N. Handigol, B. Heller, V. Jeyakumar, D. Mazières, and N. McKeown. I Know What Your Packet Did Last Hop: Using Packet Histories to Troubleshoot Networks. In NSDI, 2014.
[7]
G. Iannaccone, C.-n. Chuah, R. Mortier, S. Bhattacharyya, and C. Diot. Analysis of Link Failures in an IP Backbone. In IMC, 2002.
[8]
Juniper Networks. Layer 2 port mirroring overview, 2014. https://goo.gl/YxgZuY.
[9]
P. Kazemian, M. Chang, H. Zeng, G. Varghese, N. McKeown, and S. Whyte. Real Time Network Policy Checking Using Header Space Analysis. In NSDI, 2013.
[10]
A. Markopoulou, G. Iannaccone, S. Bhattacharyya, C. N. Chuah, Y. Ganjali, and C. Diot. Characterization of Failures in an Operational IP Backbone Network. IEEE/ACM Transactions on Networking, 16(4):749-762, Aug 2008.
[11]
M. Moshref, M. Yu, R. Govindan, and A. Vahdat. Trumpet: Timely and Precise Triggers in Data Centers. In SIGCOMM, 2016.
[12]
S. Narayana, M. Tahmasbi, J. Rexford, and D. Walker. Compiling Path Queries. In NSDI, 2016.
[13]
K. Papagiannaki, S. B. Moon, C. Fraleigh, P. Thiran, and C. Diot. Measurement and analysis of single-hop delay on an ip backbone network. IEEE Journal on Selected Areas in Communications, 21(6):908-921, 2003.
[14]
P. Phaal, S. Panchen, and N. McKee. InMon Corporation's sFlow: A Method for Monitoring Traffic in Switched and Routed Networks. RFC 3176 (Informational), Sept. 2001.
[15]
J. Rasley, B. Stephens, C. Dixon, E. Rozner, W. Felter, K. Agarwal, J. Carter, and R. Fonseca. Planck: Millisecond-scale Monitoring and Control for Commodity Networks. In Proceedings of the 2014 ACM Conference on SIGCOMM, SIGCOMM '14, pages 407-418, New York, NY, USA, 2014. ACM.
[16]
J. Rexford, J. Wang, Z. Xiao, and Y. Zhang. BGP Routing Stability of Popular Destinations. In Proc. IMW, 2002.
[17]
S. Vissicchio, O. Tilmans, L. Vanbever, and J. Rexford. Central Control Over Distributed Routing. In ACM SIGCOMM, London, UK, August 2015.
[18]
S. Vissicchio, L. Vanbever, and J. Rexford. Sweet Little Lies: Fake Topologies for Flexible Routing. In ACM HotNets, 2014.
[19]
A. Wundsam, D. Levin, S. Seetharaman, and A. Feldmann. OFRewind: Enabling Record and Replay Troubleshooting for Networks. In USENIX ATC, 2011.
[20]
Y. Zhu, N. Kang, J. Cao, A. Greenberg, G. Lu, R. Mahajan, D. Maltz, L. Yuan, M. Zhang, B. Y. Zhao, and H. Zheng. Packet-Level Telemetry in Large Datacenter Networks. In SIGCOMM, 2015.

Cited By

View all
  • (2023)Eliminating Control Plane Overload via Measurement Task PlacementIEEE/ACM Transactions on Networking10.1109/TNET.2022.322342031:4(1717-1731)Online publication date: Aug-2023
  • (2023)Toward Low-Latency and Accurate State Synchronization for Programmable NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2022.321844631:3(1400-1415)Online publication date: Jun-2023
  • (2021)MTP: Avoiding Control Plane Overload with Measurement Task PlacementIEEE INFOCOM 2021 - IEEE Conference on Computer Communications10.1109/INFOCOM42981.2021.9488732(1-10)Online publication date: 10-May-2021
  • Show More Cited By
  1. Mille-Feuille: Putting ISP traffic under the scalpel

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    HotNets '16: Proceedings of the 15th ACM Workshop on Hot Topics in Networks
    November 2016
    217 pages
    ISBN:9781450346610
    DOI:10.1145/3005745
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 November 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    HotNets-XV
    Sponsor:

    Acceptance Rates

    HotNets '16 Paper Acceptance Rate 30 of 108 submissions, 28%;
    Overall Acceptance Rate 110 of 460 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Eliminating Control Plane Overload via Measurement Task PlacementIEEE/ACM Transactions on Networking10.1109/TNET.2022.322342031:4(1717-1731)Online publication date: Aug-2023
    • (2023)Toward Low-Latency and Accurate State Synchronization for Programmable NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2022.321844631:3(1400-1415)Online publication date: Jun-2023
    • (2021)MTP: Avoiding Control Plane Overload with Measurement Task PlacementIEEE INFOCOM 2021 - IEEE Conference on Computer Communications10.1109/INFOCOM42981.2021.9488732(1-10)Online publication date: 10-May-2021
    • (2020)ApproSync: Approximate State Synchronization for Programmable Networks2020 IEEE 28th International Conference on Network Protocols (ICNP)10.1109/ICNP49622.2020.9259414(1-12)Online publication date: 13-Oct-2020
    • (2019)Clairvoyant Networks2019 Network Traffic Measurement and Analysis Conference (TMA)10.23919/TMA.2019.8784643(89-96)Online publication date: Jun-2019
    • (2019)Unison: Enabling Content Provider/ISP Collaboration using a vSwitch Abstraction2019 IEEE 27th International Conference on Network Protocols (ICNP)10.1109/ICNP.2019.8888032(1-11)Online publication date: Oct-2019
    • (2018)Net2TextProceedings of the 15th USENIX Conference on Networked Systems Design and Implementation10.5555/3307441.3307493(609-623)Online publication date: 9-Apr-2018
    • (2018)StroboscopeProceedings of the 15th USENIX Conference on Networked Systems Design and Implementation10.5555/3307441.3307481(467-482)Online publication date: 9-Apr-2018
    • (2018)PASTEProceedings of the 15th USENIX Conference on Networked Systems Design and Implementation10.5555/3307441.3307444(17-33)Online publication date: 9-Apr-2018
    • (2018)SDProberProceedings of the Symposium on SDN Research10.1145/3185467.3185472(1-7)Online publication date: 28-Mar-2018
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media