skip to main content
10.1145/3123878.3131985acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
demonstration
Public Access

Demonstration of the Marple System for Network Performance Monitoring

Published: 22 August 2017 Publication History

Abstract

We demonstrate Marple [15], a system that allows network operators to measure a wide variety of performance metrics in real time. It consists of a performance query language, Marple, modeled on familiar functional operators like map, filter, and groupby. Marple is supported by a programmable key-value store on switches, which can compute flexible aggregated statistics (e.g., per-flow counts, moving averages over queueing latencies) over packets at line rate. Our switch design implements performance queries which could previously run only on end hosts, while utilizing only a modest fraction of switch hardware resources. To demonstrate the utility of Marple, we compile Marple queries to a P4-programmable software switch running within Mininet. We demonstrate two example use cases of Marple: diagnosing the root cause of latency spikes and measuring the flowlet size distribution.

References

[1]
Cisco IOS NetFlow. http://www.cisco.com/c/en/us/products/ios-nx-os-software/ios-netflow/index.html.
[2]
Data center flow telemetry. http://www.cisco.com/c/en/us/products/collateral/data-center-analytics/tetration-analytics/white-paper-c11-737366.html.
[3]
In-band Network Telemetry. https://github.com/p4lang/p4factory/tree/master/apps/int.
[4]
P4 Behavioral Model. https://github.com/p4lang/behavioral-model.
[5]
sFlow. https://en.wikipedia.org/wiki/SFlow.
[6]
M. Alizadeh, T. Edsall, S. Dharmapurikar, R. Vaidyanathan, K. Chu, A. Fingerhut, V. T. Lam, F. Matus, R. Pan, N. Yadav, and G. Varghese. CONGA: Distributed Congestion-Aware Load Balancing for Datacenters. In SIGCOMM, 2014.
[7]
Alizadeh, Mohammad. Empirical Traffic Generator. https://github.com/datacenter/empirical-traffic-gen, 2017.
[8]
P. Bosshart, D. Daly, G. Gibb, M. Izzard, N. McKeown, J. Rexford, C. Schlesinger, D. Talayco, A. Vahdat, G. Varghese, and D. Walker. P4: Programming Protocol-Independent Packet Processors. SIGCOMM CCR, July 2014.
[9]
M. Ghasemi, T. Benson, and J. Rexford. Dapper: Data Plane Performance Diagnosis of TCP. In SOSR, 2017.
[10]
C. Guo, L. Yuan, D. Xiang, Y. Dang, R. Huang, D. Maltz, Z. Liu, V. Wang, B. Pang, H. Chen, Z.-W. Lin, and V. Kurien. Pingmesh: A Large-Scale System for Data Center Network Latency Measurement and Analysis. In SIGCOMM, 2015.
[11]
N. Handigol, B. Heller, V. Jeyakumar, D. Mazières, and N. McKeown. I Know What Your Packet Did Last Hop: Using Packet Histories to Troubleshoot Networks. In NSDI, 2014.
[12]
C. Kim, A. Sivaraman, N. Katta, A. Bas, A. Dixit, and L. J. Wobker. In-band Network Telemetry via Programmable Dataplanes. In SOSR demos, 2015.
[13]
B. Lantz, B. Heller, and N. McKeown. A Network in a Laptop: Rapid Prototyping for Software-defined Networks. In Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks, 2010.
[14]
M. Moshref, M. Yu, R. Govindan, and A. Vahdat. Trumpet: Timely and Precise Triggers in Data Centers. In SIGCOMM, 2016.
[15]
S. Narayana, A. Sivaraman, V. Nathan, P. Goyal, V. Arun, M. Alizadeh, V. Jeyakumar, and C. Kim. Language-Directed Hardware Design for Network Performance Monitoring. In SIGCOMM, 2017.
[16]
S. Narayana, A. Sivaraman, V. Nathan, P. Goyal, V. Arun, M. Alizadeh, V. Jeyakumar, and C. Kim. Language-directed hardware design for network performance monitoring. In SIGCOMM, 2017.
[17]
P. Tammana, R. Agarwal, and M. Lee. Simplifying datacenter network debugging with pathdump. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), pages 233--248, GA, 2016. USENIX Association.
[18]
E. Vanini, R. Pan, M. Alizadeh, P. Taheri, and T. Edsall. Let it Flow: Resilient Asymmetric Load Balancing with Flowlet Switching. In NSDI, 2017.
[19]
M. Yu, A. Greenberg, D. Maltz, J. Rexford, L. Yuan, S. Kandula, and C. Kim. Profiling network performance for multi-tier data center applications. In Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation, NSDI'11, pages 57--70, Berkeley, CA, USA, 2011. USENIX Association.
[20]
Y. Zhu, N. Kang, J. Cao, A. Greenberg, G. Lu, R. Mahajan, D. Maltz, L. Yuan, M. Zhang, B. Y. Zhao, and H. Zheng. Packet-Level Telemetry in Large Datacenter Networks. In SIGCOMM, 2015.

Cited By

View all
  • (2024)Debuglet: Programmable and Verifiable Inter-Domain Network Telemetry2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00032(255-265)Online publication date: 23-Jul-2024
  • (2023)P4RROT: Generating P4 Code for the Application LayerACM SIGCOMM Computer Communication Review10.1145/3594255.359425853:1(30-37)Online publication date: 1-Jan-2023
  • (2023)Toward Highly Reliable Programmable Data Planes: Verification of P4 Code Generation2023 IEEE 9th International Conference on Network Softwarization (NetSoft)10.1109/NetSoft57336.2023.10175397(1-5)Online publication date: 19-Jun-2023
  • Show More Cited By

Index Terms

  1. Demonstration of the Marple System for Network Performance Monitoring

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGCOMM Posters and Demos '17: Proceedings of the SIGCOMM Posters and Demos
      August 2017
      158 pages
      ISBN:9781450350570
      DOI:10.1145/3123878
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 22 August 2017

      Check for updates

      Author Tags

      1. Network measurement
      2. network hardware
      3. network programming

      Qualifiers

      • Demonstration
      • Research
      • Refereed limited

      Funding Sources

      Conference

      SIGCOMM '17
      Sponsor:
      SIGCOMM '17: ACM SIGCOMM 2017 Conference
      August 22 - 24, 2017
      CA, Los Angeles, USA

      Acceptance Rates

      Overall Acceptance Rate 92 of 158 submissions, 58%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)110
      • Downloads (Last 6 weeks)32
      Reflects downloads up to 13 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Debuglet: Programmable and Verifiable Inter-Domain Network Telemetry2024 IEEE 44th International Conference on Distributed Computing Systems (ICDCS)10.1109/ICDCS60910.2024.00032(255-265)Online publication date: 23-Jul-2024
      • (2023)P4RROT: Generating P4 Code for the Application LayerACM SIGCOMM Computer Communication Review10.1145/3594255.359425853:1(30-37)Online publication date: 1-Jan-2023
      • (2023)Toward Highly Reliable Programmable Data Planes: Verification of P4 Code Generation2023 IEEE 9th International Conference on Network Softwarization (NetSoft)10.1109/NetSoft57336.2023.10175397(1-5)Online publication date: 19-Jun-2023
      • (2022)End-to-end I/O Monitoring on Leading SupercomputersACM Transactions on Storage10.1145/356842519:1(1-35)Online publication date: 19-Nov-2022
      • (2020)Measuring congestion in high-performance datacenter interconnectsProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388246(37-58)Online publication date: 25-Feb-2020
      • (2019)End-to-end I/O monitoring on a leading supercomputerProceedings of the 16th USENIX Conference on Networked Systems Design and Implementation10.5555/3323234.3323267(379-394)Online publication date: 26-Feb-2019

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media