research-article

Public Access

Elastic Switch Programming with P4All

Authors:

Shir Landau-Feibish,

Mina Tahmasbi Arashloo,

Jennifer Rexford,

Rob HarrisonAuthors Info & Claims

HotNets '20: Proceedings of the 19th ACM Workshop on Hot Topics in Networks

Pages 168 - 174

https://doi.org/10.1145/3422604.3425933

Published: 04 November 2020 Publication History

Abstract

The P4 language enables a range of new network applications. However, it is still far from easy to implement and optimize P4 programs for PISA hardware. Programmers must engage in a tedious "trial and error" process wherein they write their program (guessing it will fit within the hardware) and then check by compiling it. If it fails, they repeat the process. In this paper, we argue that programmers should define elastic data structures that stretch automatically to make use of available switch resources. We present P4All, an extension of P4 that supports elastic switch programming. Elastic data structures also make P4All modules reusable across different applications and hardware targets, where resource needs and constraints may vary.Our design is oriented around use of symbolic primitives (integers that may take on a range of possible values at compile time), arrays, and loops. We show how to use these primitive mechanisms to build a range of reusable libraries such as hash tables, Bloom filters, sketches, and key-value stores. We also explain the important role that elasticity plays in modular programming, and we allow programmers to declare utility functions that control the relative share of data-plane resources apportioned to each module.

References

[1]

R. Ben-Basat, X. Chen, G. Einziger, and O. Rottenstreich. 2018. Efficient Measurement on Programmable Switches Using Probabilistic Recirculation. In IEEE International Conference on Network Protocols. 313--323.

[2]

Pat Bosshart, Dan Daly, Glen Gibb, Martin Izzard, Nick McKeown, Jennifer Rexford, Cole Schlesinger, Dan Talayco, Amin Vahdat, George Varghese, and David Walker. 2014. P4: Programming protocol-independent packet processors. ACM SIGCOMM Computer Communication Review, Vol. 44, 3 (2014), 87--95.

Digital Library

[3]

Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. 2013. Forwarding metamorphosis: Fast programmable match-action processing in hardware for SDN. In ACM SIGCOMM. 99--110.

[4]

Lee Breslau, Pei Cao, Li Fan, Graham Phillips, and Scott Shenker. 1999. Web Caching and Zipf-like Distributions: Evidence and Implications. In IEEE INFOCOM. 126--134.

[5]

Graham Cormode and S. Muthukrishnan. 2005 a. An Improved Data Stream Summary: The Count-min Sketch and Its Applications. Journal of Algorithms, Vol. 55, 1 (April 2005), 58--75. https://doi.org/10.1016/j.jalgor.2003.12.001

Digital Library

[6]

Graham Cormode and S. Muthukrishnan. 2005 b. Summarizing and Mining Skewed Data Streams. In Proceedings of the 2005 SIAM International Conference on Data Mining, SDM 2005, Newport Beach, CA, USA, April 21--23, 2005, Hillol Kargupta, Jaideep Srivastava, Chandrika Kamath, and Arnold Goodman (Eds.). SIAM, 44--55. https://doi.org/10.1137/1.9781611972757.5

[7]

Xiangyu Gao, Taegyun Kim, Aatish Kishan Varma, Anirudh Sivaraman, and Srinivas Narayana. 2019. Autogenerating Fast Packet-Processing Code Using Program Synthesis. In ACM SIGCOMM Workshop on Hot Topics in Networks. 150--160. https://doi.org/10.1145/3365609.3365858

[8]

Arpit Gupta, Rob Harrison, Marco Canini, Nick Feamster, Jennifer Rexford, and Walter Willinger. 2018. Sonata: Query-driven Streaming Network Telemetry. In ACM SIGCOMM. ACM, 357--371. https://doi.org/10.1145/3230543.3230555

[9]

Rob Harrison, Qizhe Cai, Arpit Gupta, and Jennifer Rexford. 2018. Network-Wide Heavy Hitter Detection with Commodity Switches. In Symposium on SDN Research. Article Article 8, 7 pages.

[10]

Thomas Holterbach, Edgar Costa Molero, Maria Apostolaki, Alberto Dainotti, Stefano Vissicchio, and Laurent Vanbever. 2019. Blink: Fast Connectivity Recovery Entirely in the Data Plane. In USENIX Symposium on Networked Systems Design and Implementation. Boston, MA, 161--176. https://www.usenix.org/conference/nsdi19/presentation/holterbach

[11]

Qun Huang, Xin Jin, Patrick P. C. Lee, Runhui Li, Lu Tang, Yi-Chao Chen, and Gong Zhang. 2017. SketchVisor: Robust Network Measurement for Software Packet Processing. In ACM SIGCOMM. 113--126.

[12]

Qun Huang, Patrick P. C. Lee, and Yungang Bao. 2018. SketchLearn: Relieving User Burdens in Approximate Measurement with Automated Statistical Inference. In ACM SIGCOMM. 576--590. https://doi.org/10.1145/3230543.3230559

[13]

Theo Jepsen, Masoud Moshref, Antonio Carzaniga, Nate Foster, and Robert Soulé. 2018. Life in the Fast Lane: A Line-Rate Linear Road. In Symposium on SDN Research. Article Article 10, 7 pages.

Digital Library

[14]

Xin Jin, Xiaozhou Li, Haoyu Zhang, Nate Foster, Jeongkeun Lee, Robert Soulé, Changhoon Kim, and Ion Stoica. 2018. NetChain: Scale-Free Sub-RTT Coordination. In USENIX Symposium on Networked Systems Design and Implementation. Renton, WA, 35--49. https://www.usenix.org/conference/nsdi18/presentation/jin

[15]

Xin Jin, Xiaozhou Li, Haoyu Zhang, Robert Soule, Jeongkeun Lee, Nate Foster, Changhoon Kim, and Ion Stoica. 2017. NetCache: Balancing Key-Value Stores with Fast In-Network Caching. In Symposium on Operating System Principles.

Digital Library

[16]

Lavanya Jose, Lisa Yan, George Varghese, and Nick McKeown. 2015. Compiling Packet Programs to Reconfigurable Switches. In USENIX Conference on Networked Systems Design and Implementation. USENIX Association, USA, 103--115.

[17]

K. Rustan M. Leino and Philipp Rümmer. 2010. A Polymorphic Intermediate Verification Language: Design and Logical Encoding. In Tools and Algorithms for the Construction and Analysis of Systems, Javier Esparza and Rupak Majumdar (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 312--327.

[18]

Yuliang Li, Rui Miao, Changhoon Kim, and Minlan Yu. 2016. FlowRadar: A Better NetFlow for Data Centers. In USENIX Symposium on Networked Systems Design and Implementation. Santa Clara, CA, 311--324. https://www.usenix.org/conference/nsdi16/technical-sessions/presentation/li-yuliang

[19]

Zaoxing Liu, Ran Ben-Basat, Gil Einziger, Yaron Kassner, Vladimir Braverman, Roy Friedman, and Vyas Sekar. 2019. NitroSketch: Robust and General Sketch-Based Monitoring in Software Switches. In ACM SIGCOMM. 334--350. https://doi.org/10.1145/3341302.3342076

[20]

Zaoxing Liu, Antonis Manousis, Gregory Vorsanger, Vyas Sekar, and Vladimir Braverman. 2016. One Sketch to Rule Them All: Rethinking Network Flow Monitoring with UnivMon. In ACM SIGCOMM. 101--114. https://doi.org/10.1145/2934872.2934906

[21]

Rui Miao, Hongyi Zeng, Changhoon Kim, Jeongkeun Lee, and Minlan Yu. 2017. SilkRoad: Making Stateful Layer-4 Load Balancing Fast and Cheap Using Switching ASICs. In ACM SIGCOMM. 15--28.

[22]

Travis E Oliphant. 2006. A guide to NumPy. Vol. 1. Trelgol Publishing USA.

Digital Library

[23]

Recep Ozdag. 2012. Intel® Ethernet Switch FM6000 Series--Software Defined Networking. goo.gl/AnvOvX.

[24]

P4 Language Consortium. 2018. P416 Language Specifications. (2018). https://p4.org/p4-spec/docs/P4-16-v1.0.0-spec.pdf

[25]

Naveen Kr. Sharma, Antoine Kaufmann, Thomas Anderson, Arvind Krishnamurthy, Jacob Nelson, and Simon Peter. 2017. Evaluating the Power of Flexible Packet Processing for Network Resource Allocation. In USENIX Networked Systems Design and Implementation. 67--82. https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/sharma

[26]

Naveen Kr. Sharma, Ming Liu, Kishore Atreya, and Arvind Krishnamurthy. 2018. Approximating Fair Queueing on Reconfigurable Switches. In USENIX Symposium on Networked Systems Design and Implementation. Renton, WA, 1--16. https://www.usenix.org/conference/nsdi18/presentation/sharma

[27]

Anirudh Sivaraman, Alvin Cheung, Mihai Budiu, Changhoon Kim, Mohammad Alizadeh, Hari Balakrishnan, George Varghese, Nick McKeown, and Steve Licking. 2016. Packet Transactions: High-Level Programming for Line-Rate Switches. In ACM SIGCOMM. 15--28.

Digital Library

[28]

Vibhaalakshmi Sivaraman, Srinivas Narayana, Ori Rottenstreich, S. Muthukrishnan, and Jennifer Rexford. 2017. Heavy-Hitter Detection Entirely in the Data Plane. In ACM SIGCOMM Symposium on SDN Research. ACM, 164--176. https://doi.org/10.1145/3050220.3063772

[29]

Armando Solar-Lezama, Liviu Tancau, Rastislav Bodik, Sanjit Seshia, and Vijay Saraswat. 2006. Combinatorial Sketching for Finite Programs. In Architectural Support for Programming Languages and Operating Systems. 404--415.

[30]

Emina Torlak and Rastislav Bodik. 2014. A Lightweight Symbolic Virtual Machine for Solver-aided Host Languages. In ACM SIGPLAN Conference on Programming Language Design and Implementation. 530--541. https://doi.org/10.1145/2594291.2594340

Digital Library

[31]

Tong Yang, Jie Jiang, Peng Liu, Qun Huang, Junzhi Gong, Yang Zhou, Rui Miao, Xiaoming Li, and Steve Uhlig. 2018. Elastic Sketch: Adaptive and Fast Network-wide Measurements. In ACM SIGCOMM. ACM, 561--575. https://doi.org/10.1145/3230543.3230544

Cited By

Zhang YChen PLiu ZVanbever LZhang I(2024)OctoSketchProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691914(1621-1639)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691914
Gao JCao JLi YLiu MTang MCai DZhai EVanbever LZhang I(2024)SiriusProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691852(477-490)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691852
Jin XZhang ZJia YMa YLiu X(2024)SDCC: software-defined collective communication for distributed trainingScience China Information Sciences10.1007/s11432-023-3894-467:9Online publication date: 31-Jul-2024
https://doi.org/10.1007/s11432-023-3894-4
Show More Cited By

Index Terms

Elastic Switch Programming with P4All
1. Networks
  1. Network services
    1. Programmable networks

Recommendations

Comparing novice programing environments for use in secondary education: App Inventor for Android vs. Alice

Coding is part of logical thinking and is one of the basic skills which are known as '21st-century skills'. Coding acquisition is necessary as it is used in a wide range of occupations. However, computer programing is difficult to learn and programing ...
Elastic/plastic buckling of moderately thick plates and members

A semi-analytical model for the plastic buckling of Mindlin plates has been proposed.The governing equations are derived on the flow and deformation theories.The elastic/plastic behaviour of plates is described by the Ramberg-Osgood model.A Green-...
C++ Programming: With Design Patterns Revealed

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '20: Proceedings of the 19th ACM Workshop on Hot Topics in Networks

November 2020

228 pages

ISBN:9781450381451

DOI:10.1145/3422604

General Chairs:
Ben Zhao
University of Chicago
,
Heather Zheng
University of Chicago
,
Program Chairs:
Harsha V. Madhyastha
University of Michigan
,
Venkat Padmanabhan
Microsoft Research India

Copyright © 2020 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Conference

HotNets '20

Sponsor:

SIGCOMM

HotNets '20: The 19th ACM Workshop on Hot Topics in Networks

November 4 - 6, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
636
Total Downloads

Downloads (Last 12 months)168
Downloads (Last 6 weeks)22

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YChen PLiu ZVanbever LZhang I(2024)OctoSketchProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691914(1621-1639)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691914
Gao JCao JLi YLiu MTang MCai DZhai EVanbever LZhang I(2024)SiriusProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691852(477-490)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691852
Jin XZhang ZJia YMa YLiu X(2024)SDCC: software-defined collective communication for distributed trainingScience China Information Sciences10.1007/s11432-023-3894-467:9Online publication date: 31-Jul-2024
https://doi.org/10.1007/s11432-023-3894-4
Pan MKim HRexford JWalker DRamos FShahbaz MGurevich VSignorello S(2023)NAP: Programming Data Planes with Approximate Data StructuresProceedings of the 6th on European P4 Workshop10.1145/3630047.3630196(33-39)Online publication date: 8-Dec-2023
https://dl.acm.org/doi/10.1145/3630047.3630196
Fu SLi QZhu MWang XYao SGuo YDu XXu K(2023)MASK: Practical Source and Path Verification Based on Multi-AS-KeyIEEE/ACM Transactions on Networking10.1109/TNET.2022.322261031:4(1478-1493)Online publication date: Aug-2023
https://doi.org/10.1109/TNET.2022.3222610
Angi ASacco AEsposito FMarchetto GClemm A(2023)NAIL: A Network Management Architecture for Deploying Intent into Programmable SwitchesIEEE Communications Magazine10.1109/MCOM.001.230031362:6(28-34)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1109/MCOM.001.2300313
Molero EVissicchio SVanbever LKuipers FOrda A(2022)FAst in-network GraY failure detection for ISPsProceedings of the ACM SIGCOMM 2022 Conference10.1145/3544216.3544242(677-692)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1145/3544216.3544242
Loehr DWalker D(2022)Safe, modular packet pipeline programmingProceedings of the ACM on Programming Languages10.1145/34986996:POPL(1-28)Online publication date: 12-Jan-2022
https://dl.acm.org/doi/10.1145/3498699
Angi ASacco AEsposito FMarchetto GClemm A(2022)NLP4: An Architecture for Intent-Driven Data Plane Programmability2022 IEEE 8th International Conference on Network Softwarization (NetSoft)10.1109/NetSoft54395.2022.9844035(25-30)Online publication date: 27-Jun-2022
https://doi.org/10.1109/NetSoft54395.2022.9844035
Fu SXu KLi QWang XYao SGuo YDu X(2021)MASK: Practical Source and Path Verification based on Multi-AS-Key2021 IEEE/ACM 29th International Symposium on Quality of Service (IWQOS)10.1109/IWQOS52092.2021.9521345(1-10)Online publication date: 25-Jun-2021
https://doi.org/10.1109/IWQOS52092.2021.9521345
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten