research-article

When Should The Network Be The Computer?

Authors:

Dan R. K. Ports,

Jacob NelsonAuthors Info & Claims

HotOS '19: Proceedings of the Workshop on Hot Topics in Operating Systems

Pages 209 - 215

https://doi.org/10.1145/3317550.3321439

Published: 13 May 2019 Publication History

Abstract

Researchers have repurposed programmable network devices to place small amounts of application computation in the network, sometimes yielding orders-of-magnitude performance gains. At the same time, effectively using these devices requires careful use of limited resources and managing deployment challenges.

This paper provides a framework for principled use of in-network processing. We provide a set of guidelines for building robust and deployable in-network primives, along with a taxonomy to help identify which applications can benefit from in-network processing and what types of devices they should use.

References

[1]

D. S. Alexander, W. A. Arbaugh, M. W. Hicks, P. Kakkar, A. D. Keromytis, J. T. Moore, C. A. Gunter, S. M. Nettles, and J. M. Smith. The SwitchWare active network architecture. IEEE Network Special Issue on Active and Controllable Networks, 12(3):29--36, July 1998.

Digital Library

[2]

Amazon EC2 F1 Instances. https://aws.amazon.com/ec2/instance-types/f1/.

[3]

Arista 7124FX Application Switch. https://www.arista.com/assets/data/pdf/7124FX/7124FX_Data_Sheet.pdf.

[4]

Arista latency analyzer (LANZ). https://www.arista.com/assets/data/pdf/TechBulletins/Lanz.pdf.

[5]

Barefoot Networks. Tofino. https://barefootnetworks.com/products/brief-tofino/.

[6]

P. Bosshart, G. Gibb, H.-S. Kim, G. Varghese, N. McKeown, M. Izzard, F. Mujica, and M. Horowitz. Forwarding metamorphosis: Fast programmable match-action processing in hardware for SDN. In Proceedings of ACM SIGCOMM 2013, Hong Kong, China, Aug. 2013. ACM.

Digital Library

[7]

Broadcom Trident3. https://www.broadcom.com/products/ethernet-connectivity/switching/strataxgs/bcm56870-series/.

[8]

Cavium LiquidIO II. http://www.cavium.com/LiquidIO-II_Network_Appliance_Adapters.html.

[9]

H. T. Dang, P. Bressana, H. Wang, K. S. Lee, H. Weatherspoon, M. Canini, F. Pedone, and R. Soulé. Network hardware-accelerated consensus. Technical Report USI-INF-TR-2016-03, Università della Svizzera italiana, May 2016.

[10]

H. T. Dang, P. Bressana, H. Wang, K. S. Lee, H. Weatherspoon, M. Canini, N. Zilberman, F. Pedone, and R. Soulé. P4xos: Consensus as a network service. Technical Report USI-INF-TR-2018-01, Università della Svizzera italiana, May 2018.

[11]

D. Firestone, A. Putnam, S. Mundkur, D. Chiou, A. Dabagh, M. Andrewartha, H. Angepat, V. Bhanu, A. M. Caulfield, E. S. Chung, H. K. Chandrappa, S. Chaturmohta, M. Humphrey, J. Lavier, N. Lam, F. Liu, K. Ovtcharov, J. Padhye, G. Popuri, S. Raindel, T. Sapre, M. Shaw, G. Silva, M. Sivakumar, N. Srivastava, A. Verma, Q. Zuhair, D. Bansal, D. Burger, K. Vaid, D. A. Maltz, and A. G. Greenberg. Azure accelerated networking: SmartNICs in the public cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2018, Renton, WA, USA, April 9-11, 2018, pages 51--66, 2018.

Digital Library

[12]

J. Fowers, K. Ovtcharov, M. Papamichael, T. Massengill, M. Liu, D. Lo, S. Alkalay, M. Haselman, L. Adams, M. Ghandi, S. Heil, P. Patel, A. Sapek, G. Weisz, L. Woods, S. Lanka, S. K. Reinhardt, A. M. Caulfield, E. S. Chung, and D. Burger. A configurable cloud-scale DNN processor for real-time AI. In Proceedings of the 45th Annual International Symposium on Computer Architecture, ISCA '18, pages 1--14, Piscataway, NJ, USA, 2018. IEEE Press.

Digital Library

[13]

A. Gupta, R. Harrison, M. Canini, N. Feamster, J. Rexford, and W. Willinger. Sonata: Query-driven streaming network telemetry. In Proceedings of ACM SIGCOMM 2018, Budapest, Hungary, Aug. 2018. ACM.

Digital Library

[14]

J. Han, S. Kim, J. Ha, and D. Han. SGX-Box: Enabling visibility on encrypted traffic using a secure middlebox module. In Proceedings of the First Asia-Pacific Workshop on Networking, APNet'17, pages 99--105, Hong Kong, China, 2017. ACM.

Digital Library

[15]

J. He and R. Chen. In-network data-center computing. Internet Draft draft-he-coin-datacenter-00, IRTF, Oct. 2018. https://datatracker.ietf.org/doc/draft-he-coin-datacenter/.

[16]

Intel. Intel Stratix 10 product table. https://www.intel.com/content/dam/www/programmable/us/en/pdfs/literature/pt/stratix-10-tx-product-table.pdf.

[17]

T. Jepsen, L. P. de Sousa, M. Moshref, F. Pedone, and R. Soulé. Infinite resources for optimistic concurrency control. In Proceedings of the ACM SIGCOMM 2018 Workshop on In-Network Computing (NetCompute '18), Budapest, Hungary, Aug. 2018. ACM.

Digital Library

[18]

X. Jin, X. Li, H. Zhang, N. Foster, J. Lee, R. Soulé, C. Kim, and I. Stoica. NetChain: Scale-free sub-rtt coordination. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18), pages 35--49, Renton, WA, 2018. USENIX Association.

Digital Library

[19]

X. Jin, X. Li, H. Zhang, R. Soulé, J. Lee, N. Foster, C. Kim, and I. Stoica. NetCache: Balancing key-value stores with fast in-network caching. In Proceedings of the 26th ACM Symposium on Operating Systems Principles (SOSP '17), Beijing, China, Oct. 2017. ACM.

Digital Library

[20]

N. Katta, M. Hira, C. Kim, A. Sivaraman, and J. Rexford. Hula: Scalable load balancing using programmable data planes. In Proceedings of the 2016 Symposium on SDN Research (SOSR '16), Santa Clara, CA, USA, Mar. 2016. ACM.

Digital Library

[21]

A. Khawaja, J. Landgraf, R. Prakash, M. Wei, E. Schkufza, and C. J. Rossbach. Sharing, protection, and compatibility for reconfigurable fabric with amorphos. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18), pages 107--127, Carlsbad, CA, 2018. USENIX Association.

Digital Library

[22]

C. Kim, P. Bhide, E. Doe, H. Holbrook, A. Ghanwani, D. Daly, M. Hira, and B. Davie. In-band network telemetry. https://p4.org/assets/INT-current-spec.pdf, 2016.

[23]

D. Kim, Y. Zhu, C. Kim, J. Lee, and S. Seshan. Generic external memory for switch data planes. In Proceedings of the 16th Workshop on Hot Topics in Networks (HotNets '18), Redmond, WA, USA, Nov. 2018. ACM.

Digital Library

[24]

C. Lan, J. Sherry, R. A. Popa, S. Ratnasamy, and Z. Liu. Embark: Securely outsourcing middleboxes to the cloud. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 255--273, Santa Clara, CA, 2016. USENIX Association.

Digital Library

[25]

A. Lerner, R. Hussein, and P. Cudré-Mauroux. The case for network accelerated query processing. In Proceedings of the 9th Conference on Innovative Data Systems Research (CIDR '19), Asilomar, CA, USA, Jan. 2019. VLDB / ACM.

[26]

J. Li, E. Michael, and D. R. K. Ports. Eris: Coordination-free consistent transactions using network multi-sequencing. In Proceedings of the 26th ACM Symposium on Operating Systems Principles (SOSP '17), Beijing, China, Oct. 2017. ACM.

Digital Library

[27]

J. Li, E. Michael, A. Szekeres, N. K. Sharma, and D. R. K. Ports. Just say NO to Paxos overhead: Replacing consensus with network ordering. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI '16), Savannah, GA, USA, Nov. 2016. USENIX.

Digital Library

[28]

J. Li, J. Nelson, X. Jin, and D. R. K. Ports. Pegasus: Load-aware selective replication with an in-network coherence directory. Technical Report UW-CSE-18-12-01, University of Washington CSE, Seattle, WA, USA, Dec. 2018.

[29]

X. Li, R. Sethi, M. Kaminsky, D. G. Andersen, and M. J. Freedman. Be fast, cheap and in control with SwitchKV. In 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI 16), pages 31--44, Santa Clara, CA, 2016. USENIX Association.

Digital Library

[30]

L. Luo, J. Nelson, L. Ceze, A. Phanishayee, and A. Krishnamurthy. Parameter Hub: A rack-scale parameter server for distributed deep neural network training. In Proceedings of the ACM Symposium on Cloud Computing, SoCC '18, pages 41--54, Carlsbad, CA, USA, 2018. ACM.

Digital Library

[31]

Mellanox Innova2. http://www.mellanox.com/page/products_dyn?product_family=276&mtag=programmable_adapter_cards_innova2flex.

[32]

Mellanox scalable hierarchical aggregation and reduction protocol (SHARP). http://www.mellanox.com/page/products_dyn?product_family=261&mtag=sharp.

[33]

R. Miao, H. Zeng, C. Kim, J. Lee, and M. Yu. SilkRoad: Making stateful layer-4 load balancing fast and cheap using switching asics. In Proceedings of ACM SIGCOMM 2017, Los Angeles, CA, USA, Aug. 2017. ACM.

Digital Library

[34]

Netronome Agilio CX. https://www.netronome.com/products/agilio-cx/.

[35]

R. Poddar, C. Lan, R. A. Popa, and S. Ratnasamy. SafeBricks: Shielding network functions in the cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18), pages 201--216, Renton, WA, 2018. USENIX Association.

Digital Library

[36]

D. R. K. Ports, J. Li, V. Liu, N. K. Sharma, and A. Krishnamurthy. Designing distributed systems using approximate synchrony in datacenter networks. In Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI '15), Oakland, CA, USA, May 2015. USENIX.

Digital Library

[37]

J. Rüth, R. Glebke, K. Wehrle, V. Causevic, and S. Hirche. Towards in-network industrial feedback control. In Proceedings of the ACM SIGCOMM 2018 Workshop on In-Network Computing (NetCompute '18), Budapest, Hungary, Aug. 2018. ACM.

Digital Library

[38]

A. Sapio, I. Abdelaziz, A. Aldilaijan, M. Canini, and P. Kalnis. In-network computation is a dumb idea whose time has come. In Proceedings of the 16th Workshop on Hot Topics in Networks (HotNets '17), Palo Alto, CA, USA, Nov. 2017. ACM.

Digital Library

[39]

A. Sapio, M. Canini, C.-Y. Ho, J. Nelson, P. Kalnis, C. Kim, A. Krishnamurthy, M. Moshref, D. R. K. Ports, and P. Richtarik. Scaling distributed machine learning with in-network aggregation. Technical report, KAUST, Feb. 2019.

[40]

N. K. Sharma, A. Kaufmann, T. Anderson, C. Kim, A. Krishnamurthy, J. Nelson, and S. Peter. Evaluating the power of flexible packet processing for network resource allocation. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), Boston, MA, USA, Mar. 2017. USENIX.

Digital Library

[41]

N. K. Sharma, M. Liu, K. Atreya, and A. Krishnamurthy. Approximating fair queueing on reconfigurable switches. In Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI '18), Renton, WA, USA, Apr. 2018. USENIX.

Digital Library

[42]

A. Sivaraman, S. Subramanian, M. Alizadeh, S. Chole, S.-T. Chuang, A. Agrawal, H. Balakrishnan, T. Edsall, S. Katti, and N. McKeown. Programmable packet scheduling at line rate. In Proceedings of ACM SIGCOMM 2016, Florianopolis, Brazil, Aug. 2016. ACM.

Digital Library

[43]

N. Sultana, S. Galea, D. Greaves, M. Wójcik, J. Shipton, R. G. Clegg, L. Mai, P. Bressana, R. Soulé, R. Mortier, P. Costa, P. R. Pietzuch, J. Crowcroft, A. W. Moore, and N. Zilberman. Emu: Rapid prototyping of networking services. In Proceedings of the 2017 USENIX Annual Technical Conference, Santa Clara, CA, USA, June 2017. USENIX.

Digital Library

[44]

D. L. Tennenhouse,J. M. Smith, W. D. Sincoskie, D.J. Wetherall, and G.J. Minden. A survey of active network research. IEEE Communications, 35(1):80--86, Jan. 1997.

Digital Library

[45]

D. L. Tennenhouse and D. J. Wetherall. Towards an active network architecture. ACM SIGCOMM Computer Communication Review, 37(5):81--94, Apr. 1996.

Digital Library

[46]

Y. Tokusashi, H. Matsutani, and N. Zilberman. LaKe: An energy efficient, low latency, accelerated key-value store, 2018. https://arxiv.org/pdf/1805.11344.pdf.

[47]

B. Trach, A. Krohmer, F. Gregor, S. Arnautov, P. Bhatotia, and C. Fetzer. ShieldBox: Secure middleboxes using shielded execution. In Proceedings of the Symposium on SDN Research, SOSR '18, pages 2:1--2:14, Los Angeles, CA, USA, 2018. ACM.

Digital Library

[48]

Xilinx. Xilinx UltraScale+ fpgas product tables and product selection guide. https://www.xilinx.com/support/documentation/selection-guides/ultrascale-plus-fpga-product-selection-guide.pdf.

[49]

XPliant Ethernet switch product family. www.cavium.com/XPliant-Ethernet-Switch-Product-Family.html.

[50]

N. Zilberman, Y. Audzevich, G. Kalogeridou, N. Manihatty-Bojan, J. Zhang, and A. Moore. NetFPGA: Rapid prototyping of networking devices in open source. In Proceedings of ACM SIGCOMM 2015, London, United Kingdom, Aug. 2015. ACM.

Digital Library

Cited By

Jasny MZiegler TNelson-Slivon JLeis VBinnig C(2025)Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design GuidelinesACM Transactions on Database Systems10.1145/371637750:1(1-40)Online publication date: 14-Feb-2025
https://dl.acm.org/doi/10.1145/3716377
Nickel MGöhringer D(2024)A Survey on Architectures, Hardware Acceleration and Challenges for In-Network ComputingACM Transactions on Reconfigurable Technology and Systems10.1145/369951418:1(1-34)Online publication date: 10-Oct-2024
https://dl.acm.org/doi/10.1145/3699514
Lerner AZoni DCosta PAntichi G(2024)Rethinking the Switch Architecture for Stateful In-network ComputingProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696897(273-281)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3696348.3696897
Show More Cited By

Index Terms

When Should The Network Be The Computer?
1. Networks
  1. Network services
    1. In-network processing
  2. Network types
    1. Data center networks
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Design of a Classification System for Rectangular Shapes Using a Co-Design Environment
SBCCI '00: Proceedings of the 13th symposium on Integrated circuits and systems design

Pattern localization and classification are CPU time intensive, being normally implemented in software. Custom implementations in hardware allow real-time processing. In practice, in ASIC or FPGA implementations, the digitization process introduces ...
Real-Time Management of Hardware and Software Tasks for FPGA-based Embedded Systems

Operating systems for reconfigurable devices enable the development of embedded systems where software tasks, running on a CPU, can coexist with hardware tasks running on a reconfigurable hardware device (FPGA). In this work, we consider real-time ...
SmartNIC Security Isolation in the Cloud with S-NIC
EuroSys '24: Proceedings of the Nineteenth European Conference on Computer Systems

Modern smart NICs provide little isolation between the network functions belonging to different tenants. These NICs also do not protect network functions from the datacenter-provided management OS which runs on the smart NIC. We describe concrete attacks ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotOS '19: Proceedings of the Workshop on Hot Topics in Operating Systems

May 2019

227 pages

ISBN:9781450367271

DOI:10.1145/3317550

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

HotOS '19

Sponsor:

SIGOPS

HotOS '19: Workshop on Hot Topics in Operating Systems

May 13 - 15, 2019

Bertinoro, Italy

Upcoming Conference

HOTOS '25

Sponsor:
sigops

Workshop on Hot Topics in Operating Systems

May 14 - 16, 2025

Banff , AB , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
1,295
Total Downloads

Downloads (Last 12 months)92
Downloads (Last 6 weeks)11

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jasny MZiegler TNelson-Slivon JLeis VBinnig C(2025)Synchronizing Disaggregated Data Structures with One-Sided RDMA: Pitfalls, Experiments and Design GuidelinesACM Transactions on Database Systems10.1145/371637750:1(1-40)Online publication date: 14-Feb-2025
https://dl.acm.org/doi/10.1145/3716377
Nickel MGöhringer D(2024)A Survey on Architectures, Hardware Acceleration and Challenges for In-Network ComputingACM Transactions on Reconfigurable Technology and Systems10.1145/369951418:1(1-34)Online publication date: 10-Oct-2024
https://dl.acm.org/doi/10.1145/3699514
Lerner AZoni DCosta PAntichi G(2024)Rethinking the Switch Architecture for Stateful In-network ComputingProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696897(273-281)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3696348.3696897
Zhong JLi YLiu SDuan JZhang XChen XSekar VYu MSeneviratne AVeitch D(2024)POSTER:In-network Model Inference for Distributed Systems via Programmable SwitchesProceedings of the ACM SIGCOMM 2024 Conference: Posters and Demos10.1145/3672202.3673749(75-77)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3672202.3673749
Xiao YZhao YLin SKuzmanovic A(2024)Snatch: Online Streaming Analytics at the Network EdgeProceedings of the Nineteenth European Conference on Computer Systems10.1145/3627703.3629577(349-369)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3627703.3629577
Javid FDieye MEstrada-Solano FGlitho RElbiaze HAjib W(2024)A hybrid NFV/In-Network Computing MANO Architecture for provisioning Holographic Applications in the Metaverse2024 IEEE 25th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM)10.1109/WoWMoM60985.2024.00029(99-104)Online publication date: 4-Jun-2024
https://doi.org/10.1109/WoWMoM60985.2024.00029
Segal RAvin CScalosub G(2024)SOAR: Minimizing Network Utilization Cost With Bounded In-Network ComputingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333606721:2(1832-1851)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3336067
Meng QZhang YZhang SWang ZZhang TLuo HRen F(2024)Switch-Assistant Loss Recovery for RDMA Transport ControlIEEE/ACM Transactions on Networking10.1109/TNET.2023.333666132:3(2069-2084)Online publication date: Jun-2024
https://doi.org/10.1109/TNET.2023.3336661
Zhou ZChen HChen LZhang DWu CLiu XKhan M(2024)NetDP: In-Network Differential Privacy for Large-Scale Data ProcessingIEEE Transactions on Green Communications and Networking10.1109/TGCN.2024.34327818:3(1076-1089)Online publication date: Sep-2024
https://doi.org/10.1109/TGCN.2024.3432781
Karlos GBal HWang L(2024)NetCL: A Unified Programming Framework for In-Network ComputingProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.1109/SC41406.2024.00051(1-20)Online publication date: 17-Nov-2024
https://dl.acm.org/doi/10.1109/SC41406.2024.00051
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten