research-article

Making QUIC Quicker With NIC Offload

Authors:

Gianni AntichiAuthors Info & Claims

EPIQ '20: Proceedings of the Workshop on the Evolution, Performance, and Interoperability of QUIC

Pages 21 - 27

https://doi.org/10.1145/3405796.3405827

Published: 10 August 2020 Publication History

Abstract

This paper aims at defining the right set of primitives a NIC shall expose to efficiently offload the QUIC protocol. Although previous work already partially tackled this problem, it has only considered one specific aspect: the crypto module. We instead dissect different QUIC implementations, and perform an in-depth analysis of the cost associated to many of its components. We find that the kernel to userspace communication, the crypto module and the packet reordering algorithm are CPU hungry and often the cause of application performance degradation. We use those findings to define an architecture for offloading QUIC and discuss the associated challenges.

References

[1]

2020. Mvfst repository. https://github.com/facebookincubator/mvfst/commit/5a203c90db34b15f3cecb7a71659ebb1f93bde6f.

[2]

2020. Picoquic repository. https://github.com/private-octopus/picoquic/commit/2e5c3c31478f3696ac125c084abe36205b8b4626.

[3]

2020. Quant repository. https://github.com/NTAP/quant/commit/8f63023ab04daa1b30a5de31e91f3c18dcb7f6f9.

[4]

2020. QUIC IETF Working Group Implementations. https://github.com/quicwg/base-drafts/wiki/Implementations.

[5]

2020. Quicly repository. https://github.com/h2o/quicly/commit/6637712da98fa11a6d90c6148cabb5266b8e61ec.

[6]

2020. Using TLS to Secure QUIC. https://quicwg.org/base-drafts/draft-ietf-quictls.html.

[7]

Mina Tahmasbi Arashloo, Alexey Lavrov, Manya Ghobadi, Jennifer Rexford, David Walker, and David Wentzlaff. 2020. Enabling Programmable Transport Protocols in High-Speed NICs. In Networked Systems Design and Implementation (NSDI). USENIX.

[8]

Hitesh Ballani, Paolo Costa, Christos Gkantsidis, Matthew P. Grosvenor, Thomas Karagiannis, Lazaros Koromilas, and Greg O'Shea. 2015. Enabling End-Host Network Functions. In Special Interest Group on Data Communication (SIGCOMM). ACM.

[9]

Gaetano Carlucci, Luca De Cicco, and Saverio Mascolo. 2015. HTTP over UDP: an Experimental Investigation of QUIC. In Symposium on Applied Computing (SAC). ACM.

Digital Library

[10]

Sarah Cook, Bertrand Mathieu, Patrick Truong, and Isabelle Hamchaoui. 2017. QUIC: Better for what and for whom?. In International Conference on Communications (ICC). IEEE.

[11]

Willem de Bruijn and Eric Dumazet. 2018. Optimizing UDP for content delivery: GSO, pacing and zerocopy. In Linux Plumbers Conference.

[12]

Arnaldo Carvalho De Melo. 2010. The new linux perf Tools. In Linux Kongress.

[13]

Manasi Deval and Gregory Bowers. 2019. Technologies for accelerated QUIC packet processing with hardware offloads. In Intel Corporation Patent. US Patent.

[14]

Lars Eggert. 2020. Towards Securing the Internet of Things with QUIC. In Decentralized IoT Systems and Security (DISS). The Internet Society.

[15]

Hadi Esmaeilzadeh, Emily Blem, Renee St. Amant, Karthikeyan Sankaralingam, and Doug Burger. 2011. Dark silicon and the end of multicore scaling. In International Symposium on Computer Architecture (ISCA). ACM.

Digital Library

[16]

Daniel Firestone. 2019. Building hardware-accelerated networks at scale in the c/guloud. https://conferences.sigcomm.org/sigcomm/2017/files/program-kbnets/keynote-2.pdf.

[17]

Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mark Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, Harish K. Chandrappa, Somesh Chaturmohta, Matt Humphrey, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Jitu Padhye, Gautham Popuri, Shachar Raindel, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Deepak Bansal, Doug Burger, Kushagra Vaid, David A. Maltz, and Albert Greenberg. 2018. Azure Accelerated Networking: SmartNICs in the Public Cloud. In Networked Systems Design and Implementation (NSDI). USENIX.

[18]

Leonid Grossman. 2005. Large receive offload implementation in neterion 10GbE Ethernet driver. In Linux Symposium.

[19]

Nikos Hardavellas. 2012. The rise and fall of dark silicon. In; login:, Volume: 37. USENIX.

[20]

Nikos Hardavellas, Michael Ferdman, Babak Falsafi, and Anastasia Ailamaki. 2011. Toward dark silicon in servers. In Micro, Volume: 31, Issue: 4. IEEE.

[21]

Joshua Hay, Maciej Machnikowski, Gregory Bowers, Natalia Wochtman, Joanna Muniak, and Manasi Deval. 2019. Accelerating QUIC via Hardware Offloads through a Socket Interface. In The Technical Conference on Linux Networking (Netdev).

[22]

Yatin Hoskote, Bradley A Bloechel, Gregory E Dermer, Vasantha Erraguntla, David Finan, Jason Howard, Dan Klowden, Siva G Narendra, Greg Ruhl, James W Tschanz, Sriram Vangal, Venkat Veeramachaneni, Howard Wilson, Jianping Xu, and Nitin Borkar. 2003. A TCP Offload Accelerator for 10 Gb/s Ethernet in 90-nm CMOS. Journal of Solid-State Circuits, Volume: 38, Issue: 11.

[23]

Xiaokang Hu, Changzheng Wei, Jian Li, Brian Will, Ping Yu, Lu Gong, and Haibing Guan. 2019. QTLS: High-Performance TLS Asynchronous Offload Framework with Intel QuickAssist Technology. In Principles and Practice of Parallel Programming (PPoPP). ACM.

Digital Library

[24]

Takashi Isobe, Satoshi Tsutsumi, Koichiro Seto, Kenji Aoshima, and Kazutoshi Kariya. 2010. 10 Gbps implementation of TLS/SSL accelerator on FPGA. In International Workshop on Quality of Service (IWQoS). IEEE.

[25]

Xiaowei Jiang. 2019. Cooperative TLS acceleration. US Patent.

[26]

Daehyeok Kim, Amirsaman Memaripour, Anirudh Badam, Yibo Zhu, Hongqiang Harry Liu, Jitu Padhye, Shachar Raindel, Steven Swanson, Vyas Sekar, and Srinivasan Seshan. 2018. Hyperloop: Group-based NIC-offloading to Accelerate Replicated Transactions in Multi-tenant Storage Systems. In Special Interest Group on Data Communication (SIGCOMM). ACM.

[27]

Adam Langley, Alistair Riddoch, Alyssa Wilk, Antonio Vicente, Charles Krasic, Dan Zhang, Fan Yang, Fedor Kouranov, Ian Swett, Janardhan Iyengar, Jeff Bailey, Jeremy Dorfman, Jim Roskind, Joanna Kulik, Patrik Westin, Raman Tenneti, Robbie Shade, Ryan Hamilton, Victor Vasiliev, Wan-Teh Chang, and Zhongyi Shi. 2017. The QUIC Transport Protocol: Design and Internet-Scale Deployment. In Special Interest Group on Data Communication (SIGCOMM). ACM.

[28]

Bojie Li, Zhenyuan Ruan, Wencong Xiao, Yuanwei Lu, Yongqiang Xiong, Andrew Putnam, Enhong Chen, and Lintao Zhang. 2017. KV-Direct: High-Performance In-Memory Key-Value Store with Programmable NIC. In Symposium on Operating Systems Principles (SOSP). ACM.

Digital Library

[29]

YoungGyoun Moon, SeungEon Lee Lee, Muhammad A. Jamshed, and Kyoung-Soo Park Park. 2020. AccelTCP: Accelerating Network Applications with Stateful TCP Offloading. In Networked Systems Design and Implementation (NSDI). USENIX.

[30]

Paul Morrissey, Nigel Smart, and Bogdan Warinschi. 2008. A modular security analysis of the TLS handshake protocol. In Conference on the Theory and Application of Cryptology and Information Security (ASIACRYPT). Springer.

Digital Library

[31]

Netronome. 2018. Netronome AgilioTM CX 2x40GbE Intelligent Server Adapter. https://www.netronome.com/media/redactor_files/PB_Agilio_CX_2x40GbE.pdf.

[32]

Boris Pismenny, Ilya Lesokhin, Liran Liss, and Haggai Eran. 2016. TLS offload to network devices. In The Technical Conference on Linux Networking (Netdev).

[33]

Luigi Rizzo. 2012. netmap: A Novel Framework for Fast Packet I/O. In Annual Technical Conference (ATC). USENIX Association.

[34]

Luigi Rizzo, Giuseppe Lettieri, and Vincenzo Maffione. 2016. Very high speed link emulation with TLEM. In Local and Metropolitan Area Networks (LANMAN). IEEE.

[35]

Mario Ruiz, David Sidler, Gustavo Sutter, Gustavo Alonso, and Sergio Lopez-Buedo. 2019. Limago: An FPGA-Based Open-Source 100 GbE TCP/IP Stack. In Field Programmable Logic and Applications (FPL). IEEE.

[36]

Noa Zilberman, Yury Audzevich, Adam G. Covington, and Andrew W. Moore. 2014. NetFPGA SUME: toward 100 Gbps as research commodity. In Micro, Volume: 34, Issue: 5. IEEE.

Cited By

Wei ZWang ZLi QYang YLuo CWang FJiang YYang SYuan ZBagchi SZhang Y(2024)QDSRProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692036(715-730)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692036
Khalilov MChrapek MShen SVezzu ABenz TDi Girolamo SSchneider TDe Sensi DBenini LHoefler TBagchi SZhang Y(2024)OSMOSISProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692007(247-263)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692007
Kempf MGauder NJaeger BZirngibl JCarle G(2024)A Quantum of QUIC: Dissecting Cryptography with Post-Quantum Insights2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619916(195-203)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619916
Show More Cited By

Index Terms

Making QUIC Quicker With NIC Offload
1. Networks
  1. Network performance evaluation
    1. Network measurement
    2. Network performance analysis

Recommendations

Multipath QUIC: Design and Evaluation
CoNEXT '17: Proceedings of the 13th International Conference on emerging Networking EXperiments and Technologies

Quick UDP Internet Connection (QUIC) is a recent protocol initiated by Google that combines the functions of HTTP/2, TLS, and TCP directly over UDP, with the goal to reduce the latency of client-server communication. It can replace the traditional HTTP/...
Implementation and Performance Evaluation of the QUIC Protocol in Linux Kernel
MSWIM '18: Proceedings of the 21st ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems

QUIC is a new transport layer protocol proposed by Google that is rapidly increasing its share from Internet traffic. It is designed to improve performance for HTTPS connections and partly replace TCP, the dominant standard of Internet for decades, in ...
Delegating OpenGL commands to host for hardware support in virtualized environments
ICUIMC '14: Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication

Today, the virtualization is a very important technology which is widely used in various area, from small mobile devices to virtual machine (VM) servers for large scale cloud computing. Now, hypervisor provides CPU and memory resources for the VMs with ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

EPIQ '20: Proceedings of the Workshop on the Evolution, Performance, and Interoperability of QUIC

August 2020

44 pages

ISBN:9781450380478

DOI:10.1145/3405796

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 August 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

China Scholarship Council

Conference

SIGCOMM '20

Sponsor:

SIGCOMM

SIGCOMM '20: Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication

August 10 - 14, 2020

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 6 of 8 submissions, 75%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,577
Total Downloads

Downloads (Last 12 months)173
Downloads (Last 6 weeks)19

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wei ZWang ZLi QYang YLuo CWang FJiang YYang SYuan ZBagchi SZhang Y(2024)QDSRProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692036(715-730)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692036
Khalilov MChrapek MShen SVezzu ABenz TDi Girolamo SSchneider TDe Sensi DBenini LHoefler TBagchi SZhang Y(2024)OSMOSISProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692007(247-263)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692007
Kempf MGauder NJaeger BZirngibl JCarle G(2024)A Quantum of QUIC: Dissecting Cryptography with Post-Quantum Insights2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619916(195-203)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619916
Bi PZou YXiao MYu DLi YLiu ZXie QCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)LiteQUIC: Improving QoE of Video Streams by Reducing CPU Overhead of QUICProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681670(7918-7927)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681670
Mücke JNawrocki MHiesgen RSchmidt TWählisch MVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)ReACKed QUICer: Measuring the Performance of Instant Acknowledgments in QUIC HandshakesProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3689022(389-400)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3689022
Zhang XJin SHe YHassan AMao ZQian FZhang ZChua TNgo CKa-Wei Lee RKumar RLauw H(2024)QUIC is not Quick Enough over Fast InternetProceedings of the ACM Web Conference 202410.1145/3589334.3645323(2713-2722)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645323
Novais FVerdi F(2024)Unlocking Security to the Board: An Evaluation of SmartNIC-driven TLS Acceleration with kTLSNOMS 2024-2024 IEEE Network Operations and Management Symposium10.1109/NOMS59830.2024.10575053(1-9)Online publication date: 6-May-2024
https://doi.org/10.1109/NOMS59830.2024.10575053
Zirngibl JGebauer FSattler PSosnowski MCarle G(2024)QUIC Hunter: Finding QUIC Deployments and Identifying Server Libraries Across the InternetPassive and Active Measurement10.1007/978-3-031-56252-5_13(273-290)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1007/978-3-031-56252-5_13
Jaeger BZirngibl JKempf MPloch KCarle G(2023)QUIC on the Highway: Evaluating Performance on High-rate Links2023 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking57963.2023.10186365(1-9)Online publication date: 12-Jun-2023
https://doi.org/10.23919/IFIPNetworking57963.2023.10186365
Zhang XJin SHe YHassan AMao ZQian FZhang ZMontpetit MLeivadeas AUhlig SJaved M(2023)Poster: QUIC is not Quick Enough over Fast InternetProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3625002(730-731)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3625002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten