research-article

The Demikernel Datapath OS Architecture for Microsecond-scale Datacenter Systems

Authors:

Amanda Raybuck,

Pratyush Patel,

Omar S. Navarro Leija,

Ashlie Martinez,

Anna Kornfeld Simpson,

Pedro Henrique Penna,

Piali Choudhury,

Anirudh BadamAuthors Info & Claims

SOSP '21: Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles

Pages 195 - 211

https://doi.org/10.1145/3477132.3483569

Published: 26 October 2021 Publication History

Abstract

Datacenter systems and I/O devices now run at single-digit microsecond latencies, requiring ns-scale operating systems. Traditional kernel-based operating systems impose an unaffordable overhead, so recent kernel-bypass OSes [73] and libraries [23] eliminate the OS kernel from the I/O datapath. However, none of these systems offer a general-purpose datapath OS replacement that meet the needs of μs-scale systems.' AB@This paper proposes Demikernel, a flexible datapath OS and architecture designed for heterogenous kernel-bypass devices and μs-scale datacenter systems. We build two prototype Demikernel OSes and show that minimal effort is needed to port existing μs-scale systems. Once ported, Demikernel lets applications run across heterogenous kernel-bypass devices with ns-scale overheads and no code changes.

References

[1]

Alonso, G., Binnig, C., Pandis, I., Salem, K., Skrzypczak, J., Stutsman, R., Thostrup, L., Wang, T., Wang, Z., and Ziegler, T. DPI: The data processing interface for modern networks. In 9th Biennial Conference on Innovative Data Systems Research CIDR (2019).

[2]

Barak, D. The OFED package, April 2012. https://www.rdmamojo.com/2012/04/25/the-ofed-package/.

[3]

Belay, A., Prekas, G., Klimovic, A., Grossman, S., Kozyrakis, C., and Bugnion, E. IX: A protected dataplane operating system for high throughput and low latency. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) (2014), USENIX Association.

Digital Library

[4]

Berger, E. D., McKinley, K. S., Blumofe, R. D., and Wilson, P. R. Hoard: A scalable memory allocator for multithreaded applications. SIGARCH Comput. Archit. News 28, 5 (Nov. 2000), 117--128.

Digital Library

[5]

Berger, E. D., Zorn, B. G., and McKinley, K. S. Composing high-performance memory allocators. SIGPLAN Not. 36, 5 (May 2001), 114--124.

Digital Library

[6]

Borman, D., Braden, R. T., Jacobson, V., and Scheffenegger, R. TCP Extensions for High Performance. RFC 7323, 2014.

[7]

Chen, H., Chen, R., Wei, X., Shi, J., Chen, Y., Wang, Z., Zang, B., and Guan, H. Fast in-memory transaction processing using RDMA and HTM. ACM Trans. Comput. Syst. 35, 1 (July 2017).

Digital Library

[8]

Chen, Y., Lu, Y., and Shu, J. Scalable RDMA RPC on reliable connection with efficient resource sharing. In Proceedings of the Fourteenth EuroSys Conference 2019 (2019), Association for Computing Machinery.

Digital Library

[9]

Cho, I., Saeed, A., Fried, J., Park, S. J., Alizadeh, M., and Belay, A. Overload control for μs-scale RPCs with Breakwater. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association.

[10]

corbet. Linux and TCP offload engines. LWN Articles, August 2005. https://lwn.net/Articles/148697/.

[11]

Corbet, J. Ringing in a new asynchronous I/O API. lwn.net, Jan 2019. https://lwn.net/Articles/776703/.

[12]

Corbet, J. The rapid growth of io_uring. lwn.net, Jan 2020. https://lwn.net/Articles/810414.

[13]

Corbet, J., Rubini, A., and Kroah-Hartman, G. Linux Device Drivers: Where the Kernel Meets the Hardware. "O'Reilly Media, inc.", 2005.

[14]

Currid, A. TCP offload to the rescue: Getting a toehold on TCP offload engines---and why we need them. Queue 2, 3 (May 2004), 58--65.

Digital Library

[15]

Demoulin, M., Fried, J., Pedisich, I., Kogias, M., Loo, B. T., Phan, L. T. X., and Zhang, I. When idling is ideal: Optimizing taillatency for highly-dispersed datacenter workloads with Persephone. In Proceedings of the 26th Symposium on Operating Systems Principles (2021), Association for Computing Machinery.

[16]

Data plane development kit. https://www.dpdk.org/.

[17]

Dragojević, A., Narayanan, D., Castro, M., and Hodson, O. FaRM: Fast remote memory. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (2014), USENIX Association.

Digital Library

[18]

Engler, D. R., Kaashoek, M. F., and O'Toole, J. Exokernel: An operating system architecture for application-level resource management. In Proceedings of the Fifteenth ACM Symposium on Operating Systems Principles (1995), Association for Computing Machinery.

Digital Library

[19]

Evans, J. A scalable concurrent malloc (3) implementation for FreeBSD. In Proceedings of the BSDCan Conference (2006).

[20]

F-Stack. http://www.f-stack.org/.

[21]

Firestone, D., Putnam, A., Mundkur, S., Chiou, D., Dabagh, A., Andrewartha, M., Angepat, H., Bhanu, V., Caulfield, A., Chung, E., Chandrappa, H. K., Chaturmohta, S., Humphrey, M., Lavier, J., Lam, N., Liu, F., Ovtcharov, K., Padhye, J., Popuri, G., Raindel, S., Sapre, T., Shaw, M., Silva, G., Sivakumar, M., Srivastava, N., Verma, A., Zuhair, Q., Bansal, D., Burger, D., Vaid, K., Maltz, D. A., and Greenberg, A. Azure accelerated networking: SmartNICs in the public cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) (2018), USENIX Association.

Digital Library

[22]

Fleming, M. A thorough introduction to eBPF. lwn.net, December 2017. https://lwn.net/Articles/740157/.

[23]

Fried, J., Ruan, Z., Ousterhout, A., and Belay, A. Caladan: Mitigating interference at microsecond timescales. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association.

Digital Library

[24]

File system in user-space. https://www.kernel.org/doc/html/latest/filesystems/fuse.html.

[25]

A Tour of Go: Channels. https://tour.golang.org/concurrency/2.

[26]

Ha, S., Rhee, I., and Xu, L. Cubic: a new tcp-friendly high-speed tcp variant. ACM SIGOPS Operating Systems Review 42, 5 (2008).

Digital Library

[27]

Herbert, T., and de Bruijn, W. Scaling in the Linux Networking Stack. kernel.org. https://www.kernel.org/doc/Documentation/networking/scaling.txt.

[28]

Honda, M., Lettieri, G., Eggert, L., and Santry, D. PASTE: A network programming interface for non-volatile main memory. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSD1 18) (2018), USENIX Association.

[29]

Internet Engineering Task Force. Traversal Using Relays around NAT. https://tools.ietf.org/html/rfc5766.

[30]

Jeong, E., Wood, S., Jamshed, M., Jeong, H., Ihm, S., Han, D., and Park, K. mTCP: a highly scalable user-level TCP stack for multicore systems. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (2014), USENIX Association.

Digital Library

[31]

Jin, Y., Tseng, H.-W., Papakonstantinou, Y., and Swanson, S. KAML: A flexible, high-performance key-value SSD. In 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA) (2017), IEEE.

[32]

Kadekodi, R., Lee, S. K., Kashyap, S., Kim, T., Kolli, A., and Chidambaram, V. SplitFS: Reducing software overhead in file systems for persistent memory. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (2019), Association for Computing Machinery.

Digital Library

[33]

Kaffes, K., Chong, T., Humphries, J. T., Belay, A., Mazières, D., and Kozyrakis, C. Shinjuku: Preemptive scheduling for μsecond-scale tail latency. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association.

[34]

Kalia, A., Kaminsky, M., and Andersen, D. Datacenter RPCs can be general and fast. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association.

Digital Library

[35]

Kalia, A., Kaminsky, M., and Andersen, D. G. Using RDMA efficiently for key-value services. SIGCOMM Comput. Commun. Rev. 44, 4 (Aug. 2014), 295--306.

Digital Library

[36]

Kalia, A., Kaminsky, M., and Andersen, D. G. Design guidelines for high performance RDMA systems. In 2016 USENIX Annual Technical Conference (USENIX ATC 16) (2016), USENIX Association.

Digital Library

[37]

Kalia, A., Kaminsky, M., and Andersen, D. G. FaSST: Fast, scalable and simple distributed transactions with two-sided RDMA datagram RPCs. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (2016), USENIX Association.

Digital Library

[38]

Kallas, S. Turn server. Github. https://github.com/seemk/urn.

[39]

Kaufmann, A., Stamler, T., Peter, S., Sharma, N. K., Krishnamurthy, A., and Anderson, T. TAS: TCP acceleration as an OS service. In Proceedings of the Fourteenth EuroSys Conference 2019 (2019), Association for Computing Machinery.

Digital Library

[40]

Kim, D., Memaripour, A., Badam, A., Zhu, Y., Liu, H. H., Padhye, J., Raindel, S., Swanson, S., Sekar, V., and Seshan, S. Hyperloop: Group-based NIC-Offloading to accelerate replicated transactions in multi-tenant storage systems. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (2018), Association for Computing Machinery.

Digital Library

[41]

Kim, H.-J., Lee, Y.-S., and Kim, J.-S. NVMeDirect: A user-space I/O framework for application-specific optimization on NVMe SSDs. In 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16) (2016), USENIX Association.

[42]

Kivity, A. Building efficient I/O intensive applications with Seastar, 2019. https://github.com/CoreCppIL/CoreCpp2019/blob/master/Presentations/Avi_Building_efficient_IO_intensive_applications_with_Seastar.pdf.

[43]

Klimovic, A., Litz, H., and Kozyrakis, C. ReFlex: Remote flash = local flash. In Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems (2017), Association for Computing Machinery.

Digital Library

[44]

Kwon, Y., Fingler, H., Hunt, T., Peter, S., Witchel, E., and Anderson, T. Strata: A cross media file system. In Proceedings of the 26th Symposium on Operating Systems Principles (2017), Association for Computing Machinery.

Digital Library

[45]

Laguna, I., Marshall, R., Mohror, K., Ruefenacht, M., Skjellum, A., and Sultana, N. A large-scale study of MPI usage in open-source HPC applications. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (2019), Association for Computing Machinery.

Digital Library

[46]

Leijen, D., Zorn, B., and de Moura, L. Mimalloc: Free list sharding in action. In Asian Symposium on Programming Languages and Systems (2019).

[47]

Lemire, D. Iterating over set bits quickly, Feb 2018. https://lemire.me/blog/2018/02/21/iterating-over-set-bits-quickly/.

[48]

Leslie, B., Chubb, P., Fitzroy-Dale, N., Götz, S., Gray, C., Macpherson, L., Potts, D., Shen, Y.-T., Elphinstone, K., and Heiser, G. User-level device drivers: Achieved performance. Journal of Computer Science and Technology 20, 5 (2005), 654--664.

[49]

Leslie, I., McAuley, D., Black, R., Roscoe, T., Barham, P., Evers, D., Fairbairns, R., and Hyden, E. The design and implementation of an operating system to support distributed multimedia applications. IEEE Journal on Selected Areas in Communications 14, 7 (1996), 1280--1297.

Digital Library

[50]

Lesokhin, I. tls: Add generic NIC offload infrastructure. LWN Articles, September 2017. https://lwn.net/Articles/734030.

[51]

Li, B., Cui, T., Wang, Z., Bai, W., and Zhang, L. Socksdirect: Datacenter sockets can be fast and compatible. In Proceedings of the ACM Special Interest Group on Data Communication (2019), Association for Computing Machinery.

Digital Library

[52]

Li, B., Ruan, Z., Xiao, W., Lu, Y., Xiong, Y., Putnam, A., Chen, E., and Zhang, L. KV-Direct: High-performance in-memory key-value store with programmable NIC. In Proceedings of the 26th Symposium on Operating Systems Principles (2017), Association for Computing Machinery.

Digital Library

[53]

Li, J., Sharma, N. K., Ports, D. R. K., and Gribble, S. D. Tales of the tail: Hardware, OS, and application-level sources of tail latency. In Proceedings of the ACM Symposium on Cloud Computing (2014), Association for Computing Machinery.

Digital Library

[54]

libevent: an event notification library. http://libevent.org/.

[55]

Mandry, T. How Rust optimizes async/await I, Aug 2019. https://tmandry.gitlab.io/blog/posts/optimizing-await-1/.

[56]

Marek. Epoll is fundamentally broken 1/2, Feb 2017. https://idea.popcount.org/2017-02-20-epoll-is-fundamentally-broken-12/.

[57]

Marty, M., de Kruijf, M., Adriaens, J., Alfeld, C., Bauer, S., Contavalli, C., Dalton, M., Dukkipati, N., Evans, W. C., Gribble, S., Kidd, N., Kononov, R., Kumar, G., Mauer, C., Musick, E., Olson, L., Rubow, E., Ryan, M., Springborn, K., Turner, P., Valancius, V., Wang, X., and Vahdat, A. Snap: A microkernel approach to host networking. In Proceedings of the 27th ACM Symposium on Operating Systems Principles (2019), Association for Computing Machinery.

Digital Library

[58]

Mellanox. BlueField Smart NIC. http://www.mellanox.com/page/products_dyn?product_family=275&mtag=bluefield_smart_nic1.

[59]

Mellanox. Mellanox OFED for Linux User Manual. https://www.mellanox.com/related-docs/prod_software/Mellanox_OFED_Linux_User_Manual_v4.1.pdf.

[60]

Mellanox. An introduction to smart NICs. The Next Platform, 3 2019. https://www.nextplatform.com/2019/03/04/an-introduction-to-smartnics/.

[61]

Mellanox. Mellanox OFED RDMA libraries, April 2019. http://www.mellanox.com/page/mlnx_ofed_public_repository.

[62]

Mellanox. RDMA Aware Networks Programming User Manual, September 2020. https://community.mellanox.com/s/article/rdma-aware-networks-programming--160--user-manual.

[63]

Microsoft. Network Direct SPI Reference, v2 ed., July 2010. https://docs.microsoft.com/en-us/previous-versions/windows/desktop/cc904391(v%3Dvs.85).

[64]

Mitchell, C., Geng, Y., and Li, J. Using one-sided RDMA reads to build a fast, CPU-Efficient key-value store. In 2013 USENIX Annual Technical Conference (USENIX ATC 13) (2013), USENIX Association.

[65]

Mogul, J. C. TCP offload is a dumb idea whose time has come. In 9th Workshop on Hot Topics in Operating Systems (HotOS IX) (2003), USENIX Association.

Digital Library

[66]

Moon, Y., Lee, S., Jamshed, M. A., and Park, K. AccelTCP: Accelerating network applications with stateful TCP offloading. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) (2020), USENIX Association.

[67]

Narayan, A., Cangialosi, F., Goyal, P., Narayana, S., Alizadeh, M., and Balakrishnan, H. The case for moving congestion control out of the datapath. In Proceedings of the 16th ACM Workshop on Hot Topics in Networks (2017), Association for Computing Machinery.

Digital Library

[68]

Network Protocol Independent Performance Evaluator. https://linux.die.net/man/1/netpipe.

[69]

Netronome. Agilio CX SmartNICs. https://www.netronome.com/products/agilio-cx/.

[70]

OpenFabrics Interfaces Working Group. RSockets. GitHub. https://github.com/ofiwg/librdmacm/blob/master/docs/rsocket.

[71]

Ousterhout, A., Fried, J., Behrens, J., Belay, A., and Balakrishnan, H. Shenango: Achieving high CPU efficiency for latency-sensitive datacenter workloads. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19) (2019), USENIX Association.

[72]

Panda, A., Han, S., Jang, K., Walls, M., Ratnasamy, S., and Shenker, S. Netbricks: Taking the V out of NFV. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (2016), USENIX Association.

Digital Library

[73]

Peter, S., Li, J., Zhang, I., Ports, D. R. K., Woos, D., Krishnamurthy, A., Anderson, T., and Roscoe, T. Arrakis: The operating system is the control plane. ACM Trans. Comput. Syst. 33, 4 (Nov. 2015).

Digital Library

[74]

Porter, D. E., Boyd-Wickizer, S., Howell, J., Olinsky, R., and Hunt, G. C. Rethinking the library OS from the top down. In Proceedings of the Sixteenth International Conference on Architectural Support for Programming Languages and Operating Systems (2011), Association for Computing Machinery.

Digital Library

[75]

Prekas, G., Kogias, M., and Bugnion, E. ZygOS: Achieving low tail latency for microsecond-scale networked tasks. In Proceedings of the 26th Symposium on Operating Systems Principles (2017), Association for Computing Machinery.

Digital Library

[76]

Protocol buffers. https://developers.google.com/protocol-buffers/.

[77]

Purdila, O., Grijincu, L. A., and Tapus, N. LKL: The linux kernel library. In 9th RoEduNet IEEE International Conference (2010), IEEE.

[78]

RDMA Consortium. A RDMA protocol specification, October 2002. http://rdmaconsortium.org/.

[79]

RDMA communication manager. https://linux.die.net/man/7/rdma_cm.

[80]

Redis: Open source data structure server, 2013. http://redis.io/.

[81]

Ren, Y., Min, C., and Kannan, S. CrossFS: A cross-layered direct-access file system. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI 20) (2020), USENIX Association.

[82]

Transmission Control Protocol. RFC 793, 1981. https://tools.ietf.org/html/rfc793.

[83]

Rizzo, L. Netmap: A novel framework for fast packet I/O. In 2012 USENIX Annual Technical Conference (USENIX ATC 12) (2012), USENIX Association.

[84]

RDMA CM connection and RDMA ping-pong test. http://manpages.ubuntu.com/manpages/bionic/man1/rping.1.html.

[85]

Rust. The Async Book. https://rust-lang.github.io/async-book/.

[86]

Seshadri, S., Gahagan, M., Bhaskaran, S., Bunker, T., De, A., Jin, Y., Liu, Y., and Swanson, S. Willow: A user-programmable SSD. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14) (2014), USENIX Association.

[87]

Siegel, A., Birman, K., and Marzullo, K. Deceit: A flexible distributed file system. In [1990] Proceedings. Workshop on the Management of Replicated Data (1990), pp. 15--17.

[88]

Storage performance development kit. https://spdk.io/.

[89]

Stribling, J., Sovran, Y., Zhang, I., Pretzer, X., Kaashoek, M. F., and Morris, R. Flexible, wide-area storage for distributed systems with WheelFS. In 6th USENIX Symposium on Networked Systems Design and Implementation (NSDI 09) (2009), USENIX Association.

Digital Library

[90]

SUN, C., Bi, J., Zheng, Z., Yu, H., and Hu, H. NFP: Enabling network function parallelism in NFV. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (2017), Association for Computing Machinery.

[91]

Swift, M. M., Martin, S., Levy, H. M., and Eggers, S. J. Nooks: An architecture for reliable device drivers. In Proceedings of the 10th Workshop on ACM SIGOPS European Workshop (2002), Association for Computing Machinery.

Digital Library

[92]

Taranov, K., Alonso, G., and Hoefler, T. Fast and strongly-consistent per-item resilience in key-value stores. In Proceedings of the Thirteenth EuroSys Conference (2018), Association for Computing Machinery.

Digital Library

[93]

Testpmd Users Guide. https://doc.dpdk.org/guides/testpmd_app_ug/.

[94]

Thalheim, J., Unnibhavi, H., Priebe, C., Bhatotia, P., and Pietzuch, P. rkt-io: A direct I/O stack for shielded execution. In Proceedings of the Sixteenth European Conference on Computer Systems (2021), Association for Computing Machinery.

Digital Library

[95]

Tootoonchian, A., Panda, A., Lan, C., Walls, M., Argyraki, K., Ratnasamy, S., and Shenker, S. ResQ: Enabling SLOs in network function virtualization. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18) (2018), USENIX Association.

[96]

Trivedi, A., Ioannou, N., Metzler, B., Stuedi, P., Pfefferle, J., Kourtis, K., Koltsidas, I., and Gross, T. R. Flash-Net: Flash/network stack co-design. ACM Trans. Storage 14, 4 (Dec. 2018).

Digital Library

[97]

Turon, A. Designing futures for Rust, Sep 2016. https://aturon.github.io/blog/2016/09/07/futures-design/.

[98]

Wei, X., Dong, Z., Chen, R., and Chen, H. Deconstructing RDMA-enabled distributed transactions: Hybrid is better! In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) (2018), USENIX Association.

[99]

Welch, B. B., and Ousterhout, J. K. Pseudo devices: User-level extensions to the Sprite file system. Tech. Rep. UCB/CSD-88-424, EECS Department, University of California, Berkeley, Jun 1988.

[100]

WIKIPEDIA. Traversal Using Relays around NAT, May 2021. https://en.wikipedia.org/wiki/Traversal_Using_Relays_around_NAT.

[101]

Yang, J., Izraelevitz, J., and Swanson, S. FileMR: Rethinking RDMA networking for scalable persistent memory. In 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI 20) (2020), USENIX Association.

[102]

Yasukata, K., Honda, M., Santry, D., and Eggert, L. Stackmap: Low-latency networking with the OS stack and dedicated NICs. In 2016 USENIX Annual Technical Conference (USENIX ATC 16) (2016), USENIX Association.

[103]

Zhang, I., Sharma, N. K., Szekeres, A., Krishnamurthy, A., and Ports, D. R. Building consistent transactions with inconsistent replication. ACM Transactions on Computer Systems 35, 4 (2018), 12.

Digital Library

Cited By

Lim KYoon MKim KFekete AJung H(2025)Rapid Data Ingestion through DB-OS Co-designProceedings of the ACM on Management of Data10.1145/37097183:1(1-28)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709718
Zhou XLeis VHu JYu XStonebraker M(2025)Practical DB-OS Co-Design with Privileged Kernel BypassProceedings of the ACM on Management of Data10.1145/37097143:1(1-27)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709714
Skiadopoulos AXie ZZhao MCai QAgarwal SAdelmann JAhern DContavalli CGoldflam MMayatskikh VRaja RWalton DAgarwal RMukherjee SKozyrakis CGavrilovska ATerry D(2024)High-throughput and flexible host networking for accelerated computingProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691960(405-423)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691960
Show More Cited By

Index Terms

The Demikernel Datapath OS Architecture for Microsecond-scale Datacenter Systems
1. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems

Recommendations

I'm Not Dead Yet!: The Role of the Operating System in a Kernel-Bypass Era
HotOS '19: Proceedings of the Workshop on Hot Topics in Operating Systems

Researchers have long predicted the demise of the operating system [21, 26, 41]. As datacenter servers increasingly incorporate I/O devices that let applications bypass the OS kernel (e.g., RDMA [12] and DPDK [15] network devices or SPDK storage devices)...
Capybara: μSecond-Scale Live TCP Migration
APSys '23: Proceedings of the 14th ACM SIGOPS Asia-Pacific Workshop on Systems

Latency-critical μs-scale data center applications are susceptible to server load spikes. The issue is particularly challenging for services using long-lived TCP connections. This paper introduces Capybara, a highly efficient and versatile live TCP ...
Design and verification of a lightweight reliable virtual machine monitor for a many-core architecture

Virtual machine monitors (VMMs) play a central role in cloud computing. Their reliability and availability are critical for cloud computing. Virtualization and device emulation make the VMM code base large and the interface between OS and VMM complex. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '21: Proceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles

October 2021

899 pages

ISBN:9781450387095

DOI:10.1145/3477132

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems
USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Artifacts Available / v1.1

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SOSP '21

Sponsor:

SIGOPS
USENIX Assoc

SOSP '21: ACM SIGOPS 28th Symposium on Operating Systems Principles

October 26 - 29, 2021

Virtual Event, Germany

Acceptance Rates

Overall Acceptance Rate 174 of 961 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
3,088
Total Downloads

Downloads (Last 12 months)523
Downloads (Last 6 weeks)90

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Lim KYoon MKim KFekete AJung H(2025)Rapid Data Ingestion through DB-OS Co-designProceedings of the ACM on Management of Data10.1145/37097183:1(1-28)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709718
Zhou XLeis VHu JYu XStonebraker M(2025)Practical DB-OS Co-Design with Privileged Kernel BypassProceedings of the ACM on Management of Data10.1145/37097143:1(1-27)Online publication date: 11-Feb-2025
https://dl.acm.org/doi/10.1145/3709714
Skiadopoulos AXie ZZhao MCai QAgarwal SAdelmann JAhern DContavalli CGoldflam MMayatskikh VRaja RWalton DAgarwal RMukherjee SKozyrakis CGavrilovska ATerry D(2024)High-throughput and flexible host networking for accelerated computingProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691960(405-423)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691960
Luo ZSon SRatnasamy SShenker SGavrilovska ATerry D(2024)Harvesting memory-bound CPU stall cycles in software with MSHProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691942(57-75)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691942
Zhou YXiang XKiley MDharanipragada SYu MVanbever LZhang I(2024)DINTProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691848(401-417)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691848
Fried JChaudhry GSaurez EChoukse EGoiri ÍElnikety SFonseca RBelay AVanbever LZhang I(2024)Making kernel bypass practical for the cloud with junctionProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691829(55-73)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691829
Curtis-Maury MKesavan RBharadwaj VMattankot NFang VTrivedi YMishra KLi QMa XWon Y(2024)I/O in a flashProceedings of the 22nd USENIX Conference on File and Storage Technologies10.5555/3650697.3650708(177-192)Online publication date: 27-Feb-2024
https://dl.acm.org/doi/10.5555/3650697.3650708
Leis VDietrich C(2024)Cloud-Native Database Systems and Unikernels: Reimagining OS Abstractions for Modern HardwareProceedings of the VLDB Endowment10.14778/3659437.365946217:8(2115-2122)Online publication date: 31-May-2024
https://dl.acm.org/doi/10.14778/3659437.3659462
Zhao JLim KAnderson TJerger N(2024)The Case of Unsustainable CPU AffinityACM SIGEnergy Energy Informatics Review10.1145/3698365.36983714:3(32-38)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3698365.3698371
Parola FQi SNarappa ARamakrishnan KRisso F(2024)SURE: Secure Unikernels Make Serverless Computing Rapid and EfficientProceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698558(668-688)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698558
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten