
Open access
Author
Date
2022Type
- Doctoral Thesis
ETH Bibliography
yes
Altmetrics
Abstract
Current trends in modern hardware create many opportunities and challenges for data management systems. More specifically, novel high-performance network devices with the capability of high-throughput packet processing offer the potential of significant improvements in the performance of networked systems. However, advanced in-network acceleration and offload capabilities, including RDMA, often have strong constraints which force developers to limit the functionality of designed systems or even sacrifice their security.
This dissertation aims to address challenges in the design and implementation of the data management protocols that efficiently use the offload capabilities offered by modern network accelerators in the context of various data storage and data analytics systems. Particularly, I address challenges in data management for key-value stores, shared message queues, and remote memory systems regarding storage reliability, performance, and memory fragmentation.
Second, I propose a serialization-free communication library for Java virtual machines that allows applications to send on-heap objects through RDMA connections. I show how the library unlocks RDMA networking to Java virtual machines hiding all the burden of low-level RDMA programming from the users.
Finally, I propose an extension to the InfiniBand architecture that enables authentication and encryption for RDMA networking to prevent information leakage and message tampering. I show how providers can implement RDMA secure channels with minimal changes to the existing InfiniBand protocol and with minor performance overheads.
I conclude by discussing future research directions which arise from the work presented in this dissertation, and highlighting the potential of in-network processing for modern data management platforms. Show more
Permanent link
https://doi.org/10.3929/ethz-b-000536360Publication status
publishedExternal links
Search print copy at ETH Library
Publisher
ETH ZurichSubject
Networked systems; RDMA; Network security; Data managementOrganisational unit
03950 - Hoefler, Torsten / Hoefler, Torsten
More
Show all metadata
ETH Bibliography
yes
Altmetrics