Loading [a11y]/accessibility-menu.js
CubicRing: Exploiting Network Proximity for Distributed In-Memory Key-Value Store | IEEE Journals & Magazine | IEEE Xplore

CubicRing: Exploiting Network Proximity for Distributed In-Memory Key-Value Store


Abstract:

In-memory storage has the benefits of low I/O latency and high I/O throughput. Fast failure recovery is crucial for large-scale in-memory storage systems, bringing networ...Show More

Abstract:

In-memory storage has the benefits of low I/O latency and high I/O throughput. Fast failure recovery is crucial for large-scale in-memory storage systems, bringing network-related challenges, including false detection due to transient network problems, traffic congestion during the recovery, and top-of-rack switch failures. In order to achieve fast failure recovery, in this paper, we present CubicRing, a distributed structure for cube-based networks, which exploits network proximity to restrict failure detection and recovery within the smallest possible one-hop range. We leverage the CubicRing structure to address the aforementioned challenges and design a network-aware in-memory key-value store called MemCube. In a 64-node 10GbE testbed, MemCube recovers 48 GB of data for a single server failure in 3.1 s. The 14 recovery servers achieve 123.9 Gb/s aggregate recovery throughput, which is 88.5% of the ideal aggregate bandwidth and several times faster than RAMCloud with the same configurations.
Published in: IEEE/ACM Transactions on Networking ( Volume: 25, Issue: 4, August 2017)
Page(s): 2040 - 2053
Date of Publication: 02 March 2017

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.