research-article

NVHT: an efficient key-value storage library for non-volatile memory

Authors:

Linpeng HuangAuthors Info & Claims

BDCAT '16: Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing, Applications and Technologies

Pages 227 - 236

https://doi.org/10.1145/3006299.3006318

Published: 06 December 2016 Publication History

Abstract

Modern Non-Volatile Memory (NVM) promises persistence, byte-addressability and DRAM-like read and write latency, which offers great opportunities for big data storage architecture. These excellent properties indicate that NVM has the potential to be incorporated with key-value stores to achieve high performance and durability simultaneously.

In this paper, we propose an efficient key-value storage library named NVHT for NVM. NVHT provides APIs to facilitate the development of NVM-based key-value stores where data can be stored and processed in NVM inherently. The core structure of NVHT is a hash table with NVM-optimized metadata design. In NVHT, we introduce non-volatile pointer to solve the dynamic address mapping problem and develop a simple yet efficient memory allocator called pointer-free buddy allocator. NVHT guarantees consistency using a log-based mechanism. The experimental results show that NVHT achieves 1.3x-4x speedup for insert operation and 4x-5x speedup for search operation, compared with two advanced key-value stores, LevelDB and Berke-leyDB running on DRAM-based file system.

References

[1]

"Memcached: A distributed memory object caching system," https://memcached.org/.

[2]

"Redis," http://redis.io.

[3]

"Memcachedb: A distributed key-value storage system designed for persistent," http://memcachedb.org/.

[4]

"Redis persistence," http://redis.io/topics/persistence.

[5]

M. Hosomi, H. Yamagishi, T. Yamamoto, K. Bessho, Y. Higo, K. Yamane, H. Yamada, M. Shoji, H. Hachino, C. Fukumoto et al., "A novel nonvolatile memory with spin torque transfer magnetization switching: Spin-ram," in International Electron Devices Meeting, 2005, pp. 459--462.

[6]

X. Dong, X. Wu, G. Sun, Y. Xie, H. Li, and Y. Chen, "Circuit and microarchitecture evaluation of 3d stacking magnetic ram (mram) as a universal memory replacement," in Design Automation Conference, 2008. DAC 2008. 45th ACM/IEEE. IEEE, 2008, pp. 554--559.

Digital Library

[7]

S. R. Williams, "How we found the missing memristor," Spectrum, IEEE, vol. 45, no. 12, pp. 28--35, 2008.

Digital Library

[8]

B. C. Lee, P. Zhou, J. Yang, Y. Zhang, B. Zhao, E. Ipek, O. Mutlu, and D. Burger, "Phase-change technology and the future of main memory," IEEE micro, no. 1, pp. 143--143, 2010.

Digital Library

[9]

"Intel, micron reveal xpoint, a new memory architecture that could outclass ddr4 and nand," http://www.extremetech.com/extreme/211087-intel-micron-reveal-xpoint-a-new-memory-architecture-that-claims-to-outclass-both-ddr4-and-nand.

[10]

S. Venkataraman, N. Tolia, P. Ranganathan, R. H. Campbell et al., "Consistent and durable data structures for non-volatile byte-addressable memory." in FAST, vol. 11, 2011, pp. 61--75.

Digital Library

[11]

S. Chen and Q. Jin, "Persistent b+-trees in non-volatile main memory," Proceedings of the VLDB Endowment, vol. 8, no. 7, pp. 786--797, 2015.

Digital Library

[12]

P. Chi, W.-C. Lee, and Y. Xie, "Making b+-tree efficient in pcm-based main memory," in Proceedings of the 2014 international symposium on Low power electronics and design. ACM, 2014, pp. 69--74.

Digital Library

[13]

S. R. Dulloor, S. Kumar, A. Keshavamurthy, P. Lantz, D. Reddy, R. Sankaran, and J. Jackson, "System software for persistent memory," in Proceedings of the Ninth European Conference on Computer Systems. ACM, 2014, p. 15.

Digital Library

[14]

X. Wu and A. Reddy, "Scmfs: a file system for storage class memory," in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. ACM, 2011, p. 39.

Digital Library

[15]

J. Condit, E. B. Nightingale, C. Frost, E. Ipek, B. Lee, D. Burger, and D. Coetzee, "Better i/o through byte-addressable, persistent memory," in Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles. ACM, 2009, pp. 133--146.

Digital Library

[16]

G. Graefe, "Hierarchical locking in b-tree indexes." in BTW. Citeseer, 2007, pp. 18--42.

[17]

B. Debnath, A. Haghdoost, A. Kadav, M. G. Khatib, and C. Ungureanu, "Revisiting hash table design for phase change memory," ACM SIGOPS Operating Systems Review, vol. 49, no. 2, pp. 18--26, 2016.

Digital Library

[18]

D. Schwalb, M. Dreseler, M. Uflacker, and H. Plattner, "Nvc-hashmap: A persistent and concurrent hashmap for non-volatile memories," in Proceedings of the 3rd VLDB Workshop on In-Memory Data Mangement and Analytics. ACM, 2015, p. 4.

Digital Library

[19]

H. Volos, A. J. Tack, and M. M. Swift, "Mnemosyne: Lightweight persistent memory," ACM SIGPLAN Notices, vol. 46, no. 3, pp. 91--104, 2011.

Digital Library

[20]

H. Shacham, M. Page, B. Pfaff, E.-J. Goh, N. Modadugu, and D. Boneh, "On the effectiveness of address-space randomization," in Proceedings of the 11th ACM conference on Computer and communications security. ACM, 2004, pp. 298--307.

Digital Library

[21]

G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, "Dynamo: amazon's highly available key-value store," ACM SIGOPS Operating Systems Review, vol. 41, no. 6, pp. 205 220, 2007.

Digital Library

[22]

S. Ghemawat and J. Dean, "Leveldb, a fast and lightweight key/value database library by google," 2014.

[23]

M. A. Olson, K. Bostic, and M. I. Seltzer, "Berkeley db." in USENIX Annual Technical Conference, FREENIX Track, 1999, pp. 183--191.

Digital Library

[24]

J. Coburn, A. M. Caulfield, A. Akel, L. M. Grupp, R. K. Gupta, R. Jhala, and S. Swanson, "Nv-heaps: Making persistent objects fast and safe with next-generation, non-volatile memories," 2011.

[25]

A.-R. Adl-Tabatabai, B. T. Lewis, V. Menon, B. R. Murphy, B. Saha, and T. Shpeisman, "Compiler and runtime support for efficient software transactional memory," ACM SIGPLAN Notices, vol. 41, no. 6, pp. 26--37, 2006.

Digital Library

[26]

R. Fang, H.-I. Hsiao, B. He, C. Mohan, and Y. Wang, "High performance database logging using storage class memory," in Data Engineering (ICDE), 2011 IEEE 27th International Conference on. IEEE, 2011, pp. 1221--1231.

Digital Library

[27]

B. Debnath, A. Haghdoost, A. Kadav, M. G. Khatib, and C. Ungureanu, "Revisiting hash table design for phase change memory," in Proceedings of the 3rd Workshop on Interactions of NVM/FLASH with Operating Systems and Workloads. ACM, 2015, p. 1.

Digital Library

Cited By

Liu HChen DJin HLiao XHe BHu KZhang Y(2021)A Survey of Non-Volatile Main Memory Technologies: State-of-the-Arts, Practices, and Future DirectionsJournal of Computer Science and Technology10.1007/s11390-020-0780-z36:1(4-32)Online publication date: 30-Jan-2021
https://doi.org/10.1007/s11390-020-0780-z
Wang TSambasivam STuck J(2018)Hardware supported permission checks on persistent objects for performance and programmabilityProceedings of the 45th Annual International Symposium on Computer Architecture10.1109/ISCA.2018.00046(466-478)Online publication date: 2-Jun-2018
https://dl.acm.org/doi/10.1109/ISCA.2018.00046
Chen SLi DChen XHan WZeng D(2018)Storage-Aware Network Stack for NVM-Assisted Key-Value Store2018 27th International Conference on Computer Communication and Networks (ICCCN)10.1109/ICCCN.2018.8487330(1-9)Online publication date: Jul-2018
https://doi.org/10.1109/ICCCN.2018.8487330

Index Terms

NVHT: an efficient key-value storage library for non-volatile memory
1. Hardware
  1. Integrated circuits
    1. Semiconductor memory
      1. Non-volatile memory
2. Information systems
  1. Data management systems
    1. Database management system engines
      1. Parallel and distributed DBMSs
        Key-value stores
  2. Information storage systems
    1. Information storage technologies
      1. Storage class memory
        Phase change memory
    2. Storage replication
      1. Storage recovery strategies

Recommendations

NVHT: An efficient key–value storage library for non-volatile memory
Abstract
Non-Volatile Memory (NVM) promises persistence, byte-addressability and DRAM-like read/write latency. These properties indicate that NVM has the potential to be incorporated with key–value stores to achieve high performance and durability ...
Highlights
- An efficient NVM-optimized key–value store named NVHT is proposed.
- Non-volatile pointer is designed to address the invalid pointer problem.
- A wear-out-aware pointer-free buddy allocator is developed.
- A log-based mechanism is ...
NVLSM: A Persistent Memory Key-Value Store Using Log-Structured Merge Tree with Accumulative Compaction
Computer systems utilizing byte-addressable Non-Volatile Memory (NVM) as memory/storage can provide low-latency data persistence. The widely used key-value stores using Log-Structured Merge Tree (LSM-Tree) are still beneficial for NVM systems in aspects ...
A server bypass architecture for hopscotch hashing key–value store on DRAM-NVM memories
Abstract
Non-volatile memories (NVMs), along with DRAMs, provide key–value (KV) stores with strong support in persisting data and storing it in memories. The remote direct memory access (RDMA) technology has been employed to boost remote data ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

BDCAT '16: Proceedings of the 3rd IEEE/ACM International Conference on Big Data Computing, Applications and Technologies

December 2016

373 pages

ISBN:9781450346177

DOI:10.1145/3006299

Program Chairs:
Ashiq Anjum
University of Derby, UK
,
Xinghui Zhao
Washington State University, Vancouver, WA

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

UCC '16

Sponsor:

SIGHPC

UCC '16: 9th International Conference on Utility and Cloud Computing

December 6 - 9, 2016

Shanghai, China

Acceptance Rates

Overall Acceptance Rate 27 of 93 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu HChen DJin HLiao XHe BHu KZhang Y(2021)A Survey of Non-Volatile Main Memory Technologies: State-of-the-Arts, Practices, and Future DirectionsJournal of Computer Science and Technology10.1007/s11390-020-0780-z36:1(4-32)Online publication date: 30-Jan-2021
https://doi.org/10.1007/s11390-020-0780-z
Wang TSambasivam STuck J(2018)Hardware supported permission checks on persistent objects for performance and programmabilityProceedings of the 45th Annual International Symposium on Computer Architecture10.1109/ISCA.2018.00046(466-478)Online publication date: 2-Jun-2018
https://dl.acm.org/doi/10.1109/ISCA.2018.00046
Chen SLi DChen XHan WZeng D(2018)Storage-Aware Network Stack for NVM-Assisted Key-Value Store2018 27th International Conference on Computer Communication and Networks (ICCCN)10.1109/ICCCN.2018.8487330(1-9)Online publication date: Jul-2018
https://doi.org/10.1109/ICCCN.2018.8487330

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten