skip to main content
10.1145/2757667.2757680acmconferencesArticle/Chapter ViewAbstractPublication PagessystorConference Proceedingsconference-collections
research-article

SMRDB: key-value data store for shingled magnetic recording disks

Published: 26 May 2015 Publication History

Abstract

Shingled Magnetic Recording (SMR) disks employ a shingled write process that overlaps the data tracks on the disk surface like the shingles on a roof, thereby increasing disk areal density with minimal manufacturing changes. While these disks have the same read behavior as current disks, random writes and in-place data updates are no longer possible, since a write to a track must overwrite and destroy data on all tracks that it overlaps.
Given this change in write behavior, we argue that the best way to utilize these disks is not by masquerading them as traditional disks, but by using approaches that leverage their proclivity for sequential writes. To address this need, we developed SMRDB, a key-value data store for SMR disks, demonstrating that SMR disks can be effectively used to replace conventional disks for many applications. We evaluate SMRDB against a state-of-the-art LSM-tree based key-value database engine, LevelDB, on conventional disks. Our Yahoo! Cloud Serving Benchmark results show that, despite being restricted to sequential writes, SMRDB outperforms LevelDB by 8.8--123.6%.

References

[1]
A. Amer, J. Holliday, D. D. E. Long, E. L. Miller, J.-F. Pâris, and T. Schwarz. Data Management and Layout for Shingled Magnetic Recording. IEEE Transactions on Magnetics, 47(10): 3691--3697, Oct. 2011.
[2]
D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan. FAWN: A Fast Array of Wimpy Nodes. In Proceedings of the 22nd ACM Symposium on Operating Systems Principles, SOSP '09, Oct. 2009.
[3]
J. Campello. Shingled Magnetic Recording (SMR) Introduction. http://www.t10.org/cgi-bin/ac.pl?t=d&f=13-148r0.pdf, 2013.
[4]
Y. Cassuto, M. A. A. Sanvido, C. Guyot, D. R. Hall, and Z. Z. Bandic. Indirection Systems for Shingled-recording Disk Drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies, MSST '10, 2010.
[5]
F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A Distributed Storage System for Structured Data. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation, OSDI '06, 2006.
[6]
B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking Cloud Serving Systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10, 2010.
[7]
B. Debnath, S. Sengupta, and J. Li. FlashStore: High Throughput Persistent Key-Value Store. In Proceedings of the 36th Conference on Very Large Databases, VLDB '10, Sept. 2010.
[8]
B. Debnath, S. Sengupta, and J. Li. SkimpyStash: RAM space skimpy key-value store on flash-based storage. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of data, SIGMOD '11, 2011.
[9]
G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's Highly Available Key-value Store. In Proceedings of the 21st ACM Symposium on Operating Systems Principles, SOSP '07, Oct. 2007.
[10]
T. Feldman and G. Gibson. Shingled Magnetic Recording: Areal T. Feldman and G. Gibson. Shingled Magnetic Recording: Areal Density Increase Requires New Data Management. ;login:, 38 (3), June 2013.
[11]
S. Ghemawat and J. Dean. LevelDB. https://github.com/google/leveldb, 2015.
[12]
G. Gibson and G. Ganger. Principles of Operation for Shingled Disk Devices. Technical Report CMU-PDL-11-107, Carnegie Mellon University, 2011.
[13]
S. Greaves, Y. Kanai, and H. Muraoka. Shingled Recording for 2--3 Tbit/in2. IEEE Transactions on Magnetics, 45(10): 3823--3829, Oct. 2009.
[14]
D. Hall, J. H. Marcos, and J. D. Coker. Data Handling Algorithms For Autonomous Shingled Magnetic Recording HDDs. IEEE Transactions on Magnetics, 48(5): 1777--1781, May 2012.
[15]
HBase. https://hbase.apache.org/, 2015.
[16]
J. N. Matthews, D. Roselli, A. M. Costello, R. Y. Wang, and T. E. Anderson. Improving the Performance of Log-structured File Systems with Adaptive Methods. In Proceedings of the Sixteenth ACM Symposium on Operating Systems Principles, SOSP '97, 1997.
[17]
D. L. Moal, Z. Bandic, and C. Guyot. Shingled File System Host-Side Management of Shingled Magnetic Recording Disks. In IEEE International Conference on Consumer Electronics, 2012.
[18]
P. O'Neil, E. Cheng, D. Gawlick, and E. O'Neil. The Log-Structured Merge-Tree (LSM-Tree). Acta Informatica, 33: 351--385, 1996.
[19]
G. Piatetsky-Shapiro and C. Connell. Accurate Estimation of the Number of Tuples Satisfying a Condition. In Proceedings of the 1984 ACM SIGMOD International Conference on Management of Data, SIGMOD '84, 1984.
[20]
R. Pitchumani, A. Hospodor, A. Amer, Y. Kang, E. L. Miller, and D. D. E. Long. Emulating a Shingled Write Disk. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS '12, 2012.
[21]
K. Ren and G. Gibson. TABLEFS: Embedding a NoSQL Database Inside the Local File System. In IEEE Asia-Pacific Magnetic Recording Conference, APMRC 2012, 2012.
[22]
M. Rosenblum and J. K. Ousterhout. The Design and Implementation of a Log-Structured File System. ACM Transactions on Computer Systems, 10(1): 26--52, Feb. 1992.
[23]
Seagate-Kinetic. The Seagate Kinetic Open Storage Vision. http://www.seagate.com/tech-insights/kinetic-vision-how-seagate-new-developer-tools-meets-the-needs-of-cloud-storage-platforms-master-ti/, 2014.
[24]
R. Sears and R. Ramakrishnan. bLSM: A General Purpose Log Structured Merge Tree. In Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, SIGMOD '12, 2012.
[25]
P. Shetty, R. Spillane, R. Malpani, B. Andrews, J. Seyster, and E. Zadok. Building Workload-Independent Storage with VT-Trees. In Proceedings of the 11th USENIX Conference on File and Storage Technologies, FAST'13, 2013.
[26]
SMR-8TB-HDD. Seagate 8TB SMR HDD. http://www.seagate.com/products/enterprise-servers-storage/nearline-storage/archive-hdd/, 2014.
[27]
J. Stender, B. Kolbeck, M. Högqvist, and F. Hupfeld. BabuDB: Fast and Efficient File System Metadata Storage. In Proceedings of the 2010 International Workshop on Storage Network Architecture and Parallel I/Os, SNAPI '10, 2010.
[28]
A. Suresh, G. Gibson, and G. Ganger. Shingled Magnetic Recording for Big Data Applications. Technical Report CMU-PDL-12-105, Carnegie Mellon University, May 2012.
[29]
K. S. Venkataraman, G. Dong, and T. Zhang. Techniques Mitigating Update-Induced Latency Overhead in Shingled Magnetic Recording. IEEE Transactions on Magnetics, 48(5): 1899--1905, May 2012.
[30]
H. T. Vo, S. Wang, D. Agrawal, G. Chen, and B. C. Ooi. Log-Base: A Scalable Log-structured Database System in the Cloud. Proceedings of the VLDB Endowment, 5(10): 1004--1015, June 2012.
[31]
Voldemort. http://www.project-voldemort.com/voldemort/, 2015.

Cited By

View all
  • (2024)A Space-Grained Cleaning Method to Reduce Long-Tail Latency of DM-SMR DisksACM Transactions on Embedded Computing Systems10.1145/364382723:2(1-24)Online publication date: 5-Feb-2024
  • (2024)Dynamic zone redistribution for key-value stores on zoned namespaces SSDsJournal of Systems Architecture10.1016/j.sysarc.2024.103159152(103159)Online publication date: Jul-2024
  • (2023)SMRSTOREProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585963(395-408)Online publication date: 21-Feb-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SYSTOR '15: Proceedings of the 8th ACM International Systems and Storage Conference
May 2015
183 pages
ISBN:9781450336079
DOI:10.1145/2757667
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 May 2015

Permissions

Request permissions for this article.

Check for updates

Badges

  • Best Paper

Author Tags

  1. key-value storage systems
  2. shingled magnetic recording

Qualifiers

  • Research-article

Funding Sources

Conference

SYSTOR 2015
Sponsor:

Acceptance Rates

Overall Acceptance Rate 108 of 323 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Space-Grained Cleaning Method to Reduce Long-Tail Latency of DM-SMR DisksACM Transactions on Embedded Computing Systems10.1145/364382723:2(1-24)Online publication date: 5-Feb-2024
  • (2024)Dynamic zone redistribution for key-value stores on zoned namespaces SSDsJournal of Systems Architecture10.1016/j.sysarc.2024.103159152(103159)Online publication date: Jul-2024
  • (2023)SMRSTOREProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585963(395-408)Online publication date: 21-Feb-2023
  • (2023)LifetimeKV: Narrowing the Lifetime Gap of SSTs in LSMT-based KV Stores for ZNS SSDs2023 IEEE 41st International Conference on Computer Design (ICCD)10.1109/ICCD58817.2023.00053(300-307)Online publication date: 6-Nov-2023
  • (2022)Lifetime-leveling LSM-tree compaction for ZNS SSDProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539741(100-105)Online publication date: 27-Jun-2022
  • (2022)Building GC-free Key-value Store on HM-SMR Drives with ZoneFSACM Transactions on Storage10.1145/350284618:3(1-23)Online publication date: 24-Aug-2022
  • (2022)Performance Enhancement of SMR-Based Deduplication SystemsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2021.312007241:9(2835-2848)Online publication date: Sep-2022
  • (2022)KVSTL: An Application Support to LSM-Tree Based Key-Value Store via Shingled Translation Layer Data ManagementIEEE Transactions on Computers10.1109/TC.2021.309896171:7(1598-1611)Online publication date: 1-Jul-2022
  • (2022)MAGIC: Making IMR-Based HDD Perform Like CMR-Based HDDIEEE Transactions on Computers10.1109/TC.2021.305977071:3(643-657)Online publication date: 1-Mar-2022
  • (2021)FluidSMR: Adaptive Management for Hybrid SMR DrivesACM Transactions on Storage10.1145/346540417:4(1-30)Online publication date: 15-Oct-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media