research-article

A case for flash memory ssd in enterprise database applications

Authors:

Sang-Woo KimAuthors Info & Claims

SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

Pages 1075 - 1086

https://doi.org/10.1145/1376616.1376723

Published: 09 June 2008 Publication History

Abstract

Due to its superiority such as low access latency, low energy consumption, light weight, and shock resistance, the success of flash memory as a storage alternative for mobile computing devices has been steadily expanded into personal computer and enterprise server markets with ever increasing capacity of its storage. However, since flash memory exhibits poor performance for small-to-moderate sized writes requested in a random order, existing database systems may not be able to take full advantage of flash memory without elaborate flash-aware data structures and algorithms. The objective of this work is to understand the applicability and potential impact that flash memory SSD (Solid State Drive) has for certain type of storage spaces of a database server where sequential writes and random reads are prevalent. We show empirically that up to more than an order of magnitude improvement can be achieved in transaction processing by replacing magnetic disk with flash memory SSD for transaction log, rollback segments, and temporary table spaces.

References

[1]

Hal Berenson, Philip A. Bernstein, Jim Gray, Jim Melton, Elizabeth J. O'Neil, and Patrick E. O'Neil. A Critique of ANSI SQL Isolation Levels. In Proceedings of the ACM SIGMOD, pages 1--10, San Jose, CA, May 1995.

Digital Library

[2]

Andrew Birrell, Michael Isard, Chuck Thacker, and Ted Wobbe. A Design for High-Performance Flash Disks. Technical Report MSR-TR-2005-176, Microsoft Research, December 2005.

[3]

Transaction Processing Performance Council. TPC Benchmark. http://www.tpc.org/.

[4]

David J. DeWitt, Randy H. Katz, Frank Olken, Leonard D. Shapiro, Michael Stonebraker, and David A. Wood. Implementation Techniques for Main Memory Database Systems. In Proceedings of the ACM SIGMOD, pages 1--8, Boston, MA, June 1984.

Digital Library

[5]

Eran Gal and Sivan Toledo. Mapping Structures for Flash Memories: Techniques and Open Problems. In International Conference on Software - Science, Technology & Engineering (SwSTE'05), Herzelia, Israel, February 2005.

Digital Library

[6]

Goetz Graefe. Sort-Merge-Join: An Idea Whose Time Has(h) Passed? In Proceedings of ICDE, pages 406--417, Houston, TX, February 1994.

Digital Library

[7]

Goetz Graefe. The Five-minute Rule Twenty Years Later, and How Flash Memory Changes the Rules. In Third International Workshop on Data Management on New Hardware (DAMON2007), Beijing, China, June 2007.

Digital Library

[8]

Goetz Graefe, Ann Linville, and Leonard D. Shapiro. Sort versus Hash Revisited. IEEE Transactions on Knowledge and Data Engineering, 6(6):934--944, December 1994.

Digital Library

[9]

Jim Gray. Rules of Thumb in Data Engineering. In Proceedings of ICDE, pages 3--12, San Diego, CA, March 2000.

Digital Library

[10]

Jim Gray and Bob Fitzgerald. Flash Disk Opportunity for Server-Applications. http://www.research.microsoft.com/~gray, January 2007.

[11]

Chang-Gyu Hwang. Nanotechnology Enables a New Memory Growth Model. Proceedings of the IEEE, 91(11):1765--1771, November 2003.

[12]

Intel. Understanding the Flash Translation Layer (FTL) Specification. Application Note AP-684, Intel Corporation, December 1998.

[13]

Edmond Lau and Samuel Madden. An Integrated Approach to Recovery and High Availability in an Updatable, Distributed Data Warehouse. In Proceedings of VLDB, pages 703--714, Seoul, Korea, September 2006.

Digital Library

[14]

Sang-Won Lee and Bongki Moon. Design of Flash-Based DBMS: An In-Page Logging Approach. In Proceedings of the ACM SIGMOD, pages 55--66, Beijing, China, June 2007.

Digital Library

[15]

David B. Lomet, Roger S. Barga, Mohamed F. Mokbel, German Shegalov, Rui Wang, and Yunyue Zhu. Transaction Time Support Inside a Database Engine. In Proceedings of ICDE, pages 35--44, Atlanta, GA, April 2006.

Digital Library

[16]

David T. McWherter, Bianca Schroeder, Anastassia Ailamaki, and Mor Harchol-Balter. Priority Mechanisms for OLTP and Transactional Web Applications. In Proceedings of ICDE, pages 535--546, Boston, MA, March 2004.

Digital Library

[17]

Oracle. Oracle Flashback Technology. http://www.oracle.com/technology/deploy/-availability/htdocs/Flashback_Overview.htm, 2007.

[18]

Chanik Park, Prakash Talawar, Daesik Won, MyungJin Jung, JungBeen Im, Suksan Kim, and Youngjoon Choi. A High Performance Controller for NAND Flash-based Solid State Disk (NSSD). In The 21st IEEE Non-Volatile Semiconductor Memory Workshop (NVSMW), Monterey, CA, February 2006.

[19]

David A. Patterson. Latency Lags Bandwidth. Communications of the ACM, 47(10):71--75, October 2004.

Digital Library

[20]

Michael Stonebraker. The Design of the POSTGRES Storage System. In Proceedings of VLDB, pages 289--300, Brighton, England, September 1987.

Digital Library

[21]

Michael Stonebraker, Samuel Madden, Daniel J. Abadi, Stravros Harizopoulos, Nabil Hachem, and Pat Helland. The End of an Architectural Era (It's Time for a Complete Rewrite). In Proceedings of VLDB, pages 289--300, Vienna, Austria, September 2007.

Digital Library

[22]

Theo Härder and Andreas Reuter. Principles of Transaction-Oriented Database Recovery. ACM Computing Survey, 15(4):287--317, December 1983.

Digital Library

[23]

Kimberly L. Tripp and Neal Graves. SQL Server 2005 Row Versioning-based Transaction Isolation. Microsoft SQL Server Technical article, July 2006.

[24]

Chi Zhang, Xiang Yu, Arvind Krishnamurthy, and Randolph Y. Wang. Configuring and Scheduling an Eager-Writing Disk Array for a Transaction Processing Workload. In FAST02, January 2002.

Digital Library

Cited By

Haas GAlhomssi ALeis V(2025)Managing Very Large Datasets on Directly Attached NVMe ArraysScalable Data Management for Future Hardware10.1007/978-3-031-74097-8_9(223-240)Online publication date: 24-Jan-2025
https://doi.org/10.1007/978-3-031-74097-8_9
Park KLerner ALee SBonnet PSong YCudré-Mauroux PChoi J(2024)BABOL: A Software-Defined NAND Flash Controller2024 57th IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO61859.2024.10869629(1693-1705)Online publication date: 2-Nov-2024
https://doi.org/10.1109/MICRO61859.2024.10869629
Kuiper LBoncz PMühleisen H(2024)Robust External Hash Aggregation in the Solid State Age2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00288(3753-3766)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00288
Show More Cited By

Index Terms

A case for flash memory ssd in enterprise database applications
1. Information systems
  1. Data management systems
    1. Data structures
      1. Data access methods

Recommendations

Advances in flash memory SSD technology for enterprise database applications
SIGMOD '09: Proceedings of the 2009 ACM SIGMOD International Conference on Management of data

The past few decades have witnessed a chronic and widening imbalance among processor bandwidth, disk capacity, and access speed of disk. According to Amdhal's law, the performance enhancement possible with a given improvement is limited by the amount ...
A Hybrid Flash Memory SSD Scheme for Enterprise Database Applications
APWEB '10: Proceedings of the 2010 12th International Asia-Pacific Web Conference

Flash memory has many advantages such as high performance, low electronic power, non-volatile storage and physical stability, over hard-disks. For this reason, flash memory has been deployed as data storage for mobile devices, including PDAs, MP3 ...
A hybrid SSD with PRAM and NAND Flash memory

The speed of computing processor has been improved dramatically with multi-core architecture. However, the overall computer system performance shows slow improvement because of the sluggish speed of storage system. Several researches have been done to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

June 2008

1396 pages

ISBN:9781605581026

DOI:10.1145/1376616

General Chairs:
Laks V. S. Lakshmanan
University of British Columbia, Canada
,
Raymond T. Ng
University of British Columbia, Canada
,
Dennis Shasha
New York University, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 June 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGMOD/PODS '08

Sponsor:

SIGMOD/PODS '08: SIGMOD/PODS '08 - International Conference on Management of Data

June 9 - 12, 2008

Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

257
Total Citations
View Citations
4,262
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)7

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Haas GAlhomssi ALeis V(2025)Managing Very Large Datasets on Directly Attached NVMe ArraysScalable Data Management for Future Hardware10.1007/978-3-031-74097-8_9(223-240)Online publication date: 24-Jan-2025
https://doi.org/10.1007/978-3-031-74097-8_9
Park KLerner ALee SBonnet PSong YCudré-Mauroux PChoi J(2024)BABOL: A Software-Defined NAND Flash Controller2024 57th IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO61859.2024.10869629(1693-1705)Online publication date: 2-Nov-2024
https://doi.org/10.1109/MICRO61859.2024.10869629
Kuiper LBoncz PMühleisen H(2024)Robust External Hash Aggregation in the Solid State Age2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00288(3753-3766)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00288
Trivedi AJansen MDoekemeijer KTalluri STehrany N(2024) Reviving Storage Systems Education in the 21 st Century — An experience report 2024 IEEE 24th International Symposium on Cluster, Cloud and Internet Computing (CCGrid)10.1109/CCGrid59990.2024.00074(616-625)Online publication date: 6-May-2024
https://doi.org/10.1109/CCGrid59990.2024.00074
Haas GLeis V(2023)What Modern NVMe Storage Can Do, and How to Exploit it: High-Performance I/O for High-Performance Storage EnginesProceedings of the VLDB Endowment10.14778/3598581.359858416:9(2090-2102)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.14778/3598581.3598584
Guo BYu JYang DLeng HLiao B(2022)Energy-Efficient Database Systems: A Systematic SurveyACM Computing Surveys10.1145/353822555:6(1-53)Online publication date: 7-Dec-2022
https://dl.acm.org/doi/10.1145/3538225
Lee SLerner ARyser APark KJeon CPark JSong YCudré-Mauroux PIves ZBonifati AEl Abbadi A(2022)X-SSD: A Storage System with Native Support for Database Logging and ReplicationProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526188(988-1002)Online publication date: 10-Jun-2022
https://dl.acm.org/doi/10.1145/3514221.3526188
Gao CYe MXue CZhang YShi LShu JYang J(2022)Reprogramming 3D TLC Flash Memory based Solid State DrivesACM Transactions on Storage10.1145/348706418:1(1-33)Online publication date: 29-Jan-2022
https://dl.acm.org/doi/10.1145/3487064
Cadenelli NJun SPolo JWright ACarrera DArvind (2021)Enabling Genomics Pipelines in Commodity Personal Computers With Flash StorageFrontiers in Genetics10.3389/fgene.2021.61595812Online publication date: 29-Apr-2021
https://doi.org/10.3389/fgene.2021.615958
Costa RMoreira JPintor Pdos Santos VLifschitz S(2021)Data-driven Performance Tuning for Big Data Analytics PlatformsBig Data Research10.1016/j.bdr.2021.100206(100206)Online publication date: Jan-2021
https://doi.org/10.1016/j.bdr.2021.100206
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten