skip to main content
10.1145/1871437.1871483acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

StableBuffer: optimizing write performance for DBMS applications on flash devices

Published: 26 October 2010 Publication History

Abstract

Flash devices have been widely used in embedded systems, laptop computers, and enterprise servers. However, the poor random writes have been an obstacle to running write-intensive DBMS applications on flash devices. In this paper, we exploit the recently discovered, efficient write patterns of flash devices to optimize the performance of DBMS applications. Specifically, motivated by a focused write pattern, we propose to write pages temporarily to a small, pre-allocated storage space on the flash device, called StableBuffer, instead of directly writing to their actual destinations. We then recognize and flush efficient write patterns of the buffer to achieve a better write performance. In contrast to prior log-based techniques, our StableBuffer solution does not require modifying the driver of flash devices and hence works well for commodity flash devices. We discuss the detailed design and implementation of the StableBuffer solution. Performance evaluation based on a TPC-C benchmark trace shows that StableBuffer improves the response time and throughput of write operations by a factor of 1.5-12, in comparison with a direct write-through strategy.

References

[1]
TPC Benchmark C: Standard Specification. http://www.tpc.org/tpcc/spec/tpcc_current.pdf.
[2]
Solid State Drive MSD-SATA3035: 3.5-inch Product Specification. Mtron Co. Ltd., Jan. 2008.
[3]
D. Agrawal, D. Ganesan, R. Sitaraman, and Y. Diao. Lazy-adaptive tree: An optimized index structure for flash devices. In VLDB '09, 2009.
[4]
L. Bouganim, B. T. Jónsson, and P. Bonnet. uFLIP: Understanding flash io patterns. In CIDR, 2009.
[5]
L.-P. Chang. On efficient wear leveling for large-scale flash-memory storage systems. In SAC '07, pages 1126--1130, 2007.
[6]
L.-P. Chang, T.-W. Kuo, and S. Lo. Real-time garbage collection for flash-memory storage systems of real-time embedded systems. ACM Trans. on Embedded Computing Sys., 3(4):837--863, 2004.
[7]
Y. Chang, J. Hsieh, and T.-W. Kuo. Endurance enhancement of flash-memory storage systems: an efficient static wear leveling design. In DAC '07, pages 212--217, 2007.
[8]
F. Chen, D. A. Koufaty, and X. Zhang. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In SIGMETRICS '09, pages 181--192, 2009.
[9]
S. Chen. FlashLogging: Exploiting flash devices for synchronous logging performance. In SIGMOD '09, pages 73--86, 2009.
[10]
H.-T. Chou and D. J. DeWitt. An evaluation of buffer management strategies for relational database systems. In VLDB '85, pages 127--141. VLDB Endowment, 1985.
[11]
A. Kawaguchi, S. Nishioka, and H. Motoda. A flash-memory based file system. In USENIX Winter, pages 155--164, 1995.
[12]
H. Kim and S. Ahn. BPLRU: A buffer management scheme for improving random writes in flash storage. In FAST '08, 2008.
[13]
H. Kim and S. Lee. A new flash memory management for flash storage system. In COMPSAC '99, 1999.
[14]
Y.-R. Kim, K.-Y. Whang, and I.-Y. Song. Page-Differential Logging: An efficient and dbms-independent approach for storing data into flash memory. In SIGMOD '10, 2010.
[15]
S. Lawson. Cloud computing could be a boon for flash storage. http://www.businessweek.com/technology/content/aug2009/tc20090824_219491.htm, 2009.
[16]
S.-W. Lee and B. Moon. Design of flash-based DBMS: an in-page logging approach. In SIGMOD '07, pages 55--66, 2007.
[17]
S.-W. Lee, B. Moon, C. Park, J.-M. Kim, and S.-W. Kim. A case for flash memory ssd in enterprise database applications. In SIGMOD, 2008.
[18]
Y. Li, B. He, R. J. Yang, Q. Luo, and K. Yi. Tree indexing on solid state drives. In VLDB '10, 2010.
[19]
Y. Li, S. T. On, J. Xu, B. Choi, and H. Hu. DigestJoin: Exploiting fast random reads for flash-based joins. In MDM '09, pages 152--161, 2009.
[20]
S. Nath and A. Kansal. FlashDB: Dynamic self-tuning database for nand flash. Technical Report MSR-TR-2006-168, Microsoft Research, 2006.
[21]
S. T. On, Y. Li, B. He, M. Wu, Q. Luo, and J. Xu. FD-Buffer: A buffer manager for databases on flash disks. In CIKM '10, 2010.
[22]
Y. Ou, T. Haerder, and P. Jin. CFDC - A flash-aware replacement policy for database buffer management. In DaMoN '09, 2009.
[23]
R. Stoica, M. Athanassoulis, R. Johnson, and A. Ailamaki. Evaluating and repairing write performance on flash devices. In DaMoN '09, 2009.
[24]
D. Tsirogiannis, S. Harizopoulos, M. A. Shah, J. L. Wiener, and G. Graefe. Query processing techniques for solid state drives. In SIGMOD '09, pages 59--72, 2009.
[25]
C.-H. Wu, T.-W. Kuo, and L.-P. Chang. An efficient B-tree layer implementation for flash-memory storage systems. ACM Trans. on Embedded Computing Sys., 6(3):19, 2007.

Cited By

View all
  • (2018)PBFilterInformation Systems10.1016/j.is.2012.02.00237:7(634-653)Online publication date: 29-Dec-2018
  • (2017)Dynamic Allocation Mechanism to Reduce Read Latency in Collaboration With a Device Queue in Multichannel Solid-State DevicesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2016.258990136:4(600-613)Online publication date: 1-Apr-2017
  • (2012)Improving database performance using a flash-based write cacheProceedings of the 17th international conference on Database Systems for Advanced Applications10.1007/978-3-642-29023-7_2(2-13)Online publication date: 15-Apr-2012
  • Show More Cited By

Index Terms

  1. StableBuffer: optimizing write performance for DBMS applications on flash devices

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge management
      October 2010
      2036 pages
      ISBN:9781450300995
      DOI:10.1145/1871437
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 26 October 2010

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. databases
      2. flash devices
      3. write performance

      Qualifiers

      • Research-article

      Conference

      CIKM '10

      Acceptance Rates

      Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

      Upcoming Conference

      CIKM '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 18 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2018)PBFilterInformation Systems10.1016/j.is.2012.02.00237:7(634-653)Online publication date: 29-Dec-2018
      • (2017)Dynamic Allocation Mechanism to Reduce Read Latency in Collaboration With a Device Queue in Multichannel Solid-State DevicesIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2016.258990136:4(600-613)Online publication date: 1-Apr-2017
      • (2012)Improving database performance using a flash-based write cacheProceedings of the 17th international conference on Database Systems for Advanced Applications10.1007/978-3-642-29023-7_2(2-13)Online publication date: 15-Apr-2012
      • (2011)Report on the first international workshop on flash-based database systems (FlashDB 2011)ACM SIGMOD Record10.1145/2034863.203487240:2(40-44)Online publication date: 15-Sep-2011
      • (2010)FD-bufferProceedings of the 19th ACM international conference on Information and knowledge management10.1145/1871437.1871605(1297-1300)Online publication date: 26-Oct-2010

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media