Skip to main content

A Study of Space Reclamation on Flash-Based Append-only Storage Management

  • Conference paper
Database Systems for Advanced Applications (DASFAA 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7240))

Included in the following conference series:

  • 975 Accesses

Abstract

Flash disks exhibit many different IO characteristics from magnetic disks. Flash-based databases should consider such traits of flash disks as faster access performance but discrepant between reads and writes, and between sequential and random accesses etc. To overcome the poor performance of random writes on flash memory, log-based and append-only storage management had been proposed by replacing random write with sequential write; this paper studies append-only storage management(ASM) with effective space reclamation methods, which work for both traditional relational database systems and key-value database systems built on flash devices. In this paper, we detail two kinds of record layouts used for space reclamation and then propose three space reclamation algorithms based on them. Our experiments show that the append-only storage management with bitmap index-based space reclamation algorithm(BI-ASM) has a factor of 32 of spatial improvement and factors from 23 to 44 of temporal improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tae-Sun, C., Dong-Joo, P., Sangwon, P., Dong-Ho, L., Sang-Won, L., Ha-Joo, S.: A survey of Flash Transalation Layer. Journal of Systems Architecture - Embedded Systems Design (JSA) 55, 332–343 (2009)

    Google Scholar 

  2. Intel: Understanding the flash translation layer specification. In: Application Note AP-684 (December 1998)

    Google Scholar 

  3. Sungjin, L., Dongkun, S., Young-Jin, K., Jihong, K.: Last: locality-aware sector translation for nand flash memory-based storage systems. ACM SIGOPS Operating Systems Review 42, 36–42 (2008)

    Google Scholar 

  4. Jesung, K., Jong-Min, K., Sam, H.N., Sang Lyul, M., Yookun, C.: A Space-Efficient Flash Translation Layer for Compact-Flash Systems. IEEE Transactions on Consumer Electronics 48, 366–375 (2002)

    Article  Google Scholar 

  5. Jeong-Uk, K., Heeseung, J., Jinsoo, K., Joonwon, L.: A superblock-based flash translation layer for NAND flash memory. In: Proceedings of the 6th ACM & IEEE International Conference on Embedded Software (EMSOFT 2006), pp. 117–161. ACM & IEEE Press, Seoul (2006)

    Google Scholar 

  6. Lee, S.-W., Choi, W.-K., Park, D.-J.: FAST: An Efficient Flash Translation Layer for Flash Memory. In: Zhou, X., Sokolsky, O., Yan, L., Jung, E.-S., Shao, Z., Mu, Y., Lee, D.C., Kim, D.Y., Jeong, Y.-S., Xu, C.-Z. (eds.) EUC Workshops 2006. LNCS, vol. 4097, pp. 879–887. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Chin-Hsien, W., Tei-Wei, K.: An Adaptive Two-Level Management for the Flash Translation Layer in embedded Systems. In: The International Conference on Computer-Aided Design (ICCAD 2006), pp. 601–606. IEEE Press, San Jose (2006)

    Google Scholar 

  8. Mehul, A.S., Stavros, H., Janet, L.: Fast scans and joins using flash drives. In: SIGMOD Workshop DaMoN, pp. 17–24. ACM Press, Vancouver (2008)

    Google Scholar 

  9. Raghu, R., Johannes, G.: Database Management Systems. In: WCB, 2nd edn., McGraw-Hill (2000)

    Google Scholar 

  10. George, P.C., Setrag, K.: A Decomposition Storage Model. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2085), pp. 268–279. ACM Press, Austin (1985)

    Google Scholar 

  11. Sang-Won, L., Bongki, M.: Design of flash-based DBMS: an in-page logging approach. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2007), pp. 55–66. ACM Press, Beijing (2007)

    Google Scholar 

  12. Yi-Reun, K., Kyu-Young, W., Il-Yeol, S.: Page-differential logging: an efficient and DBMS-independent approach for storing data into flash memory. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2010), pp. 363–374. ACM Press, Indianapolis (2010)

    Google Scholar 

  13. Na, G.-J., Moon, B., Lee, S.-W.: In-Page Logging B-Tree for Flash Memory. In: Zhou, X., Yokota, H., Deng, K., Liu, Q. (eds.) DASFAA 2009. LNCS, vol. 5463, pp. 755–758. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  14. Gap-Joo, N., Sang-Won, L., Bongki, M.: Dynamic in-page logging for flash-aware B-tre index. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management(CIKM 2009), pp. 1485–1488. ACM Press, Hong Kong (2009)

    Google Scholar 

  15. David, G.A., Jason, F., Michael, K., Amar, P., Lawrence, T., Vijay, V.: FAWN: a fast array of wimpy nodes. In: Proceedings of the 23rd ACM Symposium on Operating Systems Principles (SOSP 2011), vol. 54(7), pp. 101–109. ACM Press, Cascais (2011)

    Google Scholar 

  16. Biplob, D., Sudipta, S., Jin, L.: FlashStore: High throughput persistent key-value store. In: Proceedings of the VLDB Endowment (VLDB 2010), vol. 3, pp. 1414–1425. ACM Press, Singapore (2010)

    Google Scholar 

  17. Biplob, D., Sudipta, S., Jin, L.: SkimpyStash: RAM space skimpy key-value store on flash-based storage. In: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2011), pp. 25–36. ACM Press, Athens (2011)

    Google Scholar 

  18. Biplob, D., Sudipta, S., Jin, L.: ChunkStash: Speeding up Inline Storage Deduplication using Flash Memory. In: 2010 USENIX Conference on USENIX Annual Technical Conference (ATC), p. 16. ACM Press, Berkeley (2010)

    Google Scholar 

  19. Duck-Ho, B., Ji-Woong, C., Sang-Wook, K.: Clustering and Non-clustering Effects in Flash Memory Databases. In: Database and Expert Systems Applications, DEXA, International Workshops, pp. 4–8. IEEE Press, Linz (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fan, Y., Cao, W., Meng, X. (2012). A Study of Space Reclamation on Flash-Based Append-only Storage Management. In: Yu, H., Yu, G., Hsu, W., Moon, YS., Unland, R., Yoo, J. (eds) Database Systems for Advanced Applications. DASFAA 2012. Lecture Notes in Computer Science, vol 7240. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29023-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-29023-7_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29022-0

  • Online ISBN: 978-3-642-29023-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics