research-article

S-RAC: SSD Friendly Caching for Data Center Workloads

Authors:

Yuangang WangAuthors Info & Claims

SYSTOR '16: Proceedings of the 9th ACM International on Systems and Storage Conference

Article No.: 8, Pages 1 - 12

https://doi.org/10.1145/2928275.2928284

Published: 06 June 2016 Publication History

Abstract

Current data-center applications tend to process increasingly large volume of data sets. The caching effect of page cache is reduced by its limited capacity. Emerging flash-based solid state drives (SSD) have latency and price advantages compared to hard disk and DRAM. Thus, SSD-based caching is widely deployed in data centers. However, SSD caching faces two challenges. First, SSD has limited write endurance, which requires cache manager to reduce write amount to SSD. Second, data-center workloads exhibit a diverse I/O access patterns, which requires one to figure out SSD caching friendly access patterns. This paper first classifies 6 I/O access patterns among 32 data-center workloads using a cost-benefit analysis. We derive implications for designing SSD cache from analyzing the access patterns. We then propose an SSD cache manager S-RAC with re-adding blocks and ghost cache adaptation to retain SSD friendly blocks in SSD. The experimental evaluation shows the efficiency of S-RAC in reducing SSD write amount while improving/maintaining cache hit ratio.

References

[1]

Filebench. http://filebench.sourceforge.net/wiki/index.php/Main_Page.

[2]

I/O Traces from SNIA. http://iotta.snia.org/tracetypes/3.

[3]

UMASS Trace Repository: Storage Access Traces. http://traces.cs.umass.edu/index.php/Storage/Storage.

[4]

Dm-cache kernel document. https://www.kernel.org/doc/Documentation/devicemapper/cache.txt, 2013.

[5]

Oracle Exadata Smart Flash Cache. http://www.oracle.com/technetwork/database/exadata/exadata-smart-flash-cache-366203.pdf, 2013.

[6]

EMC XtreamCache. http://www.emc.com/storage/xtrem/xtremcache.htm, 2014.

[7]

C. Albrecht, A. Merchant, M. Stokely, M. Waliji, F. Labelle, N. Coehlo, X. Shi, and C. E. Schrock. Janus: Optimal flash provisioning for cloud storage workloads. In Proceedings of the 2013 USENIX Annual Technical Conference, pages 91-- 102, 2013.

Digital Library

[8]

R. Appuswamy, D. C. Van Moolenbroek, and A. S. Tanenbaum. Integrating flash-based ssds into the storage stack. In Mass Storage Systems and Technologies (MSST), 2012 IEEE 28th Symposium on, pages 1--12. IEEE, 2012.

[9]

D. Arteaga and M. Zhao. Client-side flash caching for cloud systems. In Proceedings of International Conference on Systems and Storage, pages 1--11. ACM, 2014.

Digital Library

[10]

D. Arteaga, D. Otstott, and M. Zhao. Dynamic block-level cache management for cloud. In Proceedings of the 10th USENIX Conference on File and Storage Technologies, 2012.

[11]

J. Axboe. Flexible I/O Tester Github. https://github.com/axboe/fio.

[12]

S. Byan, J. Lentini, A. Madan, L. Pabon, M. Condict, J. Kimmel, S. Kleiman, C. Small, and M. Storer. Mercury: Host-side flash caching for the data center. In Proceedings of the 28th Symposium on Mass Storage Systems and Technologies, pages 1--12, 2012.

[13]

M. Canim, G. A. Mihaila, B. Bhattacharjee, K. A. Ross, and C. A. Lang. SSD bufferpool extensions for database systems. Proceedings of the VLDB Endowment, 3:1435--1446, 2010.

Digital Library

[14]

J. Do, D. Zhang, J. M. Patel, D. J. DeWitt, J. F. Naughton, and A. Halverson. Turbocharging DBMS buffer pool using ssds. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, pages 1113--1124, 2011.

Digital Library

[15]

EMC. VNX Fast Cache: A Detailed Review. http://www.emc.com/collateral/software/whitepapers/h8046-clariion-celerra-unified-fast-cache-wp.pdf, 2013.

[16]

D. A. Holland, E. Angelino, G. Wald, and M. I. Seltzer. Flash caching on the storage client. In Proceedings of the 2013 USENIX Conference on Annual Technical Conference, pages 127--138, 2013.

Digital Library

[17]

S. Huang, Q. Wei, J. Chen, C. Chen, and D. Feng. Improving flash-based disk cache with lazy adaptive replacement. In In Proceedings of 29th Symposium on Mass Storage Systems and Technologies, pages 1--10, 2013.

[18]

Intel. Intel RAID: SSD Cache with FastPath* I/O. http://www.intel.com/content/www/us/en/servers/raid/raidssd-cache.html, 2010.

[19]

D. Jiang, Y. Che, J. Xiong, and X. Ma. uCache: A utilityaware multilevel ssd cache management policy. In Proceedings of the the 15th IEEE International Conference on High Performance Computing and Communications, 2013.

[20]

S. Jiang and X. Zhang. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. SIGMETRICS Performance Evaluation Review, 30 (1):31--42, 2002.

Digital Library

[21]

W.-H. Kang, S.-W. Lee, and B. Moon. Flash-based extended cache for higher throughput and faster recovery. Proceedings of the VLDB Endowment, 5:1615--1626, 2012.

Digital Library

[22]

H. Kim and S. Ahn. BPLRU: A buffer management scheme for improving random writes in flash storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies, pages 1--14, 2008.

Digital Library

[23]

H. Kim, M. Ryu, and U. Ramachandran. What is a good buffer cache replacement scheme for mobile flash storage? In Proceedings of the 12th ACM International Conference on Measurement and Modeling of Computer Systems, pages 235-- 246, 2012.

Digital Library

[24]

M. Kirkland. Flashcache at Facebook: From 2010 to 2013 and beyond. Facebook Engineering Blog. https://www.facebook.com/notes/facebookengineering/flashcache-at-facebook-from-2010-to-2013-and-beyond/10151725297413920.

[25]

R. Koller, L. Marmol, R. Rangaswami, S. Sundararaman, N. Talagala, and M. Zhao. Write policies for host-side flash caches. In Proceedings of the the 11th USENIX Conference on File and Storage Technologies, 2013.

Digital Library

[26]

T. Luo, S. Ma, R. Lee, X. Zhang, D. Liu, and L. Zhou. SCAVE: Effective ssd caching to improve virtual machine storage performance. In Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques, pages 103--112, 2013.

Digital Library

[27]

Y. Lv, B. Cui, B. He, and X. Chen. Operation-aware buffer management in flash-based systems. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data, pages 13--24, 2011.

Digital Library

[28]

R. L. Mattson, J. Gecsei, D. R. Slutz, and I. L. Traiger. Evaluation techniques for storage hierarchies. IBM Systems Journal, 9:78--117, 1970.

Digital Library

[29]

Oracle. Oracle Database Smart Flash Cache. http://www.oracle.com/technetwork/articles/systemshardware-architecture/oracle-db-smart-flash-cache-175588.pdf, 2010.

[30]

T. Pritchett and M. Thottethodi. SieveStore: a highly-selective, ensemble-level disk cache for cost-performance. In Proceedings of the 37th Annual International Symposium on Computer Architecture, pages 163--174, 2010.

Digital Library

[31]

M. Saxena, M. M. Swift, and Y. Zhang. FlashTier: a lightweight, consistent and durable storage cache. In Proceedings of the 7th ACM European Conference on Computer Systems, pages 267--280, 2012.

Digital Library

[32]

S. Shapiro. Flash cache best practices guide. Technical Report TR-3832, NetApp, 2013.

[33]

L. Tang, Q. Huang, W. Lloyd, S. Kumar, and K. Li. RIPQ: advanced photo caching on flash for facebook. In 13th USENIX Conference on File and Storage Technologies (FAST 15), pages 373--386, 2015.

Digital Library

[34]

J. Yang, N. Plasson, G. Gillis, and N. Talagala. HEC: improving endurance of high performance flash-based cache devices. In Proceedings of the 6th International Systems and Storage Conference, page 10. ACM, 2013.

Digital Library

[35]

Y. Zhou, J. Philbin, and K. Li. The multi-queue replacement algorithm for second level buffer caches. In Proceedings of the 2002 USENIX Annual Technical Conference, pages 91-- 104, 2001.

Digital Library

Cited By

Ha JLee SYeom HSon YBagchi SZhang Y(2024)RL-watchdogProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692058(1083-1100)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692058
Yi SSun SPeng LSun YYang MCao ZLi QJung MZhou KZhang JWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)BIZA: Design of Self-Governing Block-Interface ZNS AFA for Endurance and PerformanceProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695953(313-329)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695953
Liu KWu KWang HZhou KWang PZhang JLi C(2024)SLAP: Segmented Reuse-Time-Label Based Admission Policy for Content Delivery Network CachingACM Transactions on Architecture and Code Optimization10.1145/364655021:2(1-24)Online publication date: 9-Feb-2024
https://dl.acm.org/doi/10.1145/3646550
Show More Cited By

Index Terms

S-RAC: SSD Friendly Caching for Data Center Workloads
1. Information systems
  1. Information storage systems
    1. Storage management
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        File systems management
        Memory management

Recommendations

A high-performance and endurable SSD cache for parity-based RAID

Solid-state drives (SSDs) have been widely used as caching tier for disk-based RAID systems to speed up data-intensive applications. However, traditional cache schemes fail to effectively boost the parity-based RAID storage systems (e.g., RAID-5/6), ...
Bypassing method for STT-RAM based inclusive last-level cache
RACS '15: Proceedings of the 2015 Conference on research in adaptive and convergent systems

Non-volatile memories (NVMs), such as STT-RAM and PCM, have recently become very competitive designs for last-level caches (LLCs). To avoid cache pollution caused by unnecessary write operations, many cache-bypassing methods have been introduced. Among ...
Using solid state drives as a mid-tier cache in enterprise database OLTP applications
TPCTC'10: Proceedings of the Second TPC technology conference on Performance evaluation, measurement and characterization of complex systems

When originally introduced, flash based solid state drives (SSD) exhibited a very high random read throughput with low sub-millisecond latencies. However, in addition to their steep prices, SSDs suffered from slow write rates and reliability concerns ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SYSTOR '16: Proceedings of the 9th ACM International on Systems and Storage Conference

June 2016

191 pages

ISBN:9781450343817

DOI:10.1145/2928275

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Technion: Israel Institute of Technology
SIGOPS: ACM Special Interest Group on Operating Systems
USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SYSTOR '16

Sponsor:

Technion
SIGOPS
USENIX Assoc

SYSTOR '16: International Conference on Systems and Storage

June 6 - 8, 2016

Haifa, Israel

Acceptance Rates

SYSTOR '16 Paper Acceptance Rate 16 of 49 submissions, 33%;

Overall Acceptance Rate 108 of 323 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
532
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ha JLee SYeom HSon YBagchi SZhang Y(2024)RL-watchdogProceedings of the 2024 USENIX Conference on Usenix Annual Technical Conference10.5555/3691992.3692058(1083-1100)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691992.3692058
Yi SSun SPeng LSun YYang MCao ZLi QJung MZhou KZhang JWitchel EArpaci-Dusseau ARossbach CKeeton K(2024)BIZA: Design of Self-Governing Block-Interface ZNS AFA for Endurance and PerformanceProceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles10.1145/3694715.3695953(313-329)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3694715.3695953
Liu KWu KWang HZhou KWang PZhang JLi C(2024)SLAP: Segmented Reuse-Time-Label Based Admission Policy for Content Delivery Network CachingACM Transactions on Architecture and Code Optimization10.1145/364655021:2(1-24)Online publication date: 9-Feb-2024
https://dl.acm.org/doi/10.1145/3646550
Liu KWu KWang HZhou KZhang JLi C(2023)SLAP: An Adaptive, Learned Admission Policy for Content Delivery Network Caching2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS54959.2023.00053(457-467)Online publication date: May-2023
https://doi.org/10.1109/IPDPS54959.2023.00053
Choi WUrgaonkar BKandemir MKesidis GBellavista PZhang KGherbi ABagchi SPatiño MDi Modica GGascon-Samson J(2022)Multi-resource fair allocation for consolidated flash-based caching systemsProceedings of the 23rd ACM/IFIP International Middleware Conference10.1145/3528535.3565245(202-215)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3528535.3565245
Ebrahimi SSalkhordeh ROsia STaheri ARabiee HAsadi H(2022) RC-RNN: R econfigurable C ache Architecture for Storage Systems Using R ecurrent N eural N etworks IEEE Transactions on Emerging Topics in Computing10.1109/TETC.2021.310204110:3(1492-1506)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TETC.2021.3102041
Wang QLi JXia WKruus EDebnath BLee PGavrilovska AZadok E(2020)Austere flash caching with deduplication and compressionProceedings of the 2020 USENIX Conference on Usenix Annual Technical Conference10.5555/3489146.3489195(713-726)Online publication date: 15-Jul-2020
https://dl.acm.org/doi/10.5555/3489146.3489195
Hadizadeh MCheshmikhani EAsadi H(2020)STAIR: High Reliable STT-MRAM Aware Multi-Level I/O Cache Architecture by Adaptive ECC Allocation2020 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE48585.2020.9116550(1484-1489)Online publication date: Mar-2020
https://doi.org/10.23919/DATE48585.2020.9116550
Zhou KZhang YHuang PWang HJi YCheng BLiu Y(2020)Efficient SSD Cache for Cloud Block Storage via Leveraging Block Reuse DistancesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.299407531:11(2496-2509)Online publication date: 1-Nov-2020
https://doi.org/10.1109/TPDS.2020.2994075
Choi WUrgaonkar BKandemir MJung MYadgar GNoh S(2019)Fair resource allocation in consolidated flash systemsProceedings of the 11th USENIX Conference on Hot Topics in Storage and File Systems10.5555/3357062.3357091(22-22)Online publication date: 8-Jul-2019
https://dl.acm.org/doi/10.5555/3357062.3357091
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten