research-article

Dynamic Memory Partitioning for Cloud Caches with Heterogeneous Backends

Authors:

Cristina L. Abad,

Andres G. Abad,

Luis E. LucioAuthors Info & Claims

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

Pages 87 - 90

https://doi.org/10.1145/3030207.3030237

Published: 17 April 2017 Publication History

Get Access

Abstract

Software caches, implemented with in-memory key-value stores, are important components of cloud architectures. In a common scenario, one server may serve requests from several applications with different workloads, each supported by a different backend (database or storage system); these applications compete for an allocation of the total memory. We present a model for dynamic memory partitioning for cloud caches with heterogeneous backends. Our work differs from recent work for cloud caches in that we consider: (1) the effect of having backends with different performance profiles, and (2) the cost of re-partitioning the memory. We discuss implementation issues that must be addressed, including the need for on-line and lightweight mechanisms for estimating the miss rate curves (MRCs) and ways to solve the non-convex optimization problem; specifically, we propose a probabilistic adaptive search algorithm that can be used for discontinuous, non-differentiable, or non-convex MRCs.

References

[1]

Beckmann and Sanchez. Talus: A simple way to remove cliffs in cache performance. In HPCA, 2015.

Google Scholar

[2]

Cidon, Eisenman, Alizadeh, and Katti. Dynacache: Dynamic cloud caching. In HotCloud, 2015.

Digital Library

Google Scholar

[3]

Cidon, Eisenman, et al. Cliffhanger: Scaling perfor- mance cliffs in web memory caches. In NSDI, 2016.

Digital Library

Google Scholar

[4]

Hu, Wang, Zhou, Luo, et al. Kinetic modeling of data eviction in cache. In Usenix ATC, 2016.

Digital Library

Google Scholar

[5]

Pu, Li, Zaharia, Ghodsi, and Stoica. Fairride: Near-optimal, fair cache sharing. In NSDI, 2016.

Digital Library

Google Scholar

[6]

Singla, Chandrasekaran, Godfrey, and Maggs. The Internet at the speed of light. In HotNets, 2014.

Digital Library

Google Scholar

[7]

Stefanovici, Thereska, O'Shea, Schroeder, et al. Software-defined caching: Managing caches in multi-tenant data centers. In SOCC, 2015.

Digital Library

Google Scholar

[8]

Thompson et al. Disruptor: High performance alternative to bounded queues for exchanging data between concurrent threads. LMAX Tech. Rep., 2011.

Google Scholar

[9]

Waldspurger, Park, Garthwaite, and Ahmad. Efficient MRC construction with SHARDS. In Usenix FAST, 2015.

Digital Library

Google Scholar

[10]

Wires, Ingram, Drudi, et al. Characterizing storage workloads with counter stacks. In OSDI, 2014.

Digital Library

Google Scholar

Cited By

View all

Boza EAndrade XCedeno JMurillo JAragon HAbad CAbad A(2020)On Implementing Autonomic Systems with a Serverless Computing Approach: The Case of Self-Partitioning Cloud CachesComputers10.3390/computers90100149:1(14)Online publication date: 26-Feb-2020
https://doi.org/10.3390/computers9010014
Andrade XCedeno JBoza EAragon HAbad CMurillo J(2019)Optimizing Cloud Caches For Free: A Case for Autonomic Systems with a Serverless Computing Approach2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2019.00044(140-145)Online publication date: Jun-2019
https://doi.org/10.1109/FAS-W.2019.00044
Berger DBerg BZhu THarchol-Balter MSen SArpaci-Dusseau AVoelker G(2018)RobinHoodProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291183(195-212)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291183
Show More Cited By

Index Terms

Dynamic Memory Partitioning for Cloud Caches with Heterogeneous Backends
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Cloud computing
2. General and reference
  1. Cross-computing tools and techniques
    1. Performance

Recommendations

Dynamic Performance Profiling of Cloud Caches
SOCC '14: Proceedings of the ACM Symposium on Cloud Computing

Large-scale in-memory object caches such as memcached are widely used to accelerate popular web sites and to reduce burden on backend databases. Yet current cache systems give cache operators limited information on what resources are required to ...
A reusability-aware cache memory sharing technique for high-performance low-power CMPs with private L2 caches
ISLPED '07: Proceedings of the 2007 international symposium on Low power electronics and design

Chip multiprocessors (CMPs) emerge as a dominant architectural alternative in high-end embedded systems. Since off-chip accesses require a long latency and consume a large amount of power, CMPs are typically based on multiple levels of on-chip cache ...
Search lookaside buffer: efficient caching for index data structures
SoCC '17: Proceedings of the 2017 Symposium on Cloud Computing

With the ever increasing DRAM capacity in commodity computers, applications tend to store large amount of data in main memory for fast access. Accordingly, efficient traversal of index structures to locate requested data becomes crucial to their ...

Comments

Information & Contributors

Information

Published In

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

April 2017

450 pages

ISBN:9781450344043

DOI:10.1145/3030207

General Chairs:
Walter Binder
Università della Svizzera Italiana, Switzerland
,
Vittorio Cortellessa
Università dell'Aquila, Italy
,
Program Chairs:
Anne Koziolek
Karlsruhe Institute of Technology, Germany
,
Evgenia Smirni
College of William & Mary, USA
,
Meikel Poess
Oracle Corporation, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Google

Conference

ICPE '17

Sponsor:

ICPE '17: ACM/SPEC International Conference on Performance Engineering

April 22 - 26, 2017

L'Aquila, Italy

Acceptance Rates

ICPE '17 Paper Acceptance Rate 27 of 83 submissions, 33%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Boza EAndrade XCedeno JMurillo JAragon HAbad CAbad A(2020)On Implementing Autonomic Systems with a Serverless Computing Approach: The Case of Self-Partitioning Cloud CachesComputers10.3390/computers90100149:1(14)Online publication date: 26-Feb-2020
https://doi.org/10.3390/computers9010014
Andrade XCedeno JBoza EAragon HAbad CMurillo J(2019)Optimizing Cloud Caches For Free: A Case for Autonomic Systems with a Serverless Computing Approach2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W)10.1109/FAS-W.2019.00044(140-145)Online publication date: Jun-2019
https://doi.org/10.1109/FAS-W.2019.00044
Berger DBerg BZhu THarchol-Balter MSen SArpaci-Dusseau AVoelker G(2018)RobinHoodProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291183(195-212)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.5555/3291168.3291183
Byrne DOnder NWang Z(2018)mPart: miss-ratio curve guided partitioning in key-value storesACM SIGPLAN Notices10.1145/3299706.321057153:5(84-95)Online publication date: 18-Jun-2018
https://dl.acm.org/doi/10.1145/3299706.3210571
Byrne DOnder NWang ZPayer HSartor J(2018)mPart: miss-ratio curve guided partitioning in key-value storesProceedings of the 2018 ACM SIGPLAN International Symposium on Memory Management10.1145/3210563.3210571(84-95)Online publication date: 18-Jun-2018
https://dl.acm.org/doi/10.1145/3210563.3210571
Murillo JTotoy GAbad CDubey AGarcía-Valls M(2017)Instrumenting cloud caches for online workload monitoringProceedings of the 16th Workshop on Adaptive and Reflective Middleware10.1145/3152881.3152884(1-6)Online publication date: 11-Dec-2017
https://dl.acm.org/doi/10.1145/3152881.3152884
Mendieta MMartin CAbad C(2017)A control theory approach for managing cloud computing resources: A proof-of-concept on memory partitioning2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM)10.1109/ETCM.2017.8247502(1-6)Online publication date: Oct-2017
https://doi.org/10.1109/ETCM.2017.8247502

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Cited By

Index Terms

Recommendations

Dynamic Performance Profiling of Cloud Caches

A reusability-aware cache memory sharing technique for high-performance low-power CMPs with private L2 caches

Search lookaside buffer: efficient caching for index data structures