Elsevier

Science of Computer Programming

Volume 90, Part B, 15 September 2014, Pages 116-134
Science of Computer Programming

Metrics and techniques for quantifying performance isolation in cloud environments

https://doi.org/10.1016/j.scico.2013.08.003Get rights and content
Under an Elsevier user license
open archive

Highlights

  • Three basic metrics for quantifying performance isolation.

  • Decoupled from a concrete scenario and evaluated.

  • Round robin or blacklist scheduling for isolation on SaaS.

  • System provider or developer could use the isolation metrics.

  • Case study quantifying Xen's performance isolation capabilities.

Abstract

The cloud computing paradigm enables the provision of cost efficient IT-services by leveraging economies of scale and sharing data center resources efficiently among multiple independent applications and customers. However, the sharing of resources leads to possible interference between users and performance problems are one of the major obstacles for potential cloud customers. Consequently, it is one of the primary goals of cloud service providers to have different customers and their hosted applications isolated as much as possible in terms of the performance they observe. To make different offerings, comparable with regards to their performance isolation capabilities, a representative metric is needed to quantify the level of performance isolation in cloud environments. Such a metric should allow to measure externally by running benchmarks from the outside treating the cloud as a black box. In this article, we propose three different types of novel metrics for quantifying the performance isolation of cloud-based systems.

We consider four new approaches to achieve performance isolation in Software-as-a-Service (SaaS) offerings and evaluate them based on the proposed metrics as part of a simulation-based case study. To demonstrate the effectiveness and practical applicability of the proposed metrics for quantifying the performance isolation in various scenarios, we present a second case study evaluating performance isolation of the hypervisor Xen.

Keywords

Performance
Isolation
Metric
SaaS
Cloud
Multi-tenancy

Cited by (0)