research-article

A Tool Supporting the Analytical Evaluation of Service Level Agreements

Authors:

Peter Buchholz,

Johannes MayAuthors Info & Claims

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

Pages 233 - 244

https://doi.org/10.1145/3030207.3030215

Published: 17 April 2017 Publication History

Abstract

Quantitative aspects of modern IT systems are often specified by service level agreements (SLAs) which relate the maximal load of a system with guaranteed bounds for response times and delays. These quantities are specified for single services which are combined in a service oriented architecture (SOA) to composed services offered to potential users or other service providers. To derive SLAs for composed services and to plan the required capacity to guarantee SLAs, appropriate methods and tools have to be used that compute results based on information given in SLAs. In this paper it is argued that most available approaches are not sufficient to analyze systems based on SLA information. A new method and a tool are presented that support the efficient calculation of bounds for delays in composed systems based on bounds for the load and the delay of the individual components which are specified in the SLAs of the components. Furthermore, the presented tool can be used to generate bounds for the required processing capacity which a provider has to provide in order to guarantee the quality of service defined in the SLAs.

The presented approach is in some sense a counterpart to mean value analysis for queueing networks but rather than mean values, worst case bounds for different quantities like response times or departure processes are computed. Analysis is based on min/+ algebra but the mathematical approach is hidden from the user by a graphical interface allowing a simple graphical specification and result representation for networks of composed services.

References

[1]

Danilo Ardagna, Giuliano Casale, Michele Ciavotta, Juan F. Pérez, and Weikun Wang. Quality-of-service in cloud computing: modeling techniques and their applications. J. Internet Services and Applications, 5(1), 2014.

[2]

Marco Bertoli, Giuliano Casale, and Giuseppe Serazzi. JMT: performance engineering tools for system modeling. SIGMETRICS Perform. Eval. Rev., 36(4):10--15, 2009.

Digital Library

[3]

Steffen Bondorf and Jens B. Schmitt. The DiscoDNC v2 - A comprehensive tool for deterministic network calculus. In 8th International Conference on Performance Evaluation Methodologies and Tools, VALUETOOLS 2014, Bratislava, Slovakia, December 9-11, 2014, 2014.

[4]

Jean-Yves Le Boudec and Patrick Thiran. Network Calculus: A Theory of Deterministic Queuing Systems for the Internet, volume 2050 of Lecture Notes in Computer Science. Springer, 2001.

[5]

Anne Bouillard and Eric Thierry. An algorithmic toolbox for network calculus. Discrete Event Dynamic Systems, 18(1):3--49, 2008.

Digital Library

[6]

Peter Buchholz and Sebastian Vastag. An introduction to SLA calculus for the analytical validation of SLAs. Technical report, Informatik 4, TU Dortmund, 2015. http://ls4-www.cs.tu-dortmund.de/download/buchholz/sla.pdf.

[7]

Peter Buchholz and Sebastian Vastag. Towards an analytical method for SLA validation. submitted for publication, 2016.

[8]

G. Cohen, S. Gaubert, and J.-P. Quadrat. Maxplus algebra in Scilab and applications. In Scilab Workshop, 2001.

[9]

Rene L. Cruz. A calculus for network delay, part I: network elements in isolation. IEEE Transactions on Information Theory, 37(1):114--131, 1991.

Digital Library

[10]

Rene L. Cruz. A calculus for network delay, part II: network analysis. IEEE Transactions on Information Theory, 37(1):132--141, 1991.

Digital Library

[11]

Heiko Koziolek. Performance evaluation of component-based software systems: A survey. Perform. Eval., 67(8):634--658, 2010.

Digital Library

[12]

S. Kunzli, F. Poletti, L. Benini, and L. Thiele. Combining simulation and formal methods for system-level performance analysis. In Proceedings of the Design Automation Test in Europe Conference, volume 1, pages 1--6, March 2006.

[13]

Dimosthenis Kyriazis, editor. Cloud Computing Service Level Agreements. European Commission, 2013.

[14]

Johannes Lüthi and Günter Haring. Mean value analysis for queueing network models with intervals as input parameters. Perform. Eval., 32(3):185--215, 1998.

Digital Library

[15]

Daniel A. Menascé. Composing Web services: A QoS view. IEEE Internet Computing, 8(6):88--90, 2004.

Digital Library

[16]

Daniel A. Menascé. Mapping service-level agreements in distributed applications. IEEE Internet Computing, 8(5):100--102, 2004.

Digital Library

[17]

Daniel A. Menasce and Virgilio A. F. Almeida. Capacity Planning for Web Services: metrics, models, and methods. Prentice Hall, 2001.

[18]

Jaroslaw Stanczyk, Eckart Mayer, and Jörg Raisch. Modelling and performance evaluation of DES - A max-plus algebra toolbox for Matlab. In ICINCO 2004, Proceedings of the First International Conference on Informatics in Control, Automation and Robotics, Setúbal, Portugal, August 25-28, 2004, pages 270--275, 2004.

[19]

David Starobinski, Mark G. Karpovsky, and Lev Zakrevski. Application of network calculus to general topologies using turn-prohibition. IEEE/ACM Trans. Netw., 11(3):411--421, 2003.

Digital Library

[20]

Lothar Thiele, Samarjit Chakraborty, and Martin Naedele. Real-time calculus for scheduling hard real-time systems. In Proceedings. ISCAS 2000, pages 100--104, 2000.

[21]

Mirco Tribastone, Philip Mayer, and Martin Wirsing. Performance prediction of service-oriented systems with layered queueing networks. In Leveraging Applications of Formal Methods, Verification, and Validation - 4th International Symposium on Leveraging Applications, ISoLA 2010, Heraklion, Crete, Greece, October 18-21, 2010, Proceedings, Part II, pages 51--65, 2010.

[22]

Jos J. M. Trienekens, Jacques J. Bouman, and Mark van der Zwan. Specification of service level agreements: Problems, principles and practices. Software Quality Journal, 12(1):43--57, 2004.

Digital Library

[23]

Sebastian Vastag. A calculus for SLA delay properties. In Measurement, Modelling, and Evaluation of Computing Systems and Dependability and Fault Tolerance - 16th International GI/ITG Conference, MMB & DFT 2012, Kaiserslautern, Germany, March 19-21, 2012. Proceedings, pages 76--90, 2012.

Digital Library

[24]

Sebastian Vastag. SLA Calculus. PhD thesis, Department of Computer Science, TU Dortmund, 2014.

[25]

Ernesto Wandeler. Modular Performance Analysis and Interface-Based Design for Embedded Real-TimeSystems. PhD thesis, ETH Zürich, 2006.

[26]

Ernesto Wandeler and Lothar Thiele. Real-Time Calculus (RTC) Toolbox. http://www.mpa.ethz.ch/Rtctoolbox, 2006.

Cited By

Awalurahman HHariyanti ECahyani ARahmi NMuhammad DRamadhan D(2023)State of the art in service level agreement implementation and standardization: A literature review4TH INTERNATIONAL SCIENTIFIC CONFERENCE OF ALKAFEEL UNIVERSITY (ISCKU 2022)10.1063/5.0181073(070002)Online publication date: 2023
https://doi.org/10.1063/5.0181073
Buchholz PVastag S(2018)Toward an analytical method for SLA validationSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0604-y17:2(527-545)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s10270-017-0604-y
Bause FBuchholz P(2018)SLA ToolMeasurement, Modelling and Evaluation of Computing Systems10.1007/978-3-319-74947-1_22(302-306)Online publication date: 25-Jan-2018
https://doi.org/10.1007/978-3-319-74947-1_22

Index Terms

A Tool Supporting the Analytical Evaluation of Service Level Agreements
1. General and reference
  1. Cross-computing tools and techniques
    1. Performance

Recommendations

Workflow composition of service level agreements for web services

Service-oriented architecture enables an environment where businesses can expose services for use by their collaborators and their peer organizations. In this dynamic environment, organizations require the use of service level agreements (SLAs) to assure ...
History Heuristic Based Negotiation of Service Level Agreements for Composite Service
QSIC '08: Proceedings of the 2008 The Eighth International Conference on Quality Software

In advanced service oriented systems, service provider usually provides value-added composite service to its consumer through compositing some other component service. Because composite service and component services are owned by different organizations ...
Negotiation of Service Level Agreements: An Architecture and a Search-Based Approach
ICSOC '07: Proceedings of the 5th international conference on Service-Oriented Computing

Software systems built by composing existing services are more and more capturing the interest of researchers and practitioners. The envisaged long term scenario is that services, offered by some competing providers, are chosen by some consumers and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

April 2017

450 pages

ISBN:9781450344043

DOI:10.1145/3030207

General Chairs:
Walter Binder
Università della Svizzera Italiana, Switzerland
,
Vittorio Cortellessa
Università dell'Aquila, Italy
,
Program Chairs:
Anne Koziolek
Karlsruhe Institute of Technology, Germany
,
Evgenia Smirni
College of William & Mary, USA
,
Meikel Poess
Oracle Corporation, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICPE '17

Sponsor:

ICPE '17: ACM/SPEC International Conference on Performance Engineering

April 22 - 26, 2017

L'Aquila, Italy

Acceptance Rates

ICPE '17 Paper Acceptance Rate 27 of 83 submissions, 33%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
126
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Awalurahman HHariyanti ECahyani ARahmi NMuhammad DRamadhan D(2023)State of the art in service level agreement implementation and standardization: A literature review4TH INTERNATIONAL SCIENTIFIC CONFERENCE OF ALKAFEEL UNIVERSITY (ISCKU 2022)10.1063/5.0181073(070002)Online publication date: 2023
https://doi.org/10.1063/5.0181073
Buchholz PVastag S(2018)Toward an analytical method for SLA validationSoftware and Systems Modeling (SoSyM)10.1007/s10270-017-0604-y17:2(527-545)Online publication date: 1-May-2018
https://dl.acm.org/doi/10.1007/s10270-017-0604-y
Bause FBuchholz P(2018)SLA ToolMeasurement, Modelling and Evaluation of Computing Systems10.1007/978-3-319-74947-1_22(302-306)Online publication date: 25-Jan-2018
https://doi.org/10.1007/978-3-319-74947-1_22

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten