skip to main content
10.1145/2304696.2304715acmconferencesArticle/Chapter ViewAbstractPublication PagescomparchConference Proceedingsconference-collections
research-article

Improving performance predictions by accounting for the accuracy of composed performance models

Published: 25 June 2012 Publication History

Abstract

Performance predictions on the software architecture level support the design and evaluation of component-based systems. Composable and parameterized models are used in current prediction approaches for reasoning. The actual model for an influencing factor or component of the system is the result of a trade-off between the required accuracy, prediction speed, and validation effort. Different models can have different accuracies and the overall effect on the prediction depends on their composition and used parameter values. Existing prediction approaches neglect to take into account this potentially difference in the accuracies of models. In this paper, we present an approach in which accuracy statements attached to composable performance models allow analyzing their influence on predictions without adding restrictions on the compositionality of each model. The resulting support for risk mitigation in decision making, prediction quality evaluation, as well as inaccuracy effect propagation from parts of the analyzed system on the overall prediction results are evaluated on a case study.

References

[1]
UML Profile for MARTE: Modeling and Analysis of Real-Time Embedded Systems. http://www.omg.org/spec/MARTE/1.0, Nov 2009.
[2]
F. Bause. Queueing petri nets-a formalism for the combined qualitative and quantitative analysis of systems. Petri Nets and Performance Models, pages 14--23, Oct 1993.
[3]
S. Becker. Coupled model transformations for QoS enabled component-based software design. PhD thesis, Universitat Oldenburg, 2008.
[4]
S. Becker, A. Brogi, I. Gorton, S. Overhage, A. Romanovsky, and M. Tivoli. Towards an Engineering Approach to Component Adaptation. In Architecting Systems with Trustworthy Components, volume 3938 of LNCS, pages 193--215. Springer, 2006.
[5]
S. Becker, L. Grunske, R. Mirandola, and S. Overhage. Performance Prediction of Component-Based Systems: A Survey from an Engineering Perspective. In R. Reussner, J. Stafford, and C. Szyperski, editors, Architecting Systems with Trustworthy Components, volume 3938, pages 169--192. Springer, 2006.
[6]
H. Groenda. Palladio transformations for Accuracy Influence Analyses (Anonymous SVN Access). https://svnserver.informatik.kit.edu/i43/svn/code/Palladio.Accuracy/trunk/de.fzi.se.accuracy.
[7]
H. Groenda. Usage profile and platform independent automated validation of service behavior specifications. QUASOSS '10, pages 6:1--6:6, New York, NY, USA, 2010. ACM.
[8]
H. Groenda. An Accuracy Information Annotation Model for Validated Service Behavior Specifications. In J. Dingel and A. Solberg, editors, Models in Software Engineering, volume 6627 of LNCS, pages 369--383. Springer Berlin / Heidelberg, 2011.
[9]
D. Hamlet. Retracted and replaced: Software component composition: a subdomain-based testing foundation. Software Testing, Verification and Reliability, 17(4):243--269, 2007.
[10]
T. Harmon and R. Klefstad. A survey of worst-case execution time analysis for real-time java. In IEEE Parallel and Distributed Processing Symposium, pages 1--8, March 2007.
[11]
K. Jensen. Coloured petri nets. In W. Brauer, W. Reisig, and G. Rozenberg, editors, Petri Nets: Central Models and Their Properties, volume 254 of LNCS, pages 248--299. Springer, 1987.
[12]
B. Klatt, C. Rathfelder, and S. Kounev. Integration of Event-Based Communication in the Palladio Software Quality Prediction Framework. In QoSA 2011, Boulder, Colorado, USA, June 20--24 2011.
[13]
H. Koziolek. Parameter dependencies for reusable performance specifications of software components. PhD thesis, Universitat Oldenburg, 2008.
[14]
H. Koziolek. Performance evaluation of component-based software systems: A survey. Elsevier Performance Evaluation, 67(8):634--658, August 2010.
[15]
A. Martens, S. Becker, H. Koziolek, and R. Reussner. An Empirical Investigation of the Applicability of a Component-Based Performance Prediction Method. In EPEW'08, volume 5261, pages 17--31, 2008.
[16]
A. Martens, H. Koziolek, L. Prechelt, and R. Reussner. From monolithic to component-based performance evaluation of software architectures. Empirical Software Engineering, pages 1--36, 2010.
[17]
D. A. Menasce and V. Almeida. Capacity Planning for Web Services: Metrics, Models, and Methods., chapter 3.1: Basic Performance Concepts: Service times at Single Disks and Disk Arrays, pages 72--90. Prentice Hall PTR, Upper Saddle River, NJ, USA, 2001.
[18]
R. Reussner, S. Becker, E. Burger, J. Happe, M. Hauck, A. Koziolek, H. Koziolek, K. Krogmann, and M. Kuperberg. The Palladio Component Model. Technical report, Fakultat für Informatik, IPD, 2011.
[19]
J. A. Rolia and K. C. Sevcik. The Method of Layers. IEEE TSE, 21(8):689--700, 1995.
[20]
A. Satelli, M. Rooto, T. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and S.Tarantola. Global Sensitivity Analysis. The Primer. John Wiley & Sons, Ltd, 2008.
[21]
D. Viswanathan and S. Liang. Java virtual machine profiler interface. IBM Systems Journal, 39(1):82 --95, 2000.

Cited By

View all
  • (2023)A Large-Scale Empirical Study of Real-Life Performance Issues in Open Source ProjectsIEEE Transactions on Software Engineering10.1109/TSE.2022.316762849:2(924-946)Online publication date: 1-Feb-2023
  • (2018)Model-driven performance prediction of systems of systemsSoftware and Systems Modeling (SoSyM)10.1007/s10270-016-0547-817:2(415-441)Online publication date: 1-May-2018
  • (2014)A Model-Driven Engineering Method for DRE Defense Systems Performance Analysis and PredictionHandbook of Research on Embedded Systems Design10.4018/978-1-4666-6194-3.ch012(301-326)Online publication date: 2014
  • Show More Cited By

Index Terms

  1. Improving performance predictions by accounting for the accuracy of composed performance models

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    QoSA '12: Proceedings of the 8th international ACM SIGSOFT conference on Quality of Software Architectures
    June 2012
    164 pages
    ISBN:9781450313469
    DOI:10.1145/2304696
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 June 2012

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. model development
    2. software architectures

    Qualifiers

    • Research-article

    Conference

    Comparch '12
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 46 of 131 submissions, 35%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 05 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)A Large-Scale Empirical Study of Real-Life Performance Issues in Open Source ProjectsIEEE Transactions on Software Engineering10.1109/TSE.2022.316762849:2(924-946)Online publication date: 1-Feb-2023
    • (2018)Model-driven performance prediction of systems of systemsSoftware and Systems Modeling (SoSyM)10.1007/s10270-016-0547-817:2(415-441)Online publication date: 1-May-2018
    • (2014)A Model-Driven Engineering Method for DRE Defense Systems Performance Analysis and PredictionHandbook of Research on Embedded Systems Design10.4018/978-1-4666-6194-3.ch012(301-326)Online publication date: 2014
    • (2014)Performance-based selection of software and hardware features under parameter uncertaintyProceedings of the 10th international ACM Sigsoft conference on Quality of software architectures10.1145/2602576.2602585(23-32)Online publication date: 27-Jun-2014
    • (2013)Model-based performance analysis of software architectures under uncertaintyProceedings of the 9th international ACM Sigsoft conference on Quality of software architectures10.1145/2465478.2465487(69-78)Online publication date: 17-Jun-2013

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media