Abstract
Assessing providable service levels based on model-driven prediction approaches requires valid service behavior specifications. Such specifications must be suitable for the requested usage profile and available hardware to make correct predictions and decisions on providable service levels. Assessing the precision of given parameterized performance specifications is often done manually in an ad-hoc way based on the experience of the performance engineer. In this paper, we show how the accuracy of a specification can be assessed and stated and how validation settings of model-based testing can ease precision assessments. The applicability of the approach is shown on a case study. We demonstrate how our approach allows accuracy statements and can be used in combination with usage profile and platform independent performance validations, as well as point out how accuracy assessments are eased.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Opensta website, http://www.opensta.org/
Pushtotest website, http://www.pushtotest.com/
Apache. Jmeter website, http://jakarta.apache.org/jmeter/
Bartolini, C., Bertolino, A., Marchetti, E., Polini, A.: Ws-taxi: A wsdl-based testing tool for web services. In: ICST 2009, pp. 326–335 (2009)
Becker, S., Grunske, L., Mirandola, R., Overhage, S.: Performance Prediction of Component-Based Systems – A Survey from an Engineering Perspective. In: Reussner, R., Stafford, J.A., Ren, X.-M. (eds.) Architecting Systems with Trustworthy Components. LNCS, vol. 3938, pp. 169–192. Springer, Heidelberg (2006)
Hamlet, D.: Retracted and replaced: Software component composition: a subdomain-based testing foundation. Software Testing, Verification and Reliability 17(4), 243–269 (2007)
Harmon, T., Klefstad, R.: A survey of worst-case execution time analysis for real-time java. In: IPDPS 2007, pp. 1–8 (March 2007)
Koziolek, H.: Parameter dependencies for reusable performance specifications of software components. PhD thesis, Universität Oldenburg (2008)
Krogmann, K., Kuperberg, M., Reussner, R.: Reverse Engineering of Parametric Behavioural Service Performance Models from Black-Box Components. In: MSI 2008, pp. 57–71. GITO Verlag (September 2008)
Krogmann, K., Kuperberg, M., Reussner, R.: Using Genetic Search for Reverse Engineering of Parametric Behaviour Models for Performance Prediction. In: IEEE TSE (2010) (accepted for publication, to appear)
Kuperberg, M.: FOBIC: A Platform-Independent Performance Metric based on Dynamic Java Bytecode Counts. In: Dependability Metrics Workshop 2008, pp. 7–11. Department of Computer Science, University of Mannheim (May 2009)
Kuperberg, M., Krogmann, M., Reussner, R.: ByCounter: Portable Runtime Counting of Bytecode Instructions and Method Invocations. In: Bytecode Workshop at ETAPS 2008 (2008)
Meyerhöfer, M.B.: Measurement and management of software components for performance prediction. PhD thesis, University of Erlangen (July 2007)
Michelsen, J.: Merging open source and testing strategies. junit and lisa: The perfect match. Technical report, Interactive TKO, Inc. (iTKO) (December 2007)
Object Management Group. UML Profile for Schedulability, Performance, and Time, v1.1 (January 2005), http://www.omg.org/cgi-bin/doc?formal/2005-01-02
Object Management Group. UML Profile for MARTE: Modeling and Analysis of Real-Time Embedded Systems (November 2009), http://www.omg.org/spec/MARTE/1.0
L.P. Hp loadrunner software data sheet. Technical Report 4AA1-2118ENW, Hewlett-Packard Development Company (November 2008)
Reussner, R., Becker, S., Happe, J., Koziolek, H., Krogmann, K., Kuperberg, M.: The palladio component model. Technical report, University of Karlsruhe (TH), Germany (May 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Groenda, H. (2011). An Accuracy Information Annotation Model for Validated Service Behavior Specifications. In: Dingel, J., Solberg, A. (eds) Models in Software Engineering. MODELS 2010. Lecture Notes in Computer Science, vol 6627. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21210-9_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-21210-9_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21209-3
Online ISBN: 978-3-642-21210-9
eBook Packages: Computer ScienceComputer Science (R0)