skip to main content
10.1145/1712605.1712613acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
research-article

State dependence in performance evaluation of component-based software systems

Published: 28 January 2010 Publication History

Abstract

Integrating rising variability of software systems in performance prediction models is crucial to allow widespread industrial use of performance prediction. One of such variabilities is the dependency of system performance on the context and history-dependent internal state of the system (or its components). The questions that rise for current prediction models are (i) how to include the state properties in a prediction model, and (ii) how to balance the expressiveness and complexity of created models.
Only a few performance prediction approaches deal with modelling states in component-based systems. Currently, there is neither a consensus in the definition, nor in the method to include the state in prediction models. For these reasons, we have conducted a state-of-the-art survey of existing approaches addressing their expressiveness to model stateful components. Based on the results, we introduce a classification scheme and present the state-defining and state-dependent model parameters. We extend the Palladio Component Model (PCM), a model-based performance prediction approach, with state-modelling capabilities, and study the performance impact of modelled state. A practical influences of the internal state on software performance is evaluated on a realistic case study.

References

[1]
Java System Message Queue-Version 4.3. http://www.sun.com/software/products/message-queue/index.xml, last retrieved: July 2009.
[2]
R. Bagrodia and C. Shen. Midas: Integrated design and simulation of distributed systems. Transactions on Software Engineering, 1991.
[3]
S. Becker, J. Happe, and H. Koziolek. Putting Components into Context: Supporting QoS-Predictions with an explicit Context Model. In Proc. of Workshop on Component Oriented Programming (WCOP), 2006.
[4]
S. Becker, H. Koziolek, and R. Reussner. The palladio component model for model-driven performance prediction. Journal of Systems and Software, 2009.
[5]
A. Bertolino and R. Mirandola. Modeling and analysis of non-functional properties in component-based systems. Elsevier, 2003.
[6]
A. Bertolino and R. Mirandola. CB-SPE Tool: Putting Component-Based Performance Engineering into Practice. LNCS. Springer, 2004.
[7]
T. Bures, P. Hnetynka, and F. Plasil. Sofa 2.0: Balancing advanced features in a hierarchical component model. In Proc. of Conference on Software Engineering Research, Management and Applications (SERA). IEEE, 2006.
[8]
J. Cheesman and J. Daniels. UML Components: A Simple Process for Specifying Component-based Software. 2000.
[9]
S.P.E. Corp. SPECjms2007 Benchmark. http://www.spec.org/jms2007/, last visit: January, 2009, 2007.
[10]
A. Diaconescu and J. Murphy. Automating the performance management of component-based enterprise systems through the use of redundancy. In Proc. of Conference on Automated software engineering (ASE). IEEE, 2005.
[11]
D. Hamlet. Subdomain testing of units and systems with state. In Proc. of symposium on Software testing and analysis (ISSTA). ACM, 2006.
[12]
M. Hapner, R. Burridge, R. Sharma, J. Fialli, and K. Stout. Java Message Service Specification-Version 1.1. http://java.sun.com/products/jms/, last retrieved: January 2009.
[13]
J. Happe, S. Becker, C. Rathfelder, H. Friedrich, and R.H. Reussner. Parametric Performance Completions for Model-Driven Performance Prediction. Performance Evaluation, 2009.
[14]
S. Hissam, G. Moreno, J. Staord, and K. Wallnau. Enabling predictable assembly. Journal of Systems and Software, 2003.
[15]
H. Koziolek. Parameter Dependencies for Reusable Performance Specifications of Software Components. PhD thesis, University of Oldenburg, 2008.
[16]
H. Koziolek. Performance evaluation for component-based software systems: A survey. Submitted to Performance Evaluation (Special Issue on Software and Performance), 2009.
[17]
H. Koziolek and S. Becker. Transforming Operational Profiles of Software Components for Quality of Service Predictions. In Proc. of Workshop on Component Oriented Programming (WCOP), 2005.
[18]
H. Koziolek and J. Happe. A QoS Driven Development Process Model for Component-Based Software Systems. In Proc. of Symposium on Component-Based Software Engineering (CBSE). Springer, 2006.
[19]
Y. Liu, A. Fekete, and I. Gorton. Design-level performance prediction of component-based applications. Transactions on Software Engineering, 2005.
[20]
M. Meyerhöfer and K. Meyer-Wegener. Estimating non-functional properties of component-based software based on resource consumption. Electronic Notes in Theoretical Computer Science, 2005.
[21]
A. Mos and J. Murphy. Performance management in component-oriented systems using a model driven architecture approach. In Proc. of Enterprise Distributed Object Computing Conference. IEEE, 2002.
[22]
Object Management Group. MOF 2.0 Query/View/Transformation, version 1.0, 2008.
[23]
S. Sentilles, A. Vulgarakis, T. Bures, J. Carlson, and I. Crnković. A component model for control-intensive distributed embedded systems. In 11th International Symposium on Component-Based Software Engineering (CBSE). Springer, 2008.
[24]
C.U. Smith and L.G. Williams. New software performance antipatterns: More ways to shoot yourself in the foot. In Proc. of International CMG Conference. Computer Measurement Group, 2002.
[25]
C. Szyperski. Component Software -- Beyond Object-Oriented Programming. Addison-Wesley, 2002.
[26]
M. Woodside, G. Franks, and D.C. Petriu. The Future of Software Performance Engineering. In Proc. of Conference on Software Engineering (ICSE). IEEE, 2007.
[27]
B. Zimmerova. Modelling and Formal Analysis of Component-Based Systems in View of Component Interaction. PhD thesis, Masaryk University, Czech Republic, 2008.
[28]
B. Zimmerova et al. The Common Component Modeling Example: Comparing Software Component Models, chapter 7. LNCS. Springer, 2008.

Cited By

View all
  • (2015)Reconciling a component and process viewProceedings of the Seventh International Workshop on Modeling in Software Engineering10.5555/2820489.2820491(1-6)Online publication date: 16-May-2015
  • (2015)Reconciling a Component and Process ViewProceedings of the 2015 IEEE/ACM 7th International Workshop on Modeling in Software Engineering10.1109/MiSE.2015.8(1-6)Online publication date: 16-May-2015
  • (2015)Scalable and Fault-Tolerant Cloud ComputationsProceedings of the 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS.2015.57(396-404)Online publication date: 14-Dec-2015
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WOSP/SIPEW '10: Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering
January 2010
294 pages
ISBN:9781605585635
DOI:10.1145/1712605
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 January 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. design-time prediction
  2. performance
  3. state dependency

Qualifiers

  • Research-article

Conference

WOSP/SIPEW'10

Acceptance Rates

Overall Acceptance Rate 149 of 241 submissions, 62%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2015)Reconciling a component and process viewProceedings of the Seventh International Workshop on Modeling in Software Engineering10.5555/2820489.2820491(1-6)Online publication date: 16-May-2015
  • (2015)Reconciling a Component and Process ViewProceedings of the 2015 IEEE/ACM 7th International Workshop on Modeling in Software Engineering10.1109/MiSE.2015.8(1-6)Online publication date: 16-May-2015
  • (2015)Scalable and Fault-Tolerant Cloud ComputationsProceedings of the 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS.2015.57(396-404)Online publication date: 14-Dec-2015
  • (2014)Guilt-based handling of software performance antipatterns in palladio architectural modelsJournal of Systems and Software10.1016/j.jss.2014.03.08195(141-165)Online publication date: 1-Sep-2014
  • (2014)Stateful component-based performance modelsSoftware and Systems Modeling (SoSyM)10.1007/s10270-013-0336-613:4(1319-1343)Online publication date: 1-Oct-2014
  • (2012)Architecture-Based Reliability Prediction with the Palladio Component ModelIEEE Transactions on Software Engineering10.1109/TSE.2011.9438:6(1319-1339)Online publication date: 1-Nov-2012
  • (2011)Reusable QoS specifications for systematic component-based designProceedings of the 2nd ACM/SPEC International Conference on Performance engineering10.1145/1958746.1958805(415-416)Online publication date: 14-Mar-2011
  • (2011)Detection and solution of software performance antipatterns in palladio architectural modelsProceedings of the 2nd ACM/SPEC International Conference on Performance engineering10.1145/1958746.1958755(19-30)Online publication date: 14-Mar-2011
  • (2010)Application of advanced model-driven techniques in performance engineeringProceedings of the 7th European performance engineering conference on Computer performance engineering10.5555/1926981.1926984(17-36)Online publication date: 23-Sep-2010
  • (2010)Statistical inference of software performance models for parametric performance completionsProceedings of the 6th international conference on Quality of Software Architectures: research into Practice - Reality and Gaps10.1007/978-3-642-13821-8_4(20-35)Online publication date: 23-Jun-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media