Christian Vögele
Andre van Hoorn
ABSTRACT
Workload specifications are required in order to accurately evaluate performance properties of session-based application systems. These properties can be evaluated using measurement-based approaches such as load tests and model-based approaches, e.g., based on architecture-level performance models. Workload specifications for both approaches are created separately from each other which may result in different workload characteristics. To overcome this challenge, this paper extends our existing WESSBAS approach which defines a domain-specific language (WESSBAS-DSL) enabling the layered modeling and automatic extraction of workload specifications, as well as the transformation into load test scripts. In this paper, we extend WESSBAS by the capability of transforming WESSBAS-DSL instances into workload specifications of architecture-level performance models. The transformation demonstrates that the WESSBAS-DSL can be used as an intermediate language between system-specific workload specifications on the one side and the generation of required inputs for performance evaluation approaches on the other side. The evaluation using the standard industry benchmark SPECjEnterprise2010 shows that workload characteristics of the simulated workload match the measured workload with high accuracy.
- M. F. Arlitt, D. Krishnamurthy, and J. Rolia. Characterizing the scalability of a large web-based shopping system. ACM TOIT, 1(1):44--69, 2001. Google Scholar
Digital Library
- P. Barford and M. Crovella. Generating representative web workloads for network and server performance evaluation. In Proc. SIGMETRICS '98, pages 151--160, 1998. Google ScholarDigital Library
- S. Becker, H. Koziolek, and R. Reussner. The Palladio component model for model-driven performance prediction. Journal of Systems and Software, 82(1):3--22, 2009. Google ScholarDigital Library
- F. Brosig, N. Huber, and S. Kounev. Automated extraction of architecture-level performance models of distributed component-based systems. In Proc. ASE '11, pages 183--192, 2011. Google ScholarDigital Library
- A. Brunnert, C. Vögele, and H. Krcmar. Automatic performance model generation for java enterprise edition (EE) applications. In Proc. EPEW '13, pages 74--88. Springer, 2013.Google ScholarCross Ref
- A. Ciancone, A. Filieri, M. Drago, R. Mirandola, and V. Grassi. Klapersuite: An integrated model-driven environment for reliability and performance analysis of component-based systems. In Proc. Tools '11, pages 99--114. Springer, 2011. Google ScholarDigital Library
- S. Kounev, F. Brosig, and N. Huber. The Descartes Modeling Language. Technical report, Department of Computer Science, University of Wuerzburg, 2014.Google Scholar
- H. Koziolek. Performance evaluation of component-based software systems: A survey. Performance Evaluation, 67(8):634--658, 2010. Google ScholarDigital Library
- D. Krishnamurthy, J. A. Rolia, and S. Majumdar. A synthetic workload generation technique for stress testing session-based systems. IEEE TSE, 32(11):868--882, 2006. Google ScholarDigital Library
- D. A. Menascé, V. A. F. Almeida, R. Fonseca, and M. A. Mendes. A methodology for workload characterization of e-commerce sites. In Proc. EC '99, pages 119--128, 1999. Google ScholarDigital Library
- C. U. Smith. Introduction to software performance engineering: origins and outstanding problems. In Proc. SFM '07, pages 395--428, 2007. Google ScholarDigital Library
- A. van Hoorn, M. Rohr, and W. Hasselbring. Generating probabilistic and intensity-varying workload for Web-based software systems. In Proc. SIPEW '08, pages 124--143, 2008. Google ScholarDigital Library
- A. van Hoorn, C. Vögele, E. Schulz, W. Hasselbring, and H. Krcmar. Automatic extraction of probabilistic workload specifications for load testing session-based application systems. In Proc. VALUETOOLS, 2014.Google Scholar
- C. Vögele, A. Brunnert, A. Danciu, D. Tertilt, and H. Krcmar. Using performance models to support load testing in a large soa environment. In Proc. LT '14, pages 5--6. ACM, 2014. Google ScholarDigital Library
- M. Woodside, G. Franks, and D. C. Petriu. The future of software performance engineering. In Proc. FOSE '07, pages 171--187, 2007. Google ScholarDigital Library
- M. Woodside, D. C. Petriu, D. B. Petriu, H. Shen, T. Israr, and J. Merseguer. Performance by unified model analysis (PUMA). In Proc. WOSP '05, pages 1--12. ACM, 2005. Google ScholarDigital Library
Index Terms
- Automatic Extraction of Session-Based Workload Specifications for Architecture-Level Performance Models
Recommendations
Automatic extraction of probabilistic workload specifications for load testing session-based application systems
VALUETOOLS '14: Proceedings of the 8th International Conference on Performance Evaluation Methodologies and ToolsWorkload generation is essential to systematically evaluate performance properties of application systems under controlled conditions, e.g., in load tests or benchmarks. The definition of workload specifications that represent the real workload as ...
Using architecture-level performance models as resource profiles for enterprise applications
QoSA '14: Proceedings of the 10th international ACM Sigsoft conference on Quality of software architecturesThe rising energy and hardware demand is a growing concern in enterprise data centers. It is therefore desirable to limit the hardware resources that need to be added for new enterprise applications (EA). Detailed capacity planning is required to ...
WESSBAS: extraction of probabilistic workload specifications for load testing and performance prediction--a model-driven approach for session-based application systems
The specification of workloads is required in order to evaluate performance characteristics of application systems using load testing and model-based performance prediction. Defining workload specifications that represent the real workload as accurately ...
Comments