research-article

Framework for hybrid performance prediction process model: use case performance engineering approach

Authors:

D. Evangelin Geetha,

T.V. Suresh Kumar,

K. Rajani KanthAuthors Info & Claims

ACM SIGSOFT Software Engineering Notes, Volume 36, Issue 3

Pages 1 - 15

https://doi.org/10.1145/1968587.1968607

Published: 05 May 2011 Publication History

Abstract

The dynamic behavior of distributed systems requires that their performance characteristics be determined rigorously, preferably in the early stages of software engineering process. Evaluation of the performance at the end of software development leads to increase in the cost of design change. To compare design alternatives or to identify system bottlenecks, quantitative system analysis must be carried out from the early stages of the software development life cycle. In this paper we describe a process model, Hybrid Performance Prediction Process Model that allows modeling and evaluating distributed systems with the explicit goal of assessing performance of the software system during feasibility study. The use case performance engineering approach proposed in this paper exploits use case model and provides flexibility to integrate the software performance prediction process with software engineering process. We use an e-parking application to demonstrate various elements in our framework. The performance metrics are obtained and analyzed by considering two software architectures. Sensitivity analysis on the behavior of resources is carried out. This analysis helps to determine the capacity of the execution environment to obtain the defined performance objectives.

References

[1]

Smith C.U., Performance Engineering of Software Systems. Addison Wesley, 1990.

Digital Library

[2]

C.U. Smith and L.G. Williams, Performance Solutions: A Practical Guide to Creating Responsive, Scalable Software. Addison Wesley, 2002.

Digital Library

[3]

Dorin B Petriu, Murray Woodside: 'Analyzing Software Requirements Specifications for Performance', Proc. 3rd International Workshop on Software and Performance, Rome, Italy, July 2002, pp.1--9.

Digital Library

[4]

C.U. Smith: 'Software Performance Engineering: A Case Study including Performance Comparison with Design Alternatives', IEEE Transactions on Software Engineering, 19,(7), July 1993, pp. 720--740.

Digital Library

[5]

Object Management Group. (2005) UMLTM Profile for Schedulability, Performance, and Time Specification, Version 1.1, formal/05-01-02.

[6]

Object Management Group (2007) UML Profile for Modeling and Analysis of Real-Time and Embedded Systems (MARTE). Beta 1. OMG, 2007. OMG document number ptc/07-08-04.

[7]

L.G. Williams and C.U. Smith, "Performance Evaluation of Software Architectures," Proc. ACM Int'l Workshop Software and Performance, pp. 164--177, 1998.

Digital Library

[8]

C.U. Smith and L.G. Williams, "Performance Engineering Evaluation of Object-Oriented Systems with SPE.ED2," Springer LNCS 1245, pp. 135--153, 1997.

Digital Library

[9]

L.G. Williams and C.U. Smith, "PASA: A Method for the Performance Assessment of Software Architectures," Proc. ACM Int'l Workshop Software and Performance, pp. 179--189, 2002.

Digital Library

[10]

C.U. Smith and Lioyd G. Williams: "Performance Engineering Models of CORBA-based distributed-object systems", Performance Engineering Services and Software Engineering Research, 1998.

[11]

Peter Utton and Gino Martin, David Akehurst and Gill Waters: "Performance Analysis of Object-oriented Designs for Distributed Systems", Technical Report, University of Kent at Canterburry.

[12]

Connie U. Smith and Lioyd G. Williams: "Building Responsive and Scalable Web Applications", Proceedings CMGC, December 2000.

[13]

C.U. Smith, C.M. Llado, V. Cortellessa, A.D. Marco, L.G. Williams, "From UML models to software performance results: An SPE process based on XML interchange formats, WOSP'05, Palma de Mallorca, Spain, July 12-14, 2005.

Digital Library

[14]

V. Cortellessa and R. Mirandola, "Deriving a Queuing Network Based Performance Model from UML Diagrams," ACM Proc. Int'l Workshop Software and Performance, pp. 58--70, 2000.

Digital Library

[15]

Vittorio Cortellessa, Raffaela Mirandola, 'PRIMA-UML: A Performance Validation Incremental Methodology on Early UML Diagrams', Science of Computer Programming, Elsevier, 44, (1), 2002, pp. 101--129.

Digital Library

[16]

V. Cortellessa, G. Iazeolla, and R. Mirandola, "Early Generation of Performance Models for Object-Oriented Systems," IEEE Proc. Software, vol. 147, no. 3 pp. 61--72, 2000.

[17]

V Cortellessa, A.D. Marco, P. Inverardi, "Software Performacne Model-Driven Architecture", SAC '06, Dijon, France, April 23-27, 2006.

Digital Library

[18]

V. Cortellessa, A. Martensy, R. Reussnery, C. Trubiani, Towards the Identification of "Guilty" Performance Antipatterns

[19]

H. Gomaa and D.A. Menascé, "Design and Performance Modeling of Component Interconnection Patterns for Distributed Software Architectures," ACM Proc. Int'l Workshop Software and Performance, pp. 117--126, 2000.

Digital Library

[20]

H. Gomaa and D. Menascé, "Performance Engineering of Component-Based Distributed Software Systems," Performance Eng., R. Dumke et al., eds. pp. 40--55, 2001.

Digital Library

[21]

D.C. Petriu and X. Wang, "From UML Descriptions of High-Level Software Architectures to LQN Performance Models," Proc. Applications of Graph Transformations with Industrial Relevance Workshop (AGTIVE'99), pp. 47--62, 1999.

Digital Library

[22]

D.C. Petriu and H. Shen, "Applying UML Performance Profile: Graph Grammar-Based Derivation of LQN Models from UML Specifications," Proc. Seventh Int'l Conf. Modelling Techniques and Tools for Performance Evaluation, pp. 159--177, 2002.

Digital Library

[23]

G. Gu and D.C. Petriu, "XSLT Transformation from UML Models to LQN Performance Models," ACM Proc. Int'l Workshop Software and Performance, pp. 227--234, 2002.

Digital Library

[24]

D.A. Menascé and H. Gomaa, "On a Language Based Method for Software Performance Engineering of Client/Server Systems," ACM Proc. Int'l Workshop Software and Performance, pp. 63--69, 1998.

Digital Library

[25]

D.A. Menasceé and H. Gomaa, "A Method for Design and Performance Modeling of Client/Server Systems," IEEE Trans. Software Eng., vol. 26, no. 11, pp. 1066--1085, Nov. 2000.

Digital Library

[26]

D.A. Menascé, "A Framework for Software Performance Engineering of Client/Server Systems," Proc. 1997 Computer Measurement Group Conf., 1997.

[27]

D.C. Petriu and C.M. Woodside, "Software Performance Models from System Scenarios in Use Case Maps," Proc. 12th Int'l Conf. Modeling Tools and Techniques for Computer and Comm. System Performance Evaluation, pp. 141--1158, 2002.

Digital Library

[28]

Dorin, B. Petriu, Daniel Amyot, Murray Woodside, and Bo Jiang: 'Traceability and Evaluation in Scenario Analysis by Use Case Maps', LNCS, 3466, 2005, pp. 134--151.

Digital Library

[29]

Pekka Kahkipuro (2000) "Performance Modeling Framework for CORBA Based Distributed Systems", University of Helsinki, Finland. Report A-2000-3.

[30]

P. Kahkipuro, "UML-Based Performance Modeling Framework for Component-Based Distributed Systems," Proc. Performance Eng. Conf., pp. 167--184, 2001.

Digital Library

[31]

Stephen Gilmoret, Jane Hillstont, Lefla Kloul* and Marina Ribaudo, "Software performance modelling using PEPA nets", WOSP 04, January 14-16, 2004, Redwood City, CA.

Digital Library

[32]

Synthesizing PEPA Nets from IODs for Performance Analysis, Juliana Bowles, Leïla Kloul, WOSP/SIPEW'10, January 28-30, 2010, San Jose, California, USA.

[33]

S. Bernardi, S. Donatelli, and J. Merseguer, "From UML Sequence Diagrams and Statecharts to Analysable Petri Net Models," ACM Proc. Int'l Workshop Software and Performance, pp. 35--45, 2002.

Digital Library

[34]

Jose Merseguer and Javier Campos: 'Software Performance Modeling using UML and Petri nets', LNCS, 2965, Springer, Berlin /Heidelberg, 2004, pp. 265--289.

[35]

Jerry Banks, John S. Carson II, Barry L. Nelson, David M. Nicol: Discrete-Event System Simulation, 4th Edition, Pearson Education, 2007.

[36]

M. DeMiguel, T. Lambolais, M. Hannouz, S. Betgé-Brezetz, and S. Piekarec, "UML Extensions for the Specification and Evaluation of Latency Constraints in Architectural Models," ACM Proc. Int'l Workshop Software and Performance, pp. 83--88, 2000.

Digital Library

[37]

L.B. Arief and N.A. Speirs, "A UML Tool for an Automatic Generation of Simulation Programs," ACM Proc. Second Int'l Workshop Software and Performance, pp. 71--76, 2000.

Digital Library

[38]

Simonetta Balsamo, Moreno Marzolla, Simulation-Based Performance Modelling of UML Software Architectures, Ph.D thesis

[39]

Simonetta Balsamo, Roberto Mamprin, Moreno Marzolla: 'Performance Evaluation of Software Architectures with Queuing Network Models', Proc. ESMc '04, Paris, France, Oct 2004. http://www.moreno.marzolla.name/publications/papers/marzolla-esmc04-final.pdf, accessed May 2010.

[40]

Simonetta Balsamo Moreno Marzolla: 'Performance Evaluation of UML Software Architectures with Multiclass Queueing Network Models', Proc. 5th International Workshop on Software and Performance, Spain, July, 2005, pp. 37--42.

Digital Library

[41]

Mirco Tribastone and Stephen Gilmore (2008) "Automatic Extraction of PEPA Performance Models from UML Activity Diagrams Annotated with the MARTE Profile", Proceedings of WOSP '08, Princeton, New Jersey, USA, June 24-26, 2008, pp. 67--78.

Digital Library

[42]

Rasha Tawhid, Dorina C. Petriu (2008) "Towards Automatic Derivation of a Product Performance Model from a UML Software Product Line Model", Proceedings of WOSP '08, Princeton, New Jersey, USA, June 24-26, 2008, pp. 91--102.

Digital Library

[43]

C.M.Woodside, D.C. Petriu, D.B. Petriu, H.Shen, T.Israr. J. Merseguer, "Performance by Unified Model Analysis (PUMA)", WOSP'05, Palma de Mallorca, Spain, July 11-15, 2005.

Digital Library

[44]

Thomas B. Hodel-Widmer, Suo Cong University of Zurich "Parking Space Optimization Service", Swiss Transport Research Conference, March 24-25, 2004.

[45]

Robert, T., Futrell, Donald, F., Shafer, and Linda, I. Shafer: 'Quality Software Project Management', Pearson Eduacation, 2006.

Digital Library

[46]

Linda, M., Laird, Carol Brennan: 'Software Measurement and Estimation -- A Practical Approach', (John Wiley & Sons, 2006).

Digital Library

[47]

http://sealabtools.di.univaq.it/MosquitoHome.html

[48]

Dienemann P. F., Esttimating Cost Uncertainty Using Monte Carlo Techniques, Memorandum, RM-4854-PR, January 1966.

[49]

Evangelin Geetha, D., Suresh Kumar, T. V., and Rajani Kanth, K.: 'Early Performance Modeling for Web Based Applications", Proc CIT '04, Hyderabad, LNCS, 3356/2005, Springer Verlag, December 2004, pp. 400--409.

Digital Library

[50]

Evangelin Geetha, D., Suresh Kumar, T. V., and Rajani Kanth, K.: 'Early Performance Modeling for Multi Agent Systems using UML 2.0', IJCSNS International Journal of Computer Science and Network Security, March 2006, 6, (3A), pp.247--254.

[51]

Evangelin Geetha, D., Ram Mohan Reddy, Suresh Kumar, T. V., and Rajani Kanth, K.: 'Performance Modeling and Evaluation of e-commerce Systems', Proc. 8th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD2007), Qingdao, China, August 2007, vol. 3, pp.1135--1140.

Digital Library

[52]

Hermanns H., Herzog U., and J.P. Katoen, "Process Algebra for Performance Evaluation," Theoretical Computer Science, vol. 274, nos. 1-2, pp. 43--87, 2002.

Digital Library

[53]

S. Balsamo, A. D. Marco, P. Inverardi, "Model-Based Performance Prediction in Software Development: A Survey", IEEE Transactions on Software Engineering, Vol. 30, No. 5, May 2004.

Digital Library

[54]

G. P. Gu., Petriu, D. C., "From UML to LQN by XML Algebra-based Model Transformations", Proceedings of WOSP'05, Workshop on Software and Performance, July 12-14, 2005, Spain, pp. 99--110.

Digital Library

[55]

B. Urgaonkar, G. Pacifici, P. Shenoy, M. Spreitzer and A. Tantawi, Analytic Modeling of Multitier Internet Applications, ACM Transactions on the Web, Vol. 1, No. 1, May 2007.

Digital Library

[56]

http://staruml.sourceforge.net.

[57]

D. Evangelin Geetha, T. V. Suresh Kumar, K. Rajanikanth, Predicting the Software Performance during Feasibility Study, Accepted for publication in IET Software.

[58]

D. E. Geetha, P. Mayank, T. V. Suresh Kumar, K. Rajanikanth, A Tool for Simulating Multi-tier Queuing Applications, Technical Report, Department of MCA, MSRIT, TRMCA 04, September 2010.

[59]

Bass, L., Clements, P., and Kazman, R. 2003. Software Architecture in Practice, Pearson Education.

Digital Library

Cited By

Sbeity IDbouk M(2014)Software performance engineering using UML2SAN: Deadlock prediction of funds transfer2014 9th International Conference on Computer Engineering & Systems (ICCES)10.1109/ICCES.2014.7030978(318-323)Online publication date: Dec-2014
https://doi.org/10.1109/ICCES.2014.7030978
Ajitha SKumar TGeetha DRajanikanth K(2012)Early Performance Prediction of Co-Operative Multi-Agent SystemsProcedia Engineering10.1016/j.proeng.2012.06.35438(3037-3048)Online publication date: 2012
https://doi.org/10.1016/j.proeng.2012.06.354

Index Terms

Framework for hybrid performance prediction process model: use case performance engineering approach

Recommendations

Early performance assessment in component‐based software systems

Most techniques used to assess the qualitative characteristics of software are done in testing phase of software development. Assessment of performance in the early software development process is particularly important to risk management. Software ...
A Framework for Designing Performance-Oriented Distributed Systems
ISCC '01: Proceedings of the Sixth IEEE Symposium on Computers and Communications

Abstract: A methodology and related software design environment for the development of performance-engineered object-oriented distributed systems is essential. In this research, a performance-engineered design framework that utilizes the system ...
A reusable, academic-strength, metrics-based software engineering process for capstone courses and projects

This paper describes a mature Software Engineering Process that may be applied to capstone courses, student projects, and research projects in a university environment. This process, based in part on the Team Software Process of the Software Engineering ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGSOFT Software Engineering Notes

ACM SIGSOFT Software Engineering Notes Volume 36, Issue 3

May 2011

89 pages

ISSN:0163-5948

DOI:10.1145/1968587

Issue’s Table of Contents

Copyright © 2011 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2011

Published in SIGSOFT Volume 36, Issue 3

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
314
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sbeity IDbouk M(2014)Software performance engineering using UML2SAN: Deadlock prediction of funds transfer2014 9th International Conference on Computer Engineering & Systems (ICCES)10.1109/ICCES.2014.7030978(318-323)Online publication date: Dec-2014
https://doi.org/10.1109/ICCES.2014.7030978
Ajitha SKumar TGeetha DRajanikanth K(2012)Early Performance Prediction of Co-Operative Multi-Agent SystemsProcedia Engineering10.1016/j.proeng.2012.06.35438(3037-3048)Online publication date: 2012
https://doi.org/10.1016/j.proeng.2012.06.354

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents