Abstract
A challenging software engineering problem is the design and implementation of component-based (CB) applications that can meet specified performance requirements. Our PPCB approach has been developed to facilitate performance prediction of CB applications built using black-box component infrastructures such as J2EE. Such deployment scenarios are problematic for traditional performance modeling approaches, which typically focus on modeling application component performance and neglect the complex influence of the specific component technology that hosts the application. In this paper, an overview of the PPCB modeling approach is given. Example results from predicting the performance of a J2EE application are presented. These results are then statistically analyzed to quantify the uncertainty in the predicted results. The contribution of the paper is the presentation of concrete measures of the confidence an architect can have in the performance predictions produced by the PPCB.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balsamo, S., Personè, V.D.N., Inverardi, P.: A Review on queueing network models with finite capacity queues for software architectures performance prediction, Performance Evaluation.  51(2-4), 269–288 (2002)
Cecchet, E., Marguerite, J., Zwaenepoel, W.: Performance and scalability of EJB applications. In: Conference on Object Oriented Programming, Systems, Languages and Applications, pp. 246–261 (2002)
Chen, S., Liu, Y., Gorton, I., Liu, A.: Performance Prediction of Component Based System. Journal of Systems and Software (2004) (In Press)
Gomaa, H., Menascé, D.A.: Design and performance modeling of component interconnection patterns for distributed software architectures. In: Proc. Workshop on Software and Performance, pp. 117–126 (2000)
Gorton, I.: Enterprise Transaction Processing Systems. Addison-Wesley, Reading (2000)
Gorton, I., Liu, A.: Performance evaluation of alternative component architectures for EJB applications. IEEE Internet Computing 7(3), 18–23 (2003)
Gorton, I., Liu, A., Brebner, P.: Rigorous evaluation of COTS middleware technology. IEEE Computer 36(3), 50–55 (2003)
Hahn, G.J., Meeker, W.Q.: Statistical Intervals: a guide for practitioners. John Wiley & Sons, New York (1991)
Hissam, S.A., Moreno, G., Stafford, J., Wallman, K.: Packaging predictable assembly. In: Bishop, J.M. (ed.) CD 2002. LNCS, vol. 2370, pp. 108–224. Springer, Heidelberg (2002)
Hissam, S.A., Hudak, J., Ivers, J., Klein, M., Larsson, M., Moreno, G., Northrop, L., Plakosh, D., Stafford, J., Wallnau, K., Wood, W.: Predictable Assembly of Substation Automation Systems: An Experiment Report, 2nd edn., CMU/SEI-2002-TR-031, ESC-TR-2002-031 (2002).
Juse, K.S., Kounev, S., Buchmann, A.: PetStore-WS: measuring the performance implications of web services. In: Proceedings of the International Conference of the Computer Measurement Group (2003)
Kounev, S., Buchmann, A.: Performance modeling of distributed E-Business applications using queuing petri nets. In: Proc. of IEEE Int’l Symp on Performance Analysis of Systems and Software (2003)
Kung, H.T., Robinson, J.T.: On optimistic methods for concurrency control. ACM Transactions on Database Systems 6(2), 213–226 (1981)
Lazowska, E., Zahorjan, J., Graham, S., Sevcik, K.: Quantitative System Performance. Prentice-Hall, Englewood Cliffs (1984)
Liu, Y., Fekete, A., Gorton, I.: Predicting the performance of middleware-based applications at the design level. In: 4th International Workshop on Performance and Software Engineering, pp. 166–170 (2004)
Liu, Y.: A Framework to Predict the Performance of Component-based Applications, PhD Thesis, University of Sydney, Australia (2004)
Menascé, D., Almeida, V.A.F.: Scaling for E-Business: Technologies, Models, Performance, and Capacity Planning. Prentice-Hall, Englewood Cliffs (2000)
OptimizeIt Suite, http://www.borland.com/optimizeit/
Rakatine, D.: The Seppuku Pattern (2002), http://www.theserverside.com/patterns/thread.tss?thread_id=11280
Rolia, J.A., Sevik, K.C.: The method of layers. IEEE Transaction on Software Engineering 21(8), 689–700 (1995)
Saavedra, R.H., Smith, A.J.: Analysis of benchmark characteristics and benchmark performance prediction. ACM Transactions on Computer System 14(4), 344–384 (1996)
Venables, W.N., Ripley, B.D.: Modern Applied Statistics with S-Plus. Springer, Heidelberg (2002)
Walpole, R.E., Myers, R.H.: Probability and Statistics for Engineers and Scientists, 5th edn. Macmillan Publishing Company, Basingstoke (1993)
Woodside, C.M., Neilson, J.E., Petriu, D.C., Majumdar, S.: The Stochastic Rendezvous Network Model for Performa of Synchronous Client-Server-Like Distributed Software. IEEE Transactions on Computers 44(1), 20–34 (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, Y., Gorton, I. (2005). Accuracy of Performance Prediction for EJB Applications: A Statistical Analysis. In: Gschwind, T., Mascolo, C. (eds) Software Engineering and Middleware. SEM 2004. Lecture Notes in Computer Science, vol 3437. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11407386_14
Download citation
DOI: https://doi.org/10.1007/11407386_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25328-0
Online ISBN: 978-3-540-31975-7
eBook Packages: Computer ScienceComputer Science (R0)