Abstract
The Grid middleware must be developed iteratively and incrementally, so Grid performance testing is critical for middleware developers of Grid system. Considering the special characters of Grid system, in order to gain meaningful and comprehensive results of performance testing, it is necessary to implement testing on real Grid environment with various types of workload. CROWNBench, as described in this paper, is a system for helping Grid middleware developers to evaluate middleware design and implement using customizable synthetic workload. Middleware developers can customize testing workload basing on the model of Grid workload derived from real workload traces, including its structure and parameters, and then workload is synthesized automatically and contained jobs will be submitted by CROWNBench in a distributed manner. CROWNBench defines several metrics for measuring Grid performance as automatic testing results. The experiment, which used CROWNBench to test the performance of Grid system with CROWN Grid middleware, shows that the system already finished have accomplished its prospective goal. It can implement Grid performance testing in an efficient, flexible, controllable, replayable and automatic way to help middleware developers evaluate and improve their products effectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
China Research and Development Environment Over Wide-area Network, http://www.crown.org.cn/
Lublin, U., Feitelson, D.: The Workload on Parallel Supercomputers: Modeling the Characteristics of Rigid Jobs. http://citeseer.nj.nec.com/lublin01workload.html
Calzarossa, M., Serazzi, G.: Workload Characterization a Survey. Proc. Of the IEEE 81(8), 1136–1150 (1993)
Li, H.: Performance Evaluation in Grid Computing: A Modeling and Prediction Perspective. In: ccgrid. Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2007), pp. 869–874 (2007)
Iosup, A., Dumitrescu, C., Epema, D., Li, H., Wolters, L.: How are real grids used? The analysis of four grid traces and its implications. In: proceedings of 7th IEEE/ACM Intl. Conference on Grid Computing (Grid 2006) (2006)
Khalili, O., He, J., Olschanowsky, C., Snavely, A., Casanova, H.: Measuring the Performance and Reliability of Production Computational Grids. In: Grid Computing Conference (2006)
Frumkin, M., Van der Wijngaart, R.F.: NAS Grid Benchmarks: A Tool for Grid Space Exploration. Cluster Computing 5(3), 247–255 (2002)
Tsouloupas, G., Dikaiakos, M.: GridBench: A Tool for Benchmarking Grids. In: Proceedings of the 4th International Workshop on Grid Computing (Grid 2003), pp. 60–67 (2003)
Iosup, A., Epema, D.H.J.: GrenchMark: A Framework for Analyzing, Testing, and Comparing Grids. In: Proc. of the 6th IEEE/ACM Int’l Symposium on Cluster Computing and the Grid (CCGrid 2006), May 2006, pp. 313–320. IEEE Computer Society Press, Los Alamitos (2006)
Németh, Z., Gombás, G., Balaton, Z.: Performance Evaluation on Grids: Directions, Issues, and Open Problems. In: Parallel, Distributed and Network-Based Processing (2004)
Lublin, U., Feitelson, D.G.: The workload on parallel supercomputers: modeling the characteristics of rigid jobs. J. Parallel & Distributed Comput. 63(11), 1105–1122 (2003)
Calzarossa, M., Serazzi, G.: Workload characterization: a survey. Proc. IEEE 81(8), 1136–1150 (1993)
The Apache, A.N.T.: Project, http://ant.apache.org
Ant-Contrib Tasks, http://ant-contrib.sourceforge.net
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, X., Li, X., Ji, Y., Sha, M. (2008). CROWNBench: A Grid Performance Testing System Using Customizable Synthetic Workload. In: Zhang, Y., Yu, G., Bertino, E., Xu, G. (eds) Progress in WWW Research and Development. APWeb 2008. Lecture Notes in Computer Science, vol 4976. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78849-2_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-78849-2_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78848-5
Online ISBN: 978-3-540-78849-2
eBook Packages: Computer ScienceComputer Science (R0)