Skip to main content

Optimizing Performance of Automatic Training Phase for Application Performance Prediction in the Grid

  • Conference paper
High Performance Computing and Communications (HPCC 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4782))

Abstract

Automatic execution time prediction of the Grid applications plays a critical role in making the pervasive Grid more reliable and predictable. However, automatic execution time prediction has not been addressed due to the diversity of the Grid applications, usability of an application in multiple contexts, dynamic nature of the Grid, and concerns about result accuracy and time expensive experimental training. We introduce an optimized, low-cost, and efficient yet automatic training phase for automatic execution time prediction of Grid applications. Our approach is supported by intra- and inter-platform performance sharing and translation mechanisms. We are able to reduce the total number of experiments from an polynomial complexity to a linear complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Douglas, C., Montgomery,: Design and Analysis of Experiments, ch. 1, vol. 6. John Wiley & Sons, New York (2004)

    Google Scholar 

  2. Theiner, D., et al.: Reduction of Calibration Time of Distributed Hydrological Models by Use of Grid Comp. and Nonlinear Optimisation Algos. In: International Conference on Hydroinformatics, France (2006)

    Google Scholar 

  3. Blaha, P., Schwarz, K., Madsen, G., Kvasnicka, D., Luitz, J.: WIEN2k: An Augmented Plane Wave plus LocalOrbitals Program for Calculating Crystal Properties, Instituteof Physical and Theoretical Chemistry, TU Vienna (2001)

    Google Scholar 

  4. Schller, F., Qin, J., Farrukh N.: Performance, Scalability and Quality of the Meteorological Grid Workflow MeteoAG. In: 2nd Austrian Grid Symposium, Innsbruck, Austria. OCG Verlag (2006)

    Google Scholar 

  5. Iverson, M.A., et al.: Statistical Prediction of Task Execution Times Through Analytic Benchmarking for Scheduling in a Heterogeneous Environment. In: Heterogeneous Computing Workshop (1999)

    Google Scholar 

  6. Smith, W., Foster, I., Taylor, V.: Predicting Application Run Times Using Historical Information. In: Proceedings of the IPPS/SPDP (1998) Workshop on Job Scheduling Strategies for Parallel Processing (1998)

    Google Scholar 

  7. Yang, L.T., Ma, X., Mueller, F.: Cross- Platform Performance Prediction of Parallel Applications Using Partial Execution. In: Supercomputing, USA (2005)

    Google Scholar 

  8. Carrington, L., Snavely, A., Wolter, N.: A performance prediction framework for scientific applications,Future Gener. Computing Systems, vol. 22, Amsterdam, The Netherlands (2006)

    Google Scholar 

  9. Taylor, V., et al.: Prophesy: An Infrastructure for Performance Analysis and Modeling of Parallel and Grid Applications. ACM Sigmetrics Performance Evaluation Review 30(4) (2003)

    Google Scholar 

  10. Bailey, D.H., Snavely, A.: Performance Modeling: Understanding the Present and Predicting the Future. In: Euro-Par Conference (August 2005)

    Google Scholar 

  11. Kerbyson, D.J., Alme, H.J., et al.: Predictive Performance and Scalability Modeling of a Large-Scale Application. In: Proceedings of Supercomputing (2001)

    Google Scholar 

  12. Fahringer, T., et al.: ASKALON: A Grid Application Development and Computing Environment. In: 6th International Workshop on Grid, Seattle, USA (November 2005)

    Google Scholar 

  13. Marin, G., Mellor-Crummey, J.: Cross-Architecture Performance Predictions for Scientific Applications Using Parameterized Models. In: Joint International Conference on Measurement and Modeling of Computer Systems (2004)

    Google Scholar 

  14. Nadeem, F., Yousaf, M.M., Prodan, R., Fahringer, T.: Soft Benchmarks-based Application Performance Prediction using a Minimum Training Set. In: Second International Conference on e-Science and Grid computing, Amsterdam, Netherlands (December 2006)

    Google Scholar 

  15. Whaley, R.C., Petitet, A.: Petitet: Minimizing development and maintenance costs in supporting persistently optimized BLAS. Software: Practice and Experienc 35(2):1012̆013121 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ronald Perrott Barbara M. Chapman Jaspal Subhlok Rodrigo Fernandes de Mello Laurence T. Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nadeem, F., Prodan, R., Fahringer, T. (2007). Optimizing Performance of Automatic Training Phase for Application Performance Prediction in the Grid. In: Perrott, R., Chapman, B.M., Subhlok, J., de Mello, R.F., Yang, L.T. (eds) High Performance Computing and Communications. HPCC 2007. Lecture Notes in Computer Science, vol 4782. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75444-2_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-75444-2_33

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-75443-5

  • Online ISBN: 978-3-540-75444-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics