Skip to main content

MPTD: A Scalable and Flexible Performance Prediction Framework for Parallel Systems

  • Conference paper
Advanced Parallel Processing Technologies (APPT 2009)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5737))

Included in the following conference series:

  • 716 Accesses

Abstract

The increasing complexities of today’s parallel systems pose new challenges for performance prediction. Effective performance prediction can provide insight, deepen understanding and further identify potential performance bottlenecks of system/application combinations. In this paper, we present and evaluate a multi-phase trace-driven (MPTD) performance prediction framework for parallel systems. In the trace generation phase, based on a relatively simple performance model, MPTD performs parallel performance simulation to generate primary prediction results and traces rapidly. In the trace adjustment phase, traces are transformed or re-simulated based on performance models of new component architecture or more detailed performance models. This phase is self-repeatable (it can be performed more than once and need not go back to the former phase) to enable more flexible reuse of traces. We implemented an instantiation of MPTD to predict the performance of popular multi-core cluster systems. Analysis and tests show that MPTD is scalable, flexible, and can help researchers for better balancing accuracy and efficiency of performance prediction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nudd, G., Kerbyson, D., Papaefstathiou, E., Perry, S., Harper, J.S., Wilcox, D.: Pace: A toolset for the performance prediction of parallel and distributed systems. Int. J. of High Performance Computing Applications 14, 228–251 (2000)

    Article  Google Scholar 

  2. Top500supercomputersite (2008), http://www.top500.org/

  3. Yi, J.J., Lilja, D.J.: Simulation of computer architectures: Simulators, benchmarks, methodologies, and recommendations. IEEE Transactions on computers 55(3), 268–280 (2006)

    Article  Google Scholar 

  4. Carrington, L., Snavely, A., Wolter, N., Gao, X.: A performance prediction framework for scientific applications. In: Sloot, P.M.A., Abramson, D., Bogdanov, A.V., Gorbachev, Y.E., Dongarra, J., Zomaya, A.Y. (eds.) ICCS 2003. LNCS, vol. 2659. Springer, Heidelberg (2003)

    Google Scholar 

  5. Zheng, G., Wilmarth, T., Jagadishprasad, P., KaÍe, L.V.: Simulation-based performance prediction for large parallel machines. International Journal of Parallel Programming 33, 183–207 (2005)

    Article  Google Scholar 

  6. Dickens, P.M., Heidelberger, P., Nicol, D.M.: A distributed memory lapse: parallel simulation of message-passing programs. SIGSIM Simul. Dig. 24(1), 32–38 (1994)

    Article  Google Scholar 

  7. Bagrodia, R., Deelman, E., Docy, S., Phan, T.: Performance prediction of large parallel applications using parallel simulations. In: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP) (May 1999)

    Google Scholar 

  8. Geimer, M., Wolf, F., Wylie, B., Mohr., B.: Scalable parallel trace-based performance analysis. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) PVM/MPI 2006. LNCS, vol. 4192, pp. 303–312. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  9. Mendes, C.: Performance prediction by trace transformation. In: Proc. of the 5th Brazilian Symposium on Computer Architecture, Florianopolis (September 1993)

    Google Scholar 

  10. Jagadishprasad, P.K.: Parallel simulation of large scale interconnection networks used in high performance computing. Master’s thesis, University of Illinois at Urbana-Champaign (2004)

    Google Scholar 

  11. Labarta, J., Girona, S., Pillet, V., Cortes, T., Gregoris, L.: Dip: A parallel program development environment. In: Fraigniaud, P., Mignotte, A., Robert, Y., Bougé, L. (eds.) Euro-Par 1996. LNCS, vol. 1124, pp. 665–674. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  12. Yan, J., Sarukkai, S., Mehra, P.: Performance measurement, visualization and modeling of parallel and distributed programs using the aims toolkit. Software Practice and Experience 25(4), 429–461 (1995)

    Article  Google Scholar 

  13. Snavely, A., Carrington, L., Wolter, N., Labarta, J., Badia, R., Purkayastha, A.: A framework for application performance modeling and prediction. In: Proceedings of SC 2002, Baltimore (November 2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Xu, C., Che, Y., Wang, Z. (2009). MPTD: A Scalable and Flexible Performance Prediction Framework for Parallel Systems. In: Dou, Y., Gruber, R., Joller, J.M. (eds) Advanced Parallel Processing Technologies. APPT 2009. Lecture Notes in Computer Science, vol 5737. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03644-6_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03644-6_36

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03643-9

  • Online ISBN: 978-3-642-03644-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics