Skip to main content
Springer Nature Link
Log in

Tool Support for Developing DASH Applications

  • Conference paper
  • First Online:
Software for Exascale Computing - SPPEXA 2013-2015

Part of the book series: Lecture Notes in Computational Science and Engineering ((LNCSE,volume 113))

  • 906 Accesses

Abstract

DASH is a new parallel programming model for HPC which is implemented as a C++ template library on top of a runtime library implementing various PGAS (Partitioned Global Address Space) substrates. DASH’s goal is to be an easy to use and efficient way to parallel programming with C++. Supporting software tools is an important part of the DASH project, especially debugging and performance monitoring. Debugging is particularly necessary when adopting a new parallelization model, while performance assessment is crucial in High Performance Computing applications by nature. Tools are fundamental for a programming ecosystem and we are convinced that providing tools early brings multiple advantages, benefiting application developers using DASH as well as developers of the DASH library itself. This work, first briefly introduces DASH and the underlying runtime system, existing debugger and performance analysis tools. We then demonstrate the specific debugging and performance monitoring extensions for DASH in exemplary use cases and discuss an early assessment of the results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    IDE—Integrated Development Environment.

  2. 2.

    www.score-p.org

  3. 3.

    STL—Standard Template Library.

  4. 4.

    The unification process of Score-P was not included in the runtime measurements.

  5. 5.

    C++ specifier for a constant expression.

  6. 6.

    See http://www.sppexa.de and http://www.dfg.de/foerderung/info_wissenschaft/info_wissens chaft_14_57/index.html

References

  1. Adhianto, L., Banerjee, S., Fagan, M., Krentel, M., Marin, G., Mellor-Crummey, J., Tallent, N.R.: HPCToolkit: Tools for performance analysis of optimized parallel programs. Concurr. Comput.: Pract. Exper. 22 (6), 685–701 (2010)

    Google Scholar 

  2. Alameda, J., Spear, W., Overbey, J.L., Huck, K., Watson, G.R., Tibbitts, B.: The eclipse parallel tools platform: toward an integrated development environment for XSEDE resources. In: Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the Campus and Beyond (XSEDE ’12), pp. 48:1–48:8. ACM, New York (2012). http://doi.acm.org/10.1145/2335755.2335845

  3. Allen, E., Chase, D., Hallett, J., Luchangco, V., Maessen, J.-W., Ryu, S., Steele Jr, G.L., Tobin-Hochstadt, S., Dias, J., Eastlund, C., et al.: The fortress language specification. Sun Microsyst. 139, 140 (2005)

    Google Scholar 

  4. Allinea DDT: The global standard for high-impact debugging on clusters and supercomputers (2015). http://www.allinea.com/products/ddt Online; Accessed 12 Jan 2015

  5. Browne, S., Dongarra, J., Garner, N., Ho, G., Mucci, P.: A portable programming interface for performance evaluation on modern processors. Int. J. High Perform. Comput. Appl. 14 (3), 189–204 (2000)

    Article  Google Scholar 

  6. Buss, A., Papadopoulos, I., Pearce, O., Smith, T., Tanase, G., Thomas, N., Xu, X., Bianco, M., Amato, N.M., Rauchwerger, L., et al.: STAPL: standard template adaptive parallel library. In: Proceedings of the 3rd Annual Haifa Experimental Systems Conference, p. 14. ACM (2010)

    Google Scholar 

  7. Chamberlain, B.L., Callahan, D., Zima, H.P.: Parallel programmability and the Chapel language. Int. J. High Perform. Comput. Appl. 21, 291–312 (2007)

    Article  Google Scholar 

  8. Charles, P., Grothoff, C., Saraswat, V., Donawa, C., Kielstra, A., Ebcioglu, K., Von Praun, C., Sarkar, V.: X10: an object-oriented approach to non-uniform cluster computing. ACM Sigplan Notices 40 (10), 519–538 (2005)

    Article  Google Scholar 

  9. Dietrich, R., Ilsche, T., Juckeland, G.: Non-intrusive performance analysis of parallel hardware accelerated applications on hybrid architectures. In: 2010 39th International Conference on Parallel Processing Workshops (ICPPW), pp. 135–143. IEEE (2010)

    Google Scholar 

  10. Dryden, N.: PGDB: A debugger for MPI applications. In: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment (XSEDE ’14), pp. 44:1–44:7. ACM, New York (2014). http://doi.acm.org/10.1145/2616498.2616535

  11. Eschweiler, D., Wagner, M., Geimer, M., Knüpfer, A., Nagel, W.E., Wolf, F.: Open Trace Format 2: The next generation of scalable trace formats and support libraries. In: Applications, Tools and Techniques on the Road to Exascale Computing. Advances in Parallel Computing, vol. 22, pp. 481–490. IOS Press (2012)

    Google Scholar 

  12. Free Software Foundation, Inc.: GDB: The GNU Project Debugger. http://www.gnu.org/software/gdb/ (2014). Online; Accessed 01 Nov 2015

  13. Fürlinger, K., Glass, C., Gracia, J., Knüpfer, A., Tao, J., Hünich, D., Idrees, K., Maiterth, M., Mhedheb, Y., Zhou, H.: DASH: data structures and algorithms with support for hierarchical locality. In: Lopes, L., Žilinskas, J., Costan, A., Cascella, R., Kecskemeti, G., Jeannot, E., Cannataro, M., Ricci, L., Benkner, S., Petit, S., Scarano, V., Gracia, J., Hunold, S., Scott, S., Lankes, S., Lengauer, C., Carretero, J., Breitbart, J., Alexander, M. (eds.) Euro-Par 2014: Parallel Processing Workshops. Lecture Notes in Computer Science, vol. 8806, pp. 542–552. Springer, Cham (2014). http://dx.doi.org/10.1007/978-3-319-14313-2_46

  14. Fürlinger, K., Wright, N.J., Skinner, D.: Performance analysis and workload characterization with IPM. In: Proceedings of the 3rd International Workshop on Parallel Tools for High Performance Computing, pp. 31–38. Springer, Dresden (2010)

    Google Scholar 

  15. Geimer, M., Wolf, F., Wylie, B.J., Ábrahám, E., Becker, D., Mohr, B.: The Scalasca performance toolset architecture. Concurr. Comput.: Pract. Exper. 22 (6), 702–719 (2010)

    Google Scholar 

  16. Gerndt, M., Ott, M.: Automatic performance analysis with periscope. Concurr. Comput.: Pract. Exper. 22 (6), 736–748 (2010)

    Google Scholar 

  17. Grünewald, D., Simmendinger, C.: The GASPI API specification and its implementation GPI 2.0. In: 7th International Conference on PGAS Programming Models, vol. 243 (2013)

    Google Scholar 

  18. Hünich, D., Knüpfer, A., Gracia, J.: Providing parallel debugging for DASH distributed data structures with GDB. Procedia Comput. Sci. 51, 1383–1392 (2015). http://www.sciencedirect.com/science/article/pii/S1877050915011539. International Conference on Computational Science, ICCS 2015 Computational Science at the Gates of Nature

    Google Scholar 

  19. Ilsche, T., Schuchart, J., Schöne, R., Hackenberg, D.: Combining instrumentation and sampling for trace-based application performance analysis. In: Proceedings of the 8th International Parallel Tools Workshop, pp. 123–136. Springer (2014)

    Google Scholar 

  20. Johnson, T.A.: Coarray C++. In: 7th International Conference on PGAS Programming Models, Edinburgh (2013)

    Google Scholar 

  21. Knüpfer, A., Brunst, H., Doleschal, J., Jurenz, M., Lieber, M., Mickler, H., Müller, M.S., Nagel, W.E.: The Vampir performance analysis tool-set. In: Tools for High Performance Computing, pp. 139–155. Springer, Berlin/Heidelberg (2008)

    Google Scholar 

  22. an Mey, D., Biersdorf, S., Bischof, C., Diethelm, K., Eschweiler, D., Gerndt, M., Knüpfer, A., Lorenz, D., Malony, A., Nagel, W.E., et al.: Score-P: a unified performance measurement system for petascale applications. In: Competence in High Performance Computing 2010, pp. 85–97. Springer, Berlin/Heidelberg (2012)

    Google Scholar 

  23. MPI Forum: MPI: A Message-Passing Interface Standard. Version 3.0 (2012). Available at: http://www.mpi-forum.org (Sept 2012)

  24. Müller, M.S., Knüpfer, A., Jurenz, M., Lieber, M., Brunst, H., Mix, H., Nagel, W.E.: Developing scalable applications with Vampir, VampirServer and VampirTrace. In: Parallel Computing: Architectures, Algorithms and Applications. Advances in Parallel Computing, vol. 18, pp. 637–644. John von Neumann Institute for Computing, Jülich (2007)

    Google Scholar 

  25. Numrich, R.W., Reid, J.: Co-array Fortran for parallel programming. SIGPLAN Fortran Forum 17 (2), 1–31 (1998)

    Article  Google Scholar 

  26. Partitioned Global Address Space (2014). [Online] http://www.pgas.org

  27. Poole, S.W., Hernandez, O., Kuehn, J.A., Shipman, G.M., Curtis, A., Feind, K.: OpenSHMEM - toward a unified RMA model. In: Padua, D. (ed.) Encyclopedia of Parallel Computing, pp. 1379–1391. Springer US (2011)

    Google Scholar 

  28. Rogue Wave Software, I.: TotalView debugger: faster fault isolation, improved memory optimization, and dynamic visualization for your high performance computing apps (2015). http://www.roguewave.com/products-services/totalview, [Online; Accessed 12 Jan 2015]

  29. Shende, S.S., Malony, A.D.: The TAU parallel performance system. Int. J. High Perform Comput. Appl. 20 (2), 287–311 (2006)

    Article  Google Scholar 

  30. UPC Consortium: UPC language specifications, v1.2. Tech Report LBNL-59208, Lawrence Berkeley National Lab (2005). http://www.gwu.edu/~upc/publications/LBNL-59208.pdf

  31. at the University of Illinois at Urbana-Champaign, C.S.D.: The LLDB Debugger (2015). http://www.gnu.org/software/gdb/, [Online; Accessed 12 Jan 2015]

  32. Zheng, Y., Kamil, A., Driscoll, M.B., Shan, H., Yelick, K.: UPC++: A PGAS extension for C++. In: 28th IEEE International Parallel & Distributed Processing Symposium, pp. 1105–1114. IEEE (2014)

    Google Scholar 

  33. Zhou, H., Mhedheb, Y., Idrees, K., Glass, C.W., Gracia, J., Fürlinger, K.: DART-MPI: An MPI-based Implementation of a PGAS Runtime System. In: Proceedings of the 8th International Conference on Partitioned Global Address Space Programming Models (PGAS ’14), pp. 3:1–3:11. ACM, New York (2014). http://doi.acm.org/10.1145/2676870.2676875

Download references

Acknowledgements

The DASH concept and its current implementation have been developed in the DFG project “Hierarchical Arrays for Efficient and Productive Data-Intensive Exascale Computing” funded under the German Priority Programme 1648 “Software for Exascale Computing” (SPPEXA). Footnote 6

Author information

Authors and Affiliations

  1. TU Dresden, Dresden, Germany

    Denis Hünich, Andreas Knüpfer & Sebastian Oeste

  2. LMU München, München, Germany

    Karl Fürlinger & Tobias Fuchs

Authors
  1. Denis Hünich
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andreas Knüpfer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sebastian Oeste
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karl Fürlinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tobias Fuchs
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Denis Hünich .

Editor information

Editors and Affiliations

  1. Technische Universität München Institut für Informatik, Garching, Bayern, Germany

    Hans-Joachim Bungartz

  2. Technische Universität München Institut für Informatik, Garching, Germany

    Philipp Neumann

  3. Technische Universität Dresden, Dresden, Germany

    Wolfgang E. Nagel

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Hünich, D., Knüpfer, A., Oeste, S., Fürlinger, K., Fuchs, T. (2016). Tool Support for Developing DASH Applications. In: Bungartz, HJ., Neumann, P., Nagel, W. (eds) Software for Exascale Computing - SPPEXA 2013-2015. Lecture Notes in Computational Science and Engineering, vol 113. Springer, Cham. https://doi.org/10.1007/978-3-319-40528-5_16

Download citation

Publish with us

Policies and ethics