Skip to main content

Gotcha: An Function-Wrapping Interface for HPC Tools

  • Conference paper
  • First Online:
Programming and Performance Visualization Tools (ESPT 2017, ESPT 2018, VPA 2017, VPA 2018)

Abstract

This paper introduces Gotcha, a function wrapping interface and library for HPC tools. Many HPC tools, and performance analysis tools in particular, rely on function wrapping to integrate with applications. But existing mechanisms, such as LD_PRELOAD on Linux, have limitations that lead to tool instability and complexity. Gotcha addresses the limitations in existing mechanisms, provides a programmable interface for HPC tools to manage function wrapping, and supports function wrapping across multiple tools. In addition, this paper introduces the idea of interface-independent function wrapping, which makes it possible for tools to wrap arbitrary application functions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arm map. https://www.arm.com/products/development-tools/server-and-hpc/forge/map

  2. mpiP. http://mpip.sourceforge.net

  3. Totalview for HPC. https://www.roguewave.com/products-services/totalview

  4. Adhianto, L., et al.: HPCTOOLKIT: tools for performance analysis of optimized parallel programs. Concurrency Comput. Pract. Experience 22(6), 685–701 (2010). https://doi.org/10.1002/cpe.v22:6. http://hpctoolkit.org

    Article  Google Scholar 

  5. Atzeni, S., et al.: Archer: effectively spotting data races in large OpenMP applications. In: 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS), pp. 53–62, May 2016. https://doi.org/10.1109/IPDPS.2016.68

  6. Bernat, A.R., Miller, B.P.: Anywhere, any-time binary instrumentation. In: Proceedings of the 10th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools, PASTE 2011, pp. 9–16. ACM, New York (2011). https://doi.org/10.1145/2024569.2024572

  7. Carns, P., et al.: Understanding and improving computational science storage access through continuous characterization. Trans. Storage 7(3), 8:1–8:26 (2011). https://doi.org/10.1145/2027066.2027068

    Article  Google Scholar 

  8. Drepper, U.: How to write shared libraries. https://www.akkadia.org/drepper/dsohowto.pdf

  9. Galarowiz, J.: Open—speedshop. https://openspeedshop.org

  10. Gamblin, T.: MPI wrapper generator, for writing PMPI tool libraries. https://github.com/LLNL/wrap

  11. Gyllenhaal, J., Gamblin, T., Bertsch, A., Musselman, R.: Enabling high job throughput for uncertainty quantification on BG/Q. In: IBM HPC Systems Scientific Computing User Group, (ScicomP 2014) (2014)

    Google Scholar 

  12. Protze, J., Hilbrich, T., Schulz, M., de Supinski, B.R., Nagel, W.E., Mueller, M.S.: MPI runtime error detection with must: a scalable and crash-safe approach. In: 2014 43rd International Conference on Parallel Processing Workshops, pp. 206–215, September 2014. https://doi.org/10.1109/ICPPW.2014.37

  13. Schulz, M., de Supinski, B.R.: PNMPI tools: a whole lot greater than the sum of their parts. In: Proceedings of the 2007 ACM/IEEE Conference on Supercomputing, SC 2007, pp. 1–10, November 2007. https://doi.org/10.1145/1362622.1362663

  14. Schulz, M.: Extending and updating the tool interfaces in MPI: a request for feedback. In: Scalable Tools Workshop 2018 (2018)

    Google Scholar 

  15. Shende, S.S., Malony, A.D.: The TAU parallel performance system. Int. J. High Perform. Comput. Appl. 20(2), 287–311 (2006). https://doi.org/10.1177/1094342006064482

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to David Poliakoff or Matt LeGendre .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Poliakoff, D., LeGendre, M. (2019). Gotcha: An Function-Wrapping Interface for HPC Tools. In: Bhatele, A., Boehme, D., Levine, J., Malony, A., Schulz, M. (eds) Programming and Performance Visualization Tools. ESPT ESPT VPA VPA 2017 2018 2017 2018. Lecture Notes in Computer Science(), vol 11027. Springer, Cham. https://doi.org/10.1007/978-3-030-17872-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-17872-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-17871-0

  • Online ISBN: 978-3-030-17872-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics