Skip to main content
Springer Nature Link
Log in

Hybrid Parallelization Techniques

  • Chapter
  • First Online:
The Art of High Performance Computing for Computational Science, Vol. 1

  • 1137 Accesses

Abstract

This chapter explains the techniques of hybrid parallel execution to establish 10,000 more parallel executions and reduce communication time. Several terms are defined in the discussion of hybrid parallel execution. In addition, actual examples of hardware and programming for parallel execution are shown. Finally, an experimental methodology to develop hybrid MPI execution is shown.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    Performance goes down dramatically if a programmer does not carefully think about optimization of memory access due to frequently far memory accesses on the ccNUMA organization. Hence, even if users can use such a machine with a large amount of memory, the users may not obtain the desired performance of parallel execution.

References

  1. Manual for Large-Scale Visualization System UV2000, Information Technology Center (Nagoya University, 2016), http://www.icts.nagoya-u.ac.jp/ja/sc/pdf/uv2000manual_20160311.pdf

  2. P.S. Pacheco, Parallel Programming with MPI (Morgan Kaufmann, 1996)

    Google Scholar 

  3. NVIDIA NVLINK, http://www.nvidia.com/object/nvlink.html

  4. ScaLAPACK―Scalable Linear Algebra PACKage, http://www.netlib.org/scalapack/

  5. LAPACK–Linear Algebra PACKage, http://www.netlib.org/lapack/

  6. BLAS (Basic Linear Algebra Subprograms), http://www.netlib.org/blas/

Download references

Author information

Authors and Affiliations

  1. Information Technology Center, Nagoya University, Nagoya, Japan

    Takahiro Katagiri

Authors
  1. Takahiro Katagiri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Takahiro Katagiri .

Editor information

Editors and Affiliations

  1. Osaka University, Toyonaka, Osaka, Japan

    Masaaki Geshi

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Katagiri, T. (2019). Hybrid Parallelization Techniques. In: Geshi, M. (eds) The Art of High Performance Computing for Computational Science, Vol. 1. Springer, Singapore. https://doi.org/10.1007/978-981-13-6194-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-6194-4_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-6193-7

  • Online ISBN: 978-981-13-6194-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics