skip to main content
10.1145/2642769.2642797acmotherconferencesArticle/Chapter ViewAbstractPublication Pageseurompi-asiaConference Proceedingsconference-collections
research-article

Optimizations to enhance sustainability of MPI applications

Published: 09 September 2014 Publication History

Abstract

Ultrascale computing systems are likely to reach speeds of two or three orders of magnitude greater than today's computing systems. However, to achieve this level of performance, we need to design and implement more sustainable solutions for ultra-scale computing systems, at both the hardware and software levels, while understanding sustainability in a holistic manner in order to address challenges in economy-of-scale, agile elastic scalability, heterogeneity, programmability, fault resilience, energy efficiency, and storage. Some solutions could be integrated into MPI, but others should be devised as higher level concepts, less general, but adapted to applicative domains, possibly as programming patterns or libraries. In this paper, we layout some proposals to extend MPI to cover major relevant domains in a move towards sustainability, including: MPI programming optimizations and programming models, resilience, data management, and their usage for applications.

References

[1]
W. Bland, A. Bouteiller, T. Herault, J. Hursey, G. Bosilca, and J. Dongarra. An evaluation of user-level failure mitigation support in mpi. DOI 10.1007/s00607-013-0331-3:1--14, May 2013.
[2]
G. Bosilca, A. Bouteiller, T. Herault, Y. Robert, and J. Dongarra. Assessing the impact of abft and checkpoint composite strategies. In 16th Workshop on Advances in Parallel and Distributed Computational Models, IPDPS 2014, Phoenix, AZ, May 2014.
[3]
A. B. C. Symeonidou, P. Pratikakis and D. Nikolopoulos. Drasync: Distributed region-based memory allocation and synchronization. In Proceedings of the 20th European MPI UsersâĂŹ Group Meeting. EuroMPI âĂŹ13, page 49âĂŞ54. ACM, 2013.
[4]
K. Dichev, V. Rychkov, and A. Lastovetsky. Two algorithms of irregular scatter/gather operations for heterogeneous platforms. In Recent Advances in the Message Passing Interface, pages 289--293. Springer Berlin Heidelberg, 2010.
[5]
R. Filgueira, J. Carretero, D. E. Singh, A. Calderon, and A. NuÃśez. Dynamic-compi: Dynamic optimization techniques for mpi parallel applications. The Journal of Supercomputing, 59(1):361--391, April 2012.
[6]
J. D. S. P. P. G. T. F. H. M. H. Jordan, P. Thoman. A multi-objective auto-tuning framework for parallel codes. In Proc. of the Intl. Conference for High Performance Computing, Networking, Storage and Analysis (SC 2012). IEEE Computer Society Press, 2012.
[7]
K. Hasanov, J.-N. Quintin, and A. Lastovetsky. Hierarchical approach to optimization of parallel matrix multiplication on large-scale platforms. The Journal of Supercomputing, pages 1--24, 2014.
[8]
F. Isaila, F. J. Garcia Blas, J. Carretero, W.-K. Liao, and A. Choudhary. A Scalable Message Passing Interface Implementation of an Ad-Hoc Parallel I/O System. Int. J. High Perform. Comput. Appl., 24(2):164--184, May 2010.
[9]
G. Martin, M.-C. Marinescu, D. E. Singh, and J. Carretero. FLEX-MPI: an MPI extension for supporting dynamic load balancing on heterogeneous non-dedicated systems. In International European Conference on Parallel and Distributed Computing, EuroPar, 2013.
[10]
D. N. M. S. T. G. S. Lyberis, P. Pratikakis and B. de Supinski. The myrmics memory allocator: hierarchical, message-passing allocation for global address spaces. In Proceedings of the International Symposium on Memory Management. 2012.
[11]
Q. Zhang, J. Wang, G. D. Guerrero, J. M. Cecilia, J. M. García, Y. Li, H. Pérez-Sánchez, and T. Hou. Accelerated Conformational Entropy Calculations Using Graphic Processing Units. Journal of chemical information and modeling, 53(8):2057--2064, Aug. 2013.

Cited By

View all
  • (2024)Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future OpportunitiesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.340676435:9(1551-1564)Online publication date: Sep-2024
  • (2022)A Survey on Malleability Solutions for High-Performance Distributed ComputingApplied Sciences10.3390/app1210523112:10(5231)Online publication date: 22-May-2022
  • (2018)Enhancing large-scale docking simulation on heterogeneous systemsFuture Generation Computer Systems10.5555/3170017.317025679:P1(26-37)Online publication date: 1-Feb-2018
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
EuroMPI/ASIA '14: Proceedings of the 21st European MPI Users' Group Meeting
September 2014
183 pages
ISBN:9781450328753
DOI:10.1145/2642769
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • Kyoto University: Kyoto University
  • University of Tokyo
  • University of Tsukuba: University of Tsukuba

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 September 2014

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. MPI
  2. Optimizations
  3. Parallel architectures
  4. Sustainability

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

EuroMPI/ASIA '14

Acceptance Rates

EuroMPI/ASIA '14 Paper Acceptance Rate 18 of 39 submissions, 46%;
Overall Acceptance Rate 18 of 39 submissions, 46%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)6
  • Downloads (Last 6 weeks)1
Reflects downloads up to 17 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Malleability in Modern HPC Systems: Current Experiences, Challenges, and Future OpportunitiesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.340676435:9(1551-1564)Online publication date: Sep-2024
  • (2022)A Survey on Malleability Solutions for High-Performance Distributed ComputingApplied Sciences10.3390/app1210523112:10(5231)Online publication date: 22-May-2022
  • (2018)Enhancing large-scale docking simulation on heterogeneous systemsFuture Generation Computer Systems10.5555/3170017.317025679:P1(26-37)Online publication date: 1-Feb-2018
  • (2018)Accelerating Drugs Discovery with Deep Reinforcement LearningWorkshop Proceedings of the 47th International Conference on Parallel Processing10.1145/3229710.3229731(1-8)Online publication date: 13-Aug-2018
  • (2018)Energy‐based tuning of metaheuristics for molecular docking on multi‐GPUsConcurrency and Computation: Practice and Experience10.1002/cpe.468430:17Online publication date: 25-May-2018
  • (2016)Enhancing Metaheuristic-based Virtual Screening Methods on Massively Parallel and Heterogeneous SystemsProceedings of the 7th International Workshop on Programming Models and Applications for Multicores and Manycores10.1145/2883404.2883413(50-58)Online publication date: 12-Mar-2016
  • (2016)Improving the Energy Efficiency of MPI Applications by Means of Malleability2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP)10.1109/PDP.2016.98(627-634)Online publication date: Feb-2016
  • (2016)Dynamic load balancing on heterogeneous clusters for parallel ant colony optimizationCluster Computing10.1007/s10586-016-0534-419:1(1-11)Online publication date: 1-Mar-2016
  • (2015)Exascale Machines Require New Programming Paradigms and RuntimesSupercomputing Frontiers and Innovations: an International Journal10.14529/jsfi1502012:2(6-27)Online publication date: 6-Apr-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media