research-article

Fault Tolerance for OpenSHMEM

Authors:

Pengfei Hao,

Pavel Shamis,

Manjunath Gorentla Venkata,

Swaroop Pophale,

Aaron Welch,

Stephen Poole,

Barbara ChapmanAuthors Info & Claims

PGAS '14: Proceedings of the 8th International Conference on Partitioned Global Address Space Programming Models

Article No.: 23, Pages 1 - 3

https://doi.org/10.1145/2676870.2676894

Published: 06 October 2014 Publication History

Get Access

Abstract

On today's supercomputing systems, faults are becoming a norm rather than an exception. Given the complexity required for achieving expected scalability and performance on future systems, this situation is expected to become worse. The systems are expected to function in a nearly constant presence of faults. To be productive on these systems, programming models will require both hardware and software to be resilient to faults. With the growing importance of PGAS programming model and OpenSHMEM, as a part of HPC software stack, a lack of a fault tolerance model may become a liability for its users. Towards this end, in this paper, we discuss the viability of using checkpoint/restart as a fault-tolerance method for OpenSHMEM, propose a selective checkpoint/restart fault-tolerance model, and discuss challenges associated with implementing the proposed model.

References

[1]

N. Ali, S. Krishnamoorthy, N. Govind, and B. Palmer. A redundant communication approach to scalable fault tolerance in pgas programming models. In Parallel, Distributed and Network-Based Processing (PDP), 2011 19th Euromicro International Conference on, pages 24--31. IEEE, 2011.

Digital Library

Google Scholar

[2]

W. Bland, G. Bosilca, A. Bouteiller, T. Herault, and J. Dongarra. A proposal for user-level failure mitigation in the mpi-3 standard. Department of Electrical Engineering and Computer Science, University of Tennessee, 2012.

Google Scholar

[3]

W. Bland, A. Bouteiller, T. Herault, J. Hursey, G. Bosilca, and J. J. Dongarra. An evaluation of user-level failure mitigation support in MPI. Springer, 2012.

Digital Library

Google Scholar

[4]

T. Curtis and et al. Openshmem application programming interface, 2014.

Google Scholar

[5]

G. E. Fagg and J. J. Dongarra. Building and using a fault-tolerant mpi implementation. International Journal of High Performance Computing Applications, 18(3):353--361, 2004.

Digital Library

Google Scholar

[6]

J. Hursey and R. L. Graham. Preserving collective performance across process failure for a fault tolerant mpi. In Parallel and Distributed Processing Workshops and Phd Forum (IPDPSW), 2011 IEEE International Symposium on, pages 1208--1215. IEEE, 2011.

Digital Library

Google Scholar

[7]

M. Valiev, E. J. Bylaska, N. Govind, K. Kowalski, T. P. Straatsma, H. J. Van Dam, D. Wang, J. Nieplocha, E. Apra, T. L. Windus, et al. Nwchem: a comprehensive and scalable open-source solution for large scale molecular simulations. Computer Physics Communications, 181(9):1477--1489, 2010.

Crossref

Google Scholar

Cited By

View all

Coti CMalony A(2021)DiPOSH: A portable OpenSHMEM implementation for short API‐to‐network pathConcurrency and Computation: Practice and Experience10.1002/cpe.617933:11Online publication date: 4-Feb-2021
https://doi.org/10.1002/cpe.6179
Shahneous Bari MBasu DLu WCurtis TChapman B(2020)Checkpointing OpenSHMEM Programs Using Compiler Analysis2020 IEEE/ACM 10th Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS)10.1109/FTXS51974.2020.00011(51-60)Online publication date: Nov-2020
https://doi.org/10.1109/FTXS51974.2020.00011
Coti CMalony A(2020)On the Road to DiPOSH: Adventures in High-Performance OpenSHMEMParallel Processing and Applied Mathematics10.1007/978-3-030-43229-4_22(250-260)Online publication date: 19-Mar-2020
https://doi.org/10.1007/978-3-030-43229-4_22
Show More Cited By

Index Terms

Fault Tolerance for OpenSHMEM
1. Networks
  1. Network components
  2. Network types
    1. Public Internet

Recommendations

Check-Pointing Approach for Fault Tolerance in OpenSHMEM
OpenSHMEM 2015: Revised Selected Papers of the Second Workshop on OpenSHMEM and Related Technologies. Experiences, Implementations, and Technologies - Volume 9397

Fault tolerance for long running applications is critical to guard against failure of either compute resources or a network. Accomplishing this task in software is non-trivial and there is an added level of complexity for implementing a working model ...
Application-Aware Byzantine Fault Tolerance
DASC '14: Proceedings of the 2014 IEEE 12th International Conference on Dependable, Autonomic and Secure Computing

Byzantine fault tolerance has been intensively studied over the past decade as a way to enhance the intrusion resilience of computer systems. However, state-machine-based Byzantine fault tolerance algorithms require deterministic application processing ...
Process Fault Tolerance: Semantics, Design and Applications for High Performance Computing

With increasing numbers of processors on current machines, the probability for node or link failures is also increasing. Therefore, application-level fault tolerance is becoming more of an important issue for both end-users and the institutions running ...

Comments

Information & Contributors

Information

Published In

PGAS '14: Proceedings of the 8th International Conference on Partitioned Global Address Space Programming Models

October 2014

199 pages

ISBN:9781450332477

DOI:10.1145/2676870

Conference Chair:
Allen D. Malony,
Program Chair:
Jeff Hammond

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing
University of Oregon: University of Oregon

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article
Research
Refereed limited

Conference

PGAS '14

PGAS '14: 8th International Conference on Partitioned Global Address Space Programming Models

October 6 - 10, 2014

OR, Eugene, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
81
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Coti CMalony A(2021)DiPOSH: A portable OpenSHMEM implementation for short API‐to‐network pathConcurrency and Computation: Practice and Experience10.1002/cpe.617933:11Online publication date: 4-Feb-2021
https://doi.org/10.1002/cpe.6179
Shahneous Bari MBasu DLu WCurtis TChapman B(2020)Checkpointing OpenSHMEM Programs Using Compiler Analysis2020 IEEE/ACM 10th Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS)10.1109/FTXS51974.2020.00011(51-60)Online publication date: Nov-2020
https://doi.org/10.1109/FTXS51974.2020.00011
Coti CMalony A(2020)On the Road to DiPOSH: Adventures in High-Performance OpenSHMEMParallel Processing and Applied Mathematics10.1007/978-3-030-43229-4_22(250-260)Online publication date: 19-Mar-2020
https://doi.org/10.1007/978-3-030-43229-4_22
Butelle FCoti C(2018)Distributed Snapshot for Rollback-Recovery with One-Sided Communications2018 International Conference on High Performance Computing & Simulation (HPCS)10.1109/HPCS.2018.00102(614-620)Online publication date: Jul-2018
https://doi.org/10.1109/HPCS.2018.00102
Szynkiewicz MNowicki M(2018)Fault-Tolerance Mechanisms for the Java Parallel Codes Implemented with the PCJ LibraryParallel Processing and Applied Mathematics10.1007/978-3-319-78054-2_28(298-307)Online publication date: 23-Mar-2018
https://doi.org/10.1007/978-3-319-78054-2_28
Qian XSen KHargrove PIancu C(2016)SReplayProceedings of the 2016 International Conference on Supercomputing10.1145/2925426.2926264(1-13)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1145/2925426.2926264
Garg RVienne JCooperman G(2016)System-Level Transparent Checkpointing for OpenSHMEMOpenSHMEM and Related Technologies. Enhancing OpenSHMEM for Hybrid Environments10.1007/978-3-319-50995-2_4(52-65)Online publication date: 15-Dec-2016
https://doi.org/10.1007/978-3-319-50995-2_4
Hao PPophale SShamis PCurtis TChapman B(2015)Check-Pointing Approach for Fault Tolerance in OpenSHMEMRevised Selected Papers of the Second Workshop on OpenSHMEM and Related Technologies. Experiences, Implementations, and Technologies - Volume 939710.1007/978-3-319-26428-8_3(36-52)Online publication date: 4-Aug-2015
https://dl.acm.org/doi/10.1007/978-3-319-26428-8_3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Check-Pointing Approach for Fault Tolerance in OpenSHMEM

Application-Aware Byzantine Fault Tolerance

Process Fault Tolerance: Semantics, Design and Applications for High Performance Computing

Comments

Information

Published In

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations