SharP Unified Memory Allocator: An Intent-Based Memory Allocator for Extreme-Scale Systems
The pre-exascale systems will soon be deployed with a deep, complex memory hierarchy composed of many heterogeneous memories. This presents multiple challenges for users including: how to allocate data objects with locality between memories and devices for the various memories in these systems, which includes DRAM, High-bandwidth Memory (HBM), and non-volatile random access memory (NVRAM), and how to perform these allocations while providing portability for their application. Currently, the user can make use of multiple, disjoint libraries to allocate data objects on these memories. However, it is difficult to obtain locality between memories and devices when using libraries that are unaware of each other. This paper presents the Unified Memory Allocator (UMA) of the SHARed data-structure centric Programming abstraction (SharP) library, which provides a unified interface for memory allocations across DRAM, HBM, and NVRAM and is extensible to support future memory types. In addition, the SharP UMA allows for portability between systems by supporting both explicit and implicit, intent-based memory allocations. To demonstrate the ease of use of the SharP UMA, we have extended both Open MPIand OpenSHMEM-Xto support SharP. We validate this work by evaluating the performance implications and intent-based approach with synthetic benchmarks as well as adaptations of the Graph500 benchmark.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1468045
- Resource Relation:
- Journal Volume: 11014; Conference: International Conference on Parallel and Distributed Computing (Euro-Par 2018) - Turin, , Italy - 8/27/2018 12:00:00 PM-8/31/2018 8:00:00 AM
- Country of Publication:
- United States
- Language:
- English
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns
|
journal | December 2014 |
Hoard: a scalable memory allocator for multithreaded applications
|
journal | November 2000 |
SharP: Towards Programming Extreme-Scale Systems with Hierarchical Heterogeneous Memory
|
conference | August 2017 |
Similar Records
SharP Data Constructs: Data Constructs to Enable Data-Centric Computing
Makalu: fast recoverable allocation of non-volatile memory