Memory Compression Techniques for Network Address Management in MPI
MPI allows applications to treat processes as a logical collection of integer ranks for each MPI communicator, while internally translating these logical ranks into actual network addresses. In current MPI implementations the management and lookup of such network addresses use memory sizes that are proportional to the number of processes in each communicator. In this paper, we propose a new mechanism, called AV-Rankmap, for managing such translation. AV-Rankmap takes advantage of logical patterns in rank-address mapping that most applications naturally tend to have, and it exploits the fact that some parts of network address structures are naturally more performance critical than others. It uses this information to compress the memory used for network address management. We demonstrate that AV-Rankmap can achieve performance similar to or better than that of other MPI implementations while using significantly less memory.
- Research Organization:
- Argonne National Lab. (ANL), Argonne, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- AC02-06CH11357
- OSTI ID:
- 1366311
- Resource Relation:
- Conference: 31st IEEE International Parallel and Distributed Processing Symposium , 05/29/17 - 06/02/17, Orlando, FL, USA
- Country of Publication:
- United States
- Language:
- English
Similar Records
Optimizing point‐to‐point communication between adaptive MPI endpoints in shared memory
IMPACC: A Tightly Integrated MPI+OpenACC Framework Exploiting Shared Memory Parallelism