skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Using Deep Learning for Automated Communication Pattern Characterization: Little Steps and Big Challenges

Conference ·

Characterization of a parallel application’s communication patterns can be useful for performance analysis, debugging, and system design. However, obtaining and interpreting a characterization can be difficult. AChax implements an approach that uses search and a library of known communication patterns to automatically characterize communication patterns. Our approach has some limitations that reduce its effectiveness for the patterns and pattern combinations used by some real-world applications. By viewing AChax’s pattern recognition problem as an image recognition problem, it may be possible to use deep learning to address these limitations. In this position paper, we present our current ideas regarding the benefits and challenges of integrating deep learning into AChax and our conclusion that a hybrid approach combining deep learning classification, regression, and the existing AChax approach may be the best long-term solution to the problem of parameterizing recognized communication patterns.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
DOE Contract Number:
AC05-00OR22725
OSTI ID:
1509543
Resource Relation:
Journal Volume: 11027; Conference: Fifth International Workshop on Visual Performance Analysis (VPA18) - Dallas, Texas, United States of America - 11/11/2018 10:00:00 AM-11/11/2018 10:00:00 AM
Country of Publication:
United States
Language:
English

References (2)

Using MPI-2 book January 1999
Automated Characterization of Parallel Application Communication Patterns
  • Roth, Philip C.; Meredith, Jeremy S.; Vetter, Jeffrey S.
  • Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing https://doi.org/10.1145/2749246.2749278
conference June 2015

Similar Records

Improved Accuracy for Automated Communication Pattern Characterization Using Communication Graphs and Aggressive Search Space Pruning
Conference · Mon Apr 01 00:00:00 EDT 2019 · OSTI ID:1509543

Deep learning predicts microbial interactions from self-organized spatiotemporal patterns
Journal Article · Wed Jan 01 00:00:00 EST 2020 · Computational and Structural Biotechnology Journal · OSTI ID:1509543

ClimateNet: an expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather
Journal Article · Fri Jan 08 00:00:00 EST 2021 · Geoscientific Model Development (Online) · OSTI ID:1509543

Related Subjects