skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Reproducible network benchmarks with coNCEPTUAL

Conference ·

A cornerstone of scientific progress is the ability to reproduce experimental results. However, in the context of network benchmarking, system complexity impedes a researcher's attempts to record all of the information needed to exactly reconstruct a network-benchmarking experiment. Without this information, results may be misinterpreted and are unlikely to be reproducible. This paper presents a tool called CONCEPTUAL which simplifies most aspects of recording and presenting network performance data. CONCEPTUAL includes two core components: (1) a compiler for a high-level, domain-specific programming language that makes it possible to specify arbitrary communication patterns tersely but precisely and (2) a complementary run-time library that obviates the need for writing (and debugging) all of the mundane but necessary routines needed for benchmarking, such as those that calibrate timers, compute statistics, or output log files. The result is that CONCEPTUAL makes it easy to present network-performance data in a form that promotes reproducibility.

Research Organization:
Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
Sponsoring Organization:
USDOE
OSTI ID:
977460
Report Number(s):
LA-UR-04-0793; TRN: US201009%%778
Resource Relation:
Journal Volume: 3149; Conference: Submitted to Conference "EuroPar 2004"
Country of Publication:
United States
Language:
English