Elsevier

Science of Computer Programming

Volume 95, Part 3, 1 December 2014, Pages 344-358
Science of Computer Programming

Dynamic program analysis—Reconciling developer productivity and tool performance

https://doi.org/10.1016/j.scico.2014.03.014Get rights and content
Under an Elsevier user license
open archive

Highlights

  • We have created the Domain-Specific Language for Instrumentation (DiSL).

  • We assess whether DiSL boosts developer productivity.

  • We perform a controlled experiment.

Abstract

Dynamic program analysis tools serve many important software engineering tasks such as profiling, debugging, testing, program comprehension, and reverse engineering. Many dynamic analysis tools rely on program instrumentation and are implemented using low-level instrumentation libraries, resulting in tedious and error-prone tool development. Targeting this issue, we have created the Domain-Specific Language for Instrumentation (DiSL), which offers high-level programming abstractions especially designed for instrumentation-based dynamic analysis. When designing DiSL, our goal was to boost the productivity of tool developers targeting the Java Virtual Machine, without impairing the performance of the resulting tools. In this paper we assess whether DiSL meets this goal. First, we perform a controlled experiment to measure tool development time and correctness of the developed tools, comparing DiSL with a prevailing, state-of-the-art instrumentation library. Second, we recast 10 open-source software engineering tools in DiSL and compare source code metrics and performance with the original implementations. Our studies show that DiSL significantly improves developer productivity, enables concise tool implementations, and does not have any negative impact on tool performance.

Keywords

Dynamic program analysis
Bytecode instrumentation
Development productivity
Controlled experiment

Cited by (0)