skip to main content
article
Free Access

Benchmark semantics

Published:01 March 1991Publication History
Skip Abstract Section

Abstract

Be careful when interpreting benchmark measurements that compare two languages or two implementations of the same language. A program expressed in two different languages rarely computes the exact same function in both cases. The same goes for a program run on two different implementations of the same language. The implementation details ultimately affect the language semantics as well as the benchmark performance. Here are some simple examples of this effect.

References

  1. D. B. Cooper, Standard Pascal User Reference Manual, W.W. Norton & Co., New York 1983 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. G. Birtwistle, L. Enderin, M. Ohlin, and J. Palme, Decsystem-10 Simula Language Handbook, 1977 Swedish National Defense InstituteGoogle ScholarGoogle Scholar
  3. C. W. Gear, PL/I and PL/C Language Manual Science Research Assoc, Inc. 1978Google ScholarGoogle Scholar
  4. G. L. Steele, Common LISP: the Language, Digital Press, 1984 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. A. Goldberg & D. Robson, Smalltalk-80: the Language and its Implementation, Addison-Wesley, Reading, Mass. 1983 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. R. P. Gabriel, Performance and Evaluation of Lisp Systems MIT Press, Cambridge, Mass. 1985 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. R. A. O'Keffe, Prolog Compared with Lisp? SIGPLAN Notices, vol. 18 #5 (May 1983) Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Benchmark semantics

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Published in

              cover image ACM SIGMETRICS Performance Evaluation Review
              ACM SIGMETRICS Performance Evaluation Review  Volume 18, Issue 4
              April 1991
              22 pages
              ISSN:0163-5999
              DOI:10.1145/122289
              Issue’s Table of Contents

              Copyright © 1991 Author

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 1 March 1991

              Check for updates

              Qualifiers

              • article

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader