Abstract
This paper presents the CITY benchmark. Its design is based on the results of several in-depth studies at several large UK organisations. These studies examined over 4800 applications, and investigated over 40,000,000 transactions accessing around 5000 tables. The work revealed a common access pattern between all the organisations, despite the different nature of these environments. The benchmark shows significant deviation from the established TPC-A script and the TPC-B script when tested in a range of environments, ranging from standalone PC to large mainframe computers and multiprocessors.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
Anon et al. “A Measure of Transaction Power.” Datamation, April 1, 1985.
Bitton, D., DeWitt D., and Turbyfill, C., “Benchmarking Database Systems: A Systematic Approach.” Proc. VLDB Conf., IEEE Press, 1983.
Bitton D., Hanrahan M.and Turbyfill, C., “Performance of Complex Transactions in Main Memory Database Systems” Proc. International Conf. on Third Data Engineering, Feb. 1987.
Haran Boral, and David J. DeWitt. “A Methodology for Database System Performance Evaluation.” Proc. SIGMOD Conf., Boston, June 1984.
DeWitt, D. J. “Benchmarking Database Systems: Past Efforts and Future Directions.” Database Eng., IEEE Computer Society Press, Vol.4, 1985.
Dongarra, J., et al., “Computer Benchmarking: Paths and Pitfalls” IEEE Spectrum., 24:7, July 1987.
Ferreri, D. “Computer System Performance Evaluation.” Printice-Hall Inc., Englewood, Cliffs, New Jersey, 1978.
Ferreri, D., Serazzi, G., and Zeigner, A. “Measurement and Tuning of Computer Systems.” Printice-Hall Inc., Englewood, Cliffs, New Jersey, 1983.
Fox, R. “Benchmarking or Benchmarketing?”. Computer Weekly, April 20, 1989, page 36.
Gray J., “The Benchmark Handbook”, Morgan Kaufmann, 1991.
Hawng H. and Yu Y. “An Analytical Method for Estimating and Interpreting Query Time” Proc. of 13th VLDB Conference, Brighton, 1987, 347–357.
Hawthorn, P. “Variations on A Benchmark.” Database Eng., IEEE Computer Society Press, Vol. 4, 1985.
Revell, N. and Youssef, M. W. “An Analysis of Database Performance Measures.” Proc. of EMCSR, Apr. 1990.
Revell, N. and Youssef, M. W. “An Analysis of Transaction Behaviour in Large IMS Environment.” Proc. of EMCSR, Apr. 1992. “Best Paper Award for the Symposium Communication and Computers”.
Revell, N. and Youssef, M. W. “TP1: The Fact and The Myth.” Proc. of SEARCC 1992
Serlin, O. “MIPS, DHRYSTONES, and Other Tales.” Datamation (USA), Vol. 32, pp. 112–118, June 1986.
Stonebraker, M. “Tips On Benchmarking Database Systems.” Database Eng., IEEE Computer Society Press, Vol.4, 1985.
Transaction Processing Council. TPC Benchmark A Standard. November 1989.
Turbyfill, C. “Comparative Benchmarking of Relational Database Systems” Ph.D Dissertation. Cornell University, Jan. 1988.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Revell, N., Youssef, M.W. (1993). Database performance evaluation a methodological approach. In: Mařík, V., Lažanský, J., Wagner, R.R. (eds) Database and Expert Systems Applications. DEXA 1993. Lecture Notes in Computer Science, vol 720. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57234-1_23
Download citation
DOI: https://doi.org/10.1007/3-540-57234-1_23
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-57234-3
Online ISBN: 978-3-540-47982-6
eBook Packages: Springer Book Archive