Abstract
The TPC formed a subcommittee in 2010 to develop TPC V, a benchmark for virtualized databases. We soon discovered two major issues. First, a database benchmark running in a VM, or even a consolidation scenario of a few database VMs, is no longer adequate. There is demand for a benchmark that emulates cloud computing, e.g., a mix of heterogeneous VMs, and dynamic load elasticity for each VM. Secondly, waiting for system or database vendors to develop benchmarking kits to run such a benchmark is problematic. Hence, we are developing a publicly-available, end-to-end reference kit that will run against the open source PostgreSQL DBMS. This paper describes TPC V and the proposed architecture of its reference kit; provides a progress report; and presents results from prototyping experiments with the reference kit.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bose, S., Mishra, P., Sethuraman, P., Taheri, R.: Benchmarking Database Performance in a Virtual Environment. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 167–182. Springer, Heidelberg (2009)
Creasy, R.J.: The Origin of the VM/370 Time-Sharing System. IBM Journal of Research and Development 25(5), 483
Database Test 5 (DBT-5TM), http://sourceforge.net/apps/mediawiki/osdldbt/index.php
Figueiredo, R., Dinda, P.A., Fortes, J.A.B.: Guest Editors’ Introduction: Resource Virtualization Renaissance. Computer 38(5), 28–31 (2005), http://www2.computer.org/portal/web/csdl/doi/10.1109/MC.2005.159
Gartner Identifies the Top 10 Strategic Technologies for (2012), http://www.gartner.com/it/page.jsp?id=1826214
Nanda, S., Chiueh, T.-C.: A Survey on Virtualization Technologies. Technical Report ECSL-TR-179, SUNY at Stony Brook (2005), http://www.ecsl.cs.sunysb.edu/tr/TR179.pdf
Nelson, M., Lim, B.-H., Hutchins, G.: Fast Transparent Migration for Virtual Machines. In: USENIX 2005, pp. 391–394 (April 2005)
Rosenblum, M., Garfinkel, T.: Virtual Machine Monitors: Current Technology and Future Trends. Computer 38(5), 39–47 (2005)
Sethuraman, P., Taheri, R.: TPC-V: A Benchmark for Evaluating the Performance of Database Applications in Virtual Environments. In: Nambiar, R., Poess, M. (eds.) TPCTC 2010. LNCS, vol. 6417, pp. 121–135. Springer, Heidelberg (2011)
SPEC Virtualization Committee, http://www.spec.org/virt_sc2010/
TPC: Detailed TPC-C description, http://www.tpc.org/tpcc/detail.asp
TPC: Detailed TPC-E Description, http://www.tpc.org/tpce/spec/TPCEDetailed.doc
TPC: EGen software package, http://www.tpc.org/tpce/egen-download-request.asp
TPC: TPC Benchmark H Specification, http://www.tpc.org/tpch/spec/tpch2.14.4.pdf
TPC: DBGen and Reference Data Set, http://www.tpc.org/tpch/spec/tpch_2_14_3.zip
TPC: TPC Benchmark DS Specification, http://www.tpc.org/tpcds/spec/tpcds_1.1.0.pdf
VMware, Inc., http://www.vmware.com/products/vmmark/overview.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bond, A., Kopczynski, G., Taheri, H.R. (2013). Two Firsts for the TPC: A Benchmark to Characterize Databases Virtualized in the Cloud, and a Publicly-Available, Complete End-to-End Reference Kit. In: Nambiar, R., Poess, M. (eds) Selected Topics in Performance Evaluation and Benchmarking. TPCTC 2012. Lecture Notes in Computer Science, vol 7755. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36727-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-36727-4_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36726-7
Online ISBN: 978-3-642-36727-4
eBook Packages: Computer ScienceComputer Science (R0)