Abstract
Conditions in the marketplace for ETL tools suggest that an industry standard benchmark is needed. The benchmark should provide useful data for comparing the performance of ETL systems, be based on a meaningful scenario, and be scalable over a wide range of data set sizes. This paper gives a general scoping of the proposed benchmark and outlines some key decision points. The Transaction Processing Performance Council (TPC) has formed a development subcommittee to define and produce such a benchmark.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wikipedia article, http://en.wikipedia.org/wiki/Extract,_transform,_load
Wikipedia article, http://en.wikipedia.org/wiki/Data_integration
Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit. Wiley, Chichester (2004)
Serlin, O.: The History Of DebitCredit and the TPC, http://research.microsoft.com/en-us/um/people/gray/benchmarkhandbook/chapter2.pdf
Press release, https://www.informatica.com/news/press_releases/2001/default.htm
Press release quoted, http://www.kid.co.za/content/company/product_announcements.asp#58
Press release, http://www.tmcnet.com/usubmit/2005/mar/1126716.htm
Press release quoted, http://www.crm2day.com/content/t6_librarynews_1.php?news_id=114041
Press release, http://www.informatica.com/news_events/press_releases/2005/06062005d_sun.aspx
Press release, http://www.biosmagazine.co.uk/press-release.php?id=7959
Press release, http://www.sas.com/news/preleases/051706/news8.html
Press release, http://www.informatica.com/news_events/press_releases/2006/08142006a_hp_server.aspx
Press release, https://www.jaspersoft.com/nw_press_jaspersoft_etl_talend.html
Press release, http://www.sas.com/news/preleases/041707/news9SASSUN.html
Web log, http://blogs.msdn.com/sqlperf/archive/2008/02/27/etl-world-record.aspx
Press release, http://www.vertica.com/company/news_and_events/Syncsort-and-Vertica-Shatter-Database-ETL-World-Record-Using-HP-BladeSystem-c-Class
Transaction Processing Performance Council, http://tpc.org/tpce/
IBM Corporation, IBM InfoSphere Change Data Capture, http://www-01.ibm.com/software/data/infosphere/change-data-capture/
Oracle Corporation, Asynchronous Change Data Capture Cookbook, http://www.oracle.com/technology/products/bi/db/10g/pdf/twp_cdc_cookbook_0206.pdf
Microsoft Corporation, Change Data Capture, http://msdn.microsoft.com/en-us/library/bb522489.aspx
Kimball, R.: A Dimensional Modeling Manifesto, http://www.dbmsmag.com/9708d15.html
Transaction Processing Performance Council, http://www.tpc.org/tpcc/default.asp
Transaction Processing Performance Council, http://www.tpc.org/tpch/default.asp
Transaction Processing Performance Council, http://www.tpc.org/tpcds/The_Making_of_TPCDS.pdf
Transaction Processing Performance Council, http://www.tpc.org/pricing/default.asp
Transaction Processing Performance Council, http://www.tpc.org/information/TPC-PR-Webcast-Energy.wmv
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wyatt, L., Caufield, B., Pol, D. (2009). Principles for an ETL Benchmark. In: Nambiar, R., Poess, M. (eds) Performance Evaluation and Benchmarking. TPCTC 2009. Lecture Notes in Computer Science, vol 5895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10424-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-10424-4_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10423-7
Online ISBN: 978-3-642-10424-4
eBook Packages: Computer ScienceComputer Science (R0)