research-article

A configurable benchmark test management framework

Authors:

Naiqiao Du,

Xiaojun Ye,

Jianmin WangAuthors Info & Claims

Internetware '09: Proceedings of the First Asia-Pacific Symposium on Internetware

Article No.: 25, Page 1

https://doi.org/10.1145/1640206.1640231

Published: 17 October 2009 Publication History

Get Access

Abstract

By looking over the performance benchmarks, we found that test systems are becoming more and more complex [1]. It is expensive for academe to implement every benchmark systems from scratch, as well as the customized benchmarks, to measure particular system under test (SUT). We propose a configurable benchmark test management framework, which gives a structure intended to serve as a support or guide for the building of testbed benchmark systems that expands the reference architecture into something useful in internetware components benchmark and real system performance evaluation.

References

[1]

Transaction Processing Performance Council, TPC-C/App/E BENCHMARK Specification, www.tpc.org.

Google Scholar

[2]

X. J. Ye, J. M. Xie, J. M. Wang, H. Tang and N. Q. Du, An Approach of Performance Evaluation in Authentic Database Applications, In the Proc. of TPCTC 2009, Lyon, France.

Digital Library

Google Scholar

[3]

N. Q. Du, X. J. Ye, and J. M. Wang, Toward Workflow-Driven Database System Workload Modeling, In the Proc. of DBTest 2009, Providence, USA.

Digital Library

Google Scholar

Recommendations

Subsetting the SPEC CPU2006 benchmark suite

On August 24, 2006, the Standard Performance Evaluation Corporation (SPEC) announced CPU2006 -- the next generation of industry-standardized CPU-intensive benchmark suite. The SPEC CPU benchmark suite has become the most frequently used suite for ...
A Benchmark Characterization of the EEMBC Benchmark Suite

Benchmark consumers expect benchmark suites to be complete, accurate, and consistent, and benchmark scores serve as relative measures of performance. However, it is important to understand how benchmarks stress the processors that they aim to test. This ...
Requirements-driven database systems benchmark method

Benchmarks are the vital tools in the performance measurement, evaluation, and comparison of relational database management systems (RDBMS). Standard benchmarks such as the TP1, TPC-A, TPC-B, TPC-C, TPC-D, TPC-H, TPC-R, TPC-W, Wisconsin, and AS³ Ap ...

Comments

Information & Contributors

Information

Published In

Internetware '09: Proceedings of the First Asia-Pacific Symposium on Internetware

October 2009

150 pages

ISBN:9781605588728

DOI:10.1145/1640206

Program Chairs:
Fuqing Yang,
Hong Mei,
Jian Lv

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

Internetware '09

Sponsor:

Internetware '09: First Asia-Pacific Symposium on Internetware

October 17 - 18, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
86
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Index Terms

Recommendations

Subsetting the SPEC CPU2006 benchmark suite

A Benchmark Characterization of the EEMBC Benchmark Suite

Requirements-driven database systems benchmark method

Comments

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Login options

Full Access

PDF

eReader

Abstract

References

Index Terms

Recommendations

Subsetting the SPEC CPU2006 benchmark suite

A Benchmark Characterization of the EEMBC Benchmark Suite

Requirements-driven database systems benchmark method

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations