Abstract
In the era of Big Data and AI, it is challenging to know all technical and business advantages of the emerging technologies. The goal of DataBench is to design a benchmarking process helping organizations developing Big Data Technologies (BDT) to reach for excellence and constantly improve their performance, by measuring their technology development activity against parameters of high business relevance. This paper focuses on the internals of the DataBench framework and presents our methodological workflow and framework architecture.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
D3.1 DataBench Architecture, DataBench Toolbox (2018). https://www.databench.eu/wp-content/uploads/2018/10/databench-d3.1-ver.1.0.pdf
DataBench (2019). https://www.databench.eu
D3.2 DataBench toolbox alpha including support for reusing of existing benchmarks, DataBench toolbox (2019). https://www.databench.eu
Gao, W., et al.: AIBench: towards scalable and comprehensive datacenter AI benchmarking. In: Zheng, C., Zhan, J. (eds.) Bench 2018. LNCS, vol. 11459, pp. 3–9. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32813-9_1
Gao, W., et al.: Aibench: an industry standard internet service AI benchmark suite (2019). CoRR abs/1908.08998. http://arxiv.org/abs/1908.08998
Han, R., John, L.K., Zhan, J.: Benchmarking big data systems: a review. IEEE Trans. Serv. Comput. 11(3), 580–597 (2018). https://doi.org/10.1109/TSC.2017.2730882
Ivanov, T., Rabl, T., Poess, M., Queralt, A., Poelman, J., Poggi, N., Buell, J.: Big data benchmark compendium. In: Nambiar, R., Poess, M. (eds.) TPCTC 2015. LNCS, vol. 9508, pp. 135–155. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-31409-9_9
Ivanov, T., et al.: Databench: evidence based big data benchmarking to improve business performance. In: KDD 2018 Project Showcase Track (2018). https://www.kdd.org/kdd2018/files/project-showcase/KDD18_paper_1805.pdf
Kumar, S., et al.: Scale MLPerf-0.6 models on google TPU-v3 pods (2019). CoRR abs/1909.09756. http://arxiv.org/abs/1909.09756
Mattson, P., et al.: MLPerf training benchmark (2019). CoRR abs/1910.01500. http://arxiv.org/abs/1910.01500
Pernici, B., et al.: Relating big data business and technical performance indicators. In: Conference of the Italian Chapter of AIS, pp. 1–12 (2018)
D5.3 Assessment of technical usability, relevance, scale, complexity (2019). https://www.databench.eu
Verma, S., et al.: Demystifying the MLPerf benchmark suite (2019). CoRR abs/1908.09207. http://arxiv.org/abs/1908.09207
Acknowledgements
This work has been partially funded by the European Commission H2020 project DataBench - Evidence Based Big Data Benchmarking to Improve Business Performance, under project No. 780966. This work expresses the opinions of the authors and not necessarily those of the European Commission. The European Commission is not liable for any use that may be made of the information contained in this work. The authors thank all the participants in the project for discussions and common work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Ivanov, T. et al. (2020). Building the DataBench Workflow and Architecture. In: Gao, W., Zhan, J., Fox, G., Lu, X., Stanzione, D. (eds) Benchmarking, Measuring, and Optimizing. Bench 2019. Lecture Notes in Computer Science(), vol 12093. Springer, Cham. https://doi.org/10.1007/978-3-030-49556-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-49556-5_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49555-8
Online ISBN: 978-3-030-49556-5
eBook Packages: Computer ScienceComputer Science (R0)