Abstract
Large-scale scientific simulations generate petascale data sets subsequently analyzed by groups of researchers, often in databases. We developed a software library, MPI-DB, to provide database services to scientific computing applications. As a bridge between CPU-intensive and data-intensive computations, MPI-DB exploits massive parallelism within large databases to provide scalable, fast service. It is built as a client-server framework, using MPI, with MPI-DB server acting as an intermediary between the user application running an MPI-DB client and the database servers. MPI-DB provides high-level objects such as multi-dimensional arrays, acting as an abstraction layer that effectively hides the database from the end user.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dobos, L., Csabai, I., Milovanovic, M., Budavari, T., Szalay, A.S., Tintor, M., Blakeley, J., Jovanovic, A., Tomic, D.: Array requirements for scientific applications and an implementation for microsoft sql server. In: Baumann, P. (ed.) Proc. of the EDBT/ICDT 2011 Workshop on Array Databases, Uppsala, Sweden (2011)
Lemson, G., The Virgo Consortium: Halo and galaxy formation histories from the millennium simulation: Public release of a vo-oriented database (2006)
Springel, V., White, S.D.M., Jenkins, A., Frenk, C.S., Yoshida, N., Gao, L., Navarro, J., Thacker, R., Croton, D., Helly, J., Peacock, J.A., Cole, S., Thomas, P., Couchman, H., Evrard, A., Colberg, J., Pearce, F.: Simulations of the formation, evolution and clustering of galaxies and quasars, vol. 435, pp. 629–636 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Givelberg, E., Szalay, A., Kanov, K., Burns, R. (2011). MPI-DB, A Parallel Database Services Software Library for Scientific Computing. In: Cotronis, Y., Danalis, A., Nikolopoulos, D.S., Dongarra, J. (eds) Recent Advances in the Message Passing Interface. EuroMPI 2011. Lecture Notes in Computer Science, vol 6960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24449-0_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-24449-0_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24448-3
Online ISBN: 978-3-642-24449-0
eBook Packages: Computer ScienceComputer Science (R0)