Abstract
Fast, user-centric access to and evaluation of large supercomputing results is a well-recognised problem among compute and data service providers.
In the ESTEDI initiative, research and industry from Europe and beyond cooperate to overcome this obstacle. The basic approach is to augment the highvolume data generators with a database system for the management and extraction of spatio-temporal data. Led by ERCOFTAC (European Research Community on Flow, Turbulence and Combustion), a detailed requirements analysis has been carried out which forms the basis for the specification of a High-Performance Computing (HPC) database platform. Implementation of this platform relies on the multidimensional database system RasDaMan. Evaluation covers all major application fields by HPC centres with in-depth experience in their resp. field.
We introduce the ESTEDI project and give an overview of the data management platform under development.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P. Baumann: A Database Array Algebra for Spatio-Temporal Data and Beyond. Proc. Next Generation Information Technology and Systems NGITS’99, Zikhron Yaakov, Israel, 1999, pp. 76–93.
P. Baumann, P. Furtado, R. Ritsch, N. Widmann: Geo/Environmental and Medical Data Management in the RasDaMan System. Proc. VLDB’97, Athens, Greece, 1997, pp. 548–552.
P. Furtado, P. Baumann: Storage of Multidimensional Arrays Based on Arbitrary Tiling. Proc. ICDE’ 99, Sydney, Australia 1999, pp. 480–489.
J. Hague: Halo Exchange in Mixed Shared and Distributed Memory Processors. 9th Workshop on the Use of High Performance Computing in Meteorology-Developments in Teracomputing, European Centre for Medium-Range Weather Forecast, Reading, UK, 2000.
L. Libkin, R. Machlin, and L. Wong: A Query Language for Multidimensional Arrays: Design, Implementation, and Optimization Techniques. Proc. ACM SIGMOD’96, Montreal, Canada, 1996, pp. 228–239.
A.P. Marathe, K. Salem: Query Processing Techniques for Arrays. Proc. ACM SIGMOD’ 99, Philadelphia, USA, 1999, pp. 323–334.
R. Ritsch: Optimization and Evaluation of Array Queries in Database Management Systems. PhD Thesis, Technische Universität München, 1999.
S. Sarawagi, M. Stonebraker: Efficient Organization of Large Multidimensional Arrays. Proc. ICDE’94, Houston, USA, 1994, pp. 328–336.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Baumann, P. (2001). Grid Services for Fast Retrieval on Large Multidimensional Databases. In: Hertzberger, B., Hoekstra, A., Williams, R. (eds) High-Performance Computing and Networking. HPCN-Europe 2001. Lecture Notes in Computer Science, vol 2110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48228-8_82
Download citation
DOI: https://doi.org/10.1007/3-540-48228-8_82
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42293-8
Online ISBN: 978-3-540-48228-4
eBook Packages: Springer Book Archive