Abstract
Modern scientific applications are producing vast amounts of data[2]. In many cases, the essential information needed for understanding scientific processes is stored in a relatively small number of data records. Efficiently locating the interesting data records is indispensable to the overall analysis procedure. The data structures most effective at performing these search operations is known as indices [2]. This work implements a flexible way of applying such an index to a range of different scientific data.
This work was supported by the Director, Office of Science, Office of Advanced Scientific Computing Research, of the U.S. Department of Energy under Contract No. DE-AC02-05CH11231. The authors would also like to thank Allen Sanderson, John Shalf, Quincey Koziol and Wes Bethel for the helpful discussions leading up to the design and specification of FastQuery API.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Gosink, L., Shalf, J., Stockinger, K., Wu, K., Bethel, W.: HDF5-FastQuery: Accelerating complex queries on HDF datasets using fast bitmap indices. In: SSDBM, pp. 149–158 (2006)
Shoshani, A., Rotem, D. (eds.): Scientific Data Management: Challenges, Technology, and Deployment, ch. 6. Chapman & Hall/CRC Press (2010)
Wu, K., Ahern, S., Bethel, E.W., Chen, J., Childs, H., Cormier-Michel, E., Geddes, C., Gu, J., Hagen, H., Hamann, B., Koegler, W., Lauret, J., Meredith, J., Messmer, P., Otoo, E., Perevoztchikov, V., Poskanzer, A., Prabhat, O.R., Shoshani, A., Sim, A., Stockinger, K., Weber, G., Zhang., W.-M.: FastBit: Interactively searching massive data. In: SciDAC (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chou, J., Wu, K., Prabhat (2011). FastQuery: A General Indexing and Querying System for Scientific Data. In: Bayard Cushing, J., French, J., Bowers, S. (eds) Scientific and Statistical Database Management. SSDBM 2011. Lecture Notes in Computer Science, vol 6809. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22351-8_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-22351-8_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22350-1
Online ISBN: 978-3-642-22351-8
eBook Packages: Computer ScienceComputer Science (R0)