Skip to main content

Adapting to Changing Resource Performance in Grid Query Processing

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3836))

Abstract

The Grid provides facilities that support the coordinated use of diverse resources, and consequently, provides new opportunities for wide-area query processing. However, Grid resources, as well as being heterogeneous, may also exhibit unpredictable, volatile behaviour. Thus, query processing on the Grid needs to be adaptive, in order to cope with evolving resource characteristics, such as machine load. To address this challenge, an architecture is proposed that has been empirically evaluated over a prototype Grid-enabled adaptive query processor instantiating it.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alpdemir, N., Mukherjee, A., Gounaris, A., Paton, N.W., Watson, P., Fernandes, A.A.A.: OGSA-DQP: A grid service for distributed querying on the grid. In: Bertino, E., Christodoulakis, S., Plexousakis, D., Christophides, V., Koubarakis, M., Böhm, K., Ferrari, E. (eds.) EDBT 2004. LNCS, vol. 2992, pp. 858–861. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  2. Arpaci-Dusseau, R., Anderson, E., Treuhaft, N., Culler, D., Hellerstein, J., Patterson, D., Yelick, K.: Cluster I/O with River: Making the fast case common. In: Proc. of the Sixth IOPADS Workshop, pp. 10–22 (1999)

    Google Scholar 

  3. Avnur, R., Hellerstein, J.: Eddies: continuously adaptive query processing. In: Proc. of ACM SIGMOD 2000, pp. 261–272 (2000)

    Google Scholar 

  4. Babu, S., Bizarro, P.: Adaptive query processing in the looking glass. In: CIDR, pp. 238–249 (2005)

    Google Scholar 

  5. Braumandl, R., Keidl, M., Kemper, A., Kossmann, K., Kreutz, A., Seltzsam, S., Stocker, K.: ObjectGlobe: Ubiquitous query processing on the Internet. VLDB Journal 10(1), 48–71 (2001)

    MATH  Google Scholar 

  6. Chandrasekaran, S., Franklin, M.: PSoup: a system for streaming queries over streaming data. VLDB Journal 12, 140–156 (2003)

    Article  Google Scholar 

  7. Chaudhuri, S., Narasayya, V., Ramamurthy, R.: Estimating progress of execution for sql queries. In: Proc. of ACM SIGMOD, pp. 803–814 (2004)

    Google Scholar 

  8. Cherniack, M., Balakrishnan, H., Balazinska, M., Carney, D., Cetintemel, U., Xing, Y., Zdonik, S.: Scalable distributed stream processing. In: CIDR (2003)

    Google Scholar 

  9. Deshpande, A., Hellerstein, J.M.: Lifting the burden of history from adaptive query processing. In: Proc. of 30th VLDB Conf., pp. 948–959 (2004)

    Google Scholar 

  10. Gounaris, A., Paton, N.W., Fernandes, A.A.A., Sakellariou, R.: Self monitoring query execution for adaptive query processing. Data and Knowledge Engineering 51(3), 325–348 (2004)

    Article  Google Scholar 

  11. Gounaris, A., Sakellariou, R., Paton, N.W., Fernandes, A.A.A.: Resource scheduling for parallel query processing on computational grids. In: Proc. of 5th IEEE/ACM GRID Workshop, pp. 396–401 (2004)

    Google Scholar 

  12. Graefe, G.: Encapsulation of parallelism in the Volcano query processing system. In: Proc. of ACM SIGMOD, pp. 102–111 (1990)

    Google Scholar 

  13. Graefe, G.: Query evaluation techniques for large databases. ACM Computing Surveys 25(2), 73–170 (1993)

    Article  Google Scholar 

  14. Ives, Z., Halevy, A., Weld, D.: Adapting to source properties in processing data integration queries. In: Proc. of ACM SIGMOD, pp. 395–406 (2004)

    Google Scholar 

  15. Kossmann, D.: The state of the art in distributed query processing. ACM Computing Surveys 32(4), 422–469 (2000)

    Article  Google Scholar 

  16. Liu, D.T., Franklin, M.J., Parekh, D.: GridDB: a relational interface for the grid. In: Proc. of ACM SIGMOD, pp. 660–660 (2003)

    Google Scholar 

  17. Shah, M., Hellerstein, J., Chandrasekaran, S., Franklin, M.: Flux: An adaptive partitioning operator for continuous query systems. In: Proc. of ICDE, pp. 25–36 (2003)

    Google Scholar 

  18. Smith, J., Watson, P.: Fault-tolerance in distributed query processing. Technical Report CS-TR-893, School of Computing Science, The University of Newcastle upon Tyne (2004)

    Google Scholar 

  19. Tian, F., DeWitt, D.: Tuple routing strategies for distributed eddies. In: Proc. of 29th VLDB Conference, pp. 333–344 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gounaris, A., Smith, J., Paton, N.W., Sakellariou, R., Fernandes, A.A.A., Watson, P. (2006). Adapting to Changing Resource Performance in Grid Query Processing. In: Pierson, JM. (eds) Data Management in Grids. DMG 2005. Lecture Notes in Computer Science, vol 3836. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11611950_4

Download citation

  • DOI: https://doi.org/10.1007/11611950_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-31212-3

  • Online ISBN: 978-3-540-32452-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics