Skip to main content

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 407))

Abstract

Cloud computing has become a powerful distributed computing mode. A Cloud system has a characteristics strength such as scalability and heterogeneity against the traditional distributed paradigm. These characteristics lead to increased numbers of clients needs to access and process data from multiple distributed resources over a cloud environment with widely differing expectations. Therefore, query processing on such an environment needs to be adaptive to handling the concurrent queries. The aim of this paper is to improve the overall performance of the query execution. We focused on enhancing a query merging approach within a query processing architecture. This is done by considering different waiting times of submitted queries, therefore the queries are merged in case they have a positive impact on the query execution performance. The results show that our enhancement can improve the queries execution time over the original technique by 15 % and over the existing merging technique by 60 %.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Samatha, N., Vijay, C.K., Raja, S.R.P.: Query optimization issues for data retrieval in cloud computing. Int. J. Comput. Eng. Res. 2(1361–1364), 22 (2012)

    Google Scholar 

  2. Lang, W., Nehme, R. V. and Rae, I.: Database optimization for the cloud: where costs, partial results, and consumer choice meet. In: Biennial Conference on Innovative Data Systems Research (CIDR’15), California, USA (2015)

    Google Scholar 

  3. Amazon Web Services.: http://aws.amazon.com/

  4. Google Apps.: www.google.com/Apps/Work

  5. Microsoft Azure.: http://azure.microsoft.com/en-us/

  6. Aboulnaga, A., Salem, K., Soror, A. A., Minha, U. F.: Deploying DATABASE APPLIANCES IN THE Cloud. In: IEEE Computer Society Technical Committee on Data Engineering (2009)

    Google Scholar 

  7. Gounaris, A., Smith, J., Paton, N.W., Sakellariou, R., Fernandes, A.A., Watson, P.: Adaptive workload allocation in query processing in autonomous heterogeneous environments. J. Distrib. Parallel Databases 25(3), 125–164 (2009)

    Article  Google Scholar 

  8. Lua, X., Guan, J.: A new approach to building histogram for selectivity estimation in query processing optimization. J. Comput. Math. Appl. 57, 1037–1047 (2009)

    Article  MATH  Google Scholar 

  9. Maghawry, E.A., Ismail, R.M., Badr, N.L., Tolba, M.F.: An enhanced resource allocation approach for optimizing a sub-query on cloud. In: Hassanien, A.E., Salem, A.-B.M., Ramadan, R., Kim, T.-h. (eds.) AMLTA 2012. CCIS, vol. 322, pp. 413–422. Springer, Heidelberg (2012)

    Google Scholar 

  10. Maghawry, E.A., Ismail, R.M., Badr, N.L., Tolba, M.F.: Queries based workload management system for the cloud environment. In: AMLTA 2014, vol. 488, pp. 77–86. Springer, Heidelberg (2014)

    Google Scholar 

  11. Maghawry, E.A., Ismail, R.M., Badr, N.L., Tolba, M.F.: An enhanced queries scheduler for query processing over a cloud environment. In: ICCES, pp. 409–414. IEEE (2014)

    Google Scholar 

  12. Amazon Elastic Compute Cloud (EC2).: http://aws.amazon.com/ec2/

  13. Chen, G., Wu, Y., Liu, J., Yang, G., Zheng, W.: Optimization of sub-query processing in distributed data integration systems. J. Netw. Comput. Appl. 34, 1035–1042 (2011)

    Article  Google Scholar 

  14. Lee, R., Zhou, M., Liao, H.: Request window: an approach to improve throughput of RDBMS-based data integration system by utilizing data sharing across concurrent distributed queries. In: 33rd International Conference on Very Large Data Bases, pp. 1219–1230 (2007)

    Google Scholar 

  15. Liu, S., Karimi, A.H.: Grid query optimizer to improve query processing in grids. Future Gener. Comput. Syst. 24, 342–353 (2008)

    Article  Google Scholar 

  16. Duggan, J., Cetintemel, U., Papaemmanouil, O., Upfal, E.: Performance prediction for concurrent database workloads. In: SIGMOD, pp. 337–348, Athens (2011)

    Google Scholar 

  17. Albuitiu, M.C., Kemper, A.: Synergy based workload management. In: Proceedings of the VLDB Ph.D. Workshop, Lyon (2009)

    Google Scholar 

  18. Paton, N.W., Buenabad, J.C., Chen, M., Raman, V., Swart, G., Narang, I., Yellin, D.M., Fernandes, A.A.A.: Autonomic query parallelization using non-dedicated computers: an evaluation of adaptivity options. VLDB 18, 119–140 (2009)

    Article  Google Scholar 

  19. Shah, M.A., Hellerstein, J.M., Chandrasekaran, S., Franklin, M.J.: Flux: an adaptive partitioning operator for continuous query systems. In: 19th International Conference on Data Engineering, pp. 25–36. IEEE Press (2003)

    Google Scholar 

  20. Raman, V., Han, W., Narang, I.: Parallel querying with non-dedicated computers. In: 31st international conference on Very large databases, pp. 61–72. Trondheim, Norway (2005)

    Google Scholar 

  21. Ganapathi, A., Kuno, H., Daval, U., Wiener, J., Fox, A., Jordan, M., and Patterson, D.: Predicting multiple performance metrics for queries: better decisions enabled by machine learning. In: Proceedings of International Conference on Data Engineering, Shanghai, pp. 592–603, Mar 2009

    Google Scholar 

  22. Luo, G., Naughton, J. F., Yu, P. S.: Multi-query SQL progress indicators. In: Proceedings of the 10th International Conference on Extending Database Technology, pp. 921–941, Munich, March 2006

    Google Scholar 

  23. Duggan, J., Papaemmanouil, O., etintemel, U. C., Upfal, E.: Contender: a resource modeling approach for concurrent query performance prediction. In: Proceedings of International Conference on Extending Database Technology (EDBT) (2014)

    Google Scholar 

  24. Li, J., König, A. C., Narasayya, V., Chaudhuri, S.: Robust estimation of resource consumption for Sql queries using statistical techniques. In: Proceedings of the VLDB Endowment, Istanbul, vol. 5, pp. 1555–1566, July 2012

    Google Scholar 

  25. Avnur, R., Hellerstein, J.M.. Eddies.: continuously adaptive query processing. In: Proceedings of the 2000 ACM SIGMOD international conference on Management of Data, vol. 29, pp. 261–272 (2000)

    Google Scholar 

  26. Tian, F., DeWitt, D.J.: Tuple routing strategies for distributed eddies. In: Aberer, K., Koubarakis, M., Kalogeraki, V. (eds.) Proceedings of the 29th International Conference on Very Large Data Bases, LNCS, vol. 2944, pp. 333–344. Springer, Heidelberg (2004)

    Google Scholar 

  27. Jorg, S., Jens, D., Jorge-Arnulfo, Q.: Runtime measurements in the cloud: observing, analyzing, and reducing variance. In: 36th International Conference on Very Large Data Bases, vol. 3, Singapore (2010)

    Google Scholar 

  28. Transaction Processing and Database Benchmark.: http://www.tpc.org/tpch/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eman A. Maghawry .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Maghawry, E.A., Ismail, R.M., Badr, N.L., Tolba, M.F. (2016). Enhancing Query Optimization Technique by Conditional Merging Over Cloud Computing. In: Gaber, T., Hassanien, A., El-Bendary, N., Dey, N. (eds) The 1st International Conference on Advanced Intelligent System and Informatics (AISI2015), November 28-30, 2015, Beni Suef, Egypt. Advances in Intelligent Systems and Computing, vol 407. Springer, Cham. https://doi.org/10.1007/978-3-319-26690-9_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26690-9_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26688-6

  • Online ISBN: 978-3-319-26690-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics