Skip to main content

Advertisement

SpringerLink
Log in

Materialized view selection applying differential evolution algorithm combined with ensembled constraint handling techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Materialized view selection problem is a NP-hard, constrained optimization problem where the pre-computation of views is censorious for query performance enhancement and expediting the data warehouse tasks. The pervasive presence of disk space and cost constraints heightens the intricacy of constrained optimization Materialized view selection (MVS) problem. Thus, the problem of MVS becomes prominent among data warehouse researchers. In the last few years, various evolutionary algorithms (EA) have been applied for the optimal selection of views. The present study handles the MVS problem using Ensembled Constraint Handling Techniques (ECHT) composed of (i) Self Adaptive Penalty (SP), (ii) ℇ- Constraint (EC) and (iii) Stochastic Ranking (SR) integrated with Differential Evolution (DE) algorithm. Authors have used TPC-H star schema benchmark dataset for testing. Simulated results were compared with three existing work i.e. PSO, genetic algorithm and EA and it was observed that our proposed ensemble method ECHTDEMVS, outperforms than single constraint handling methods and minimizes the total processing cost of query and is scalable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Bezdek, J.C. (2001) What is computational intelligence? In computational intelligence imitating life. NY: IEEE Press, 1994, pg. 1–12.

  2. Biswas Partha P, Suganthan PN, Mallipeddi R, Amaratunga Gehan AJ (2018) Optimal power flow solutions using differential evolution algorithm integrated with effective constraint handling techniques. Eng Appl Artif Intell Vol.68, pg. 81–100.

  3. Boukra A, Nacer MA, Bouroubi S (2007) Selection of views to materialize in data warehouse: a hybrid solution. Int J Comput Intell Res 3(4):327–334

    Article  Google Scholar 

  4. Chaudhuri S, Dayal U (1997) An overview of data warehousing and OLAP technology. ACM SIGMOD Rec 26(1):65–74

    Article  Google Scholar 

  5. Coello Carlos AC (2002) Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art. In: Computer Methods in Applied Mechanics and Engineering, Elsevier, pg. 1245–1287

  6. Coello Carlos AC (2012) Constraint-handling techniques used with evolutionary algorithms. In: Genetic and evolutionary computation conference GECCO’12, ACM

  7. Farmani R, Wright JA (2003) Self-adaptive fitness formulation for constrained optimization. IEEE Trans Evol Comput 7(5):445–455

    Article  Google Scholar 

  8. Golfarelli M, Maniezzo V, Rizzi S (2004) Materialization of fragmented views in multidimensional databases. Data Knowl Eng49, pg 325–335.

  9. Gosain A, Heena (2016) Materialized cube selection using particle swarm optimization algorithm. In: 7th International Conference on Communication, Computing and Virtualization, Elsevier, Vol.79, pg. 2–7

  10. Goswami R, Bhattacharyya DK, Dutta M (2013). Multiobjective differential evolution algorithm using binary encoded data in selecting views for materializing in data warehouse. International Conference on Swarm, Evolutionary, and Memetic Computing, SEMCCO 2013: Swarm, Evolutionary, and Memetic Computing, LNCS, volume 8298, pp. 95–106

  11. Gray J, Layman A, Bosworth A, Pirahesh H (1997) Data cube: a relational aggregation operator generalizing group-by, cross-tabs and subtotals. In Data Min Knowl Disc, Vol.1, Issue.1, pg. 29–53.

  12. Gupta H (1997) Selection of views to materialize in a data warehouse. In: Proceedings of the 6th International Conference on Database Theory, Springer-Verlag, pg.98–112

  13. Gupta H, Mumick IS (1999) Selection of views to materialize under a maintenance cost constraint. In: Proceedings of the 7th International Conference on Database Theory, Springer-Verlag, 453–470

  14. Gupta H, Mumick IS (2005) Selection of views to materialize in a data warehouse. In IEEE Trans Knowl Data Eng, Vol.17, No.1, pg. 24–43.

  15. Gupta H, Harinarayan V, Rajaraman A, Ullman JD (1997) Index selection for OLAP. In: Proceedings of 13th International Conference on Data Engineering, pg. 208–219

  16. Han J, Pei J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufman Publishers, San Francisco

    MATH  Google Scholar 

  17. Harinarayan V, Rajaraman A, Ullman JD (1996) Implementing data cubes efficiently. In: Proceedings of the 1996 ACM SIGMOD international conference on Management of Data, Montreal, Que., Canada, pg. 205–216.

  18. He J, Yao X (2001) Drift analysis and average time complexity of evolutionary algorithms. Artif Intell Elsevier, 127 pg. 57–85.

  19. Hung MC, Huang ML, Yang DL, Hsueh NL (2007) Efficient approaches for materialized views selection in a data warehouse. Inf Sci Elsevier, Vol.177, Issue.6, pg.1333–1348.

  20. Inmon WH, Kelley C (1993) Rdb-VMS: developing a data warehouse. John Wiley & Sons, Inc

  21. Jain H, Gosain A (2012) A comprehensive study of view maintenance approaches in data warehousing evolution. ACM SIGSOFT Softw Eng Notes 37(5):1–8

  22. Kumar Vijay TV, Kumar S (2014) Materialized view selection using differential evolution. Int J Innov Comput Appl 6(2):102–113

    Article  Google Scholar 

  23. Lee M, Hammer J (2001) Speeding up materialized view selection in data warehouses using a randomized algorithm. Int J Coop Inf Syst 10(3):327–353

    Article  Google Scholar 

  24. Lin WY, Kuo IC (2004) A genetic selection algorithm for OLAP data cubes. Knowl Inf Syst Vol.6.1, pg. 83–102.

  25. Mallipeddi R, Suganthan PN (2010) Ensemble of constraint handling techniques. IEEE Trans Evol Comput 14(4):561–579

    Article  Google Scholar 

  26. Morse S, Isaac D (1998) Parallel Systems in the data warehouse. Prentice Hall, Upper saddle River

  27. O’Neil P, O’Neil E, Chen X (2007) The star schema benchmark (SSB). Pat

  28. Qin AK, Huang VL, Suganthan PN (2009) Differential evolution algorithm with strategy adaptation for global numerical optimization. IEEE Trans Evol Comput 13(2):398–417

    Article  Google Scholar 

  29. Rauf M, Abdelmadjid B (2016) Using binary differential evolution to solve materialized views selection problem. International conference on business intelligence and applications (ICBIA) at: Blida Algeria

  30. Runarsson TP, Yao X (2000) Stochastic ranking for constrained evolutionary optimization. IEEE Trans Evol Comput Vol. 4, pg. 284–294.

  31. Shukla A, Deshpande P, Naughton JF (1998) Materialized view selection for multidimensional datasets. In: Proceedings of 24th International Conference on Very Large Data Bases, pg. 488–499

  32. Storn R, Price KD (1997) Differential evolution: A simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11(4):341–359

    Article  MathSciNet  Google Scholar 

  33. Takahama T, Sakai S (2006) Constrained optimization by the constrained differential evolution with gradient-based mutation and feasible elites. In: Proceedings of IEEE congress on evolutionary computation, Vancouver, BC, Canada, pg 1–8

  34. Tessema BG, Yen GG (2006) A self-adaptive penalty function based algorithm for constrained optimization. In: IEEE Congress on Evolutionary Computation, 2006. CEC 2006. IEEE, pp 246–253

  35. Wolpert DH, Macready WG (1997) No free lunch theorems for optimization. IEEE Trans Evol Comput 1(1):67–82

    Article  Google Scholar 

  36. Xu Yu J, Yao X, Choi C H, Gou G, (2003) Materialized view selection as constrained evolutionary optimization. IEEE Trans Syst Man Cybern Part C Appl Rev, Vol. 33, No. 4, pg.458–467.

  37. Yang J, Karlapalem K, Li Q (1997) Algorithms for materialized view design in data warehousing environment. In: VLDB, proceedings of the 23rd international conference on very large data bases Vol 97, pp 136–145

  38. Zhang C, Yao X, Yang J (2001) An evolutionary approach to materialized views selection in a data warehouse environment. IEEE Trans Syst Man Cybern Part C Appl Rev 31(3):282–294

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University School of Information, Communication and Technology, GGS Indraprastha University, New Delhi, 110078, India

    Kavita Sachdeva & Anjana Gosain

Authors
  1. Kavita Sachdeva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anjana Gosain
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kavita Sachdeva.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sachdeva, ., Gosain, A. Materialized view selection applying differential evolution algorithm combined with ensembled constraint handling techniques. Multimed Tools Appl 80, 31619–31645 (2021). https://doi.org/10.1007/s11042-021-11181-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11181-8

Keywords

Search

Navigation