Skip to main content

Evaluating Maintenance Policies for Externally Materialised Multi-source Views

  • Conference paper
  • First Online:
New Horizons in Information Management (BNCOD 2003)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2712))

Included in the following conference series:

  • 190 Accesses

Abstract

In many applications data from distributed, autonomous, and heterogeneous sources need to be imported and materialised in a (client) system external to those sources. As changes are committed in the sources, the externally materialised view must be updated to reflect those changes. A maintenance policy determines when and how to conduct updates. As sources may not be cooperating maintenance of externally materialised views is different from traditional view maintenance. Previous studies on maintenance of externally materialised views have been heavily focused on algorithms that ensure view consistency. There are, however, other aspects of maintenance that, when considered, can affect choice of consistency algorithm. If, for example, auxiliary views are maintained in the view client it is possible to ensure strong consistency without complex algorithms.

In our previous work we have studied how to select a maintenance policy for a single source view. In this paper we extend the work to evaluating maintenance policies for externally materialised views based on several sources. We explore views that are defined as the join of two independent sources, identifying the solution space in terms of possible policies, their implications for consistency and their required source capabilities. We use a testbed system to evaluate policy performance. The work confirms that the earlier results on single source maintenance extend to the multi-source situation. In addition we show that the consistency preserving algorithms suggested in the literature are not always required. Actually, in all situations explored it has proved more efficient to use auxiliary views than policies which requires consistency preserving algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. S. Abiteboul, J. McHugh, M. Rys, V. Vassalos, and J.L. Wiener, Incremental maintenance for materialized views over semistructured data, VLDB’98, Proceedings of 24rd International Conference on Very Large Data Bases, August 24–27, 1998, New York City, New York, USA (A. Gupta, O. Shmueli, and J. Widom, eds.), 1998, pp. 38–49.

    Google Scholar 

  2. D. Agrawal, A. El Abbadi, A.K. Singh, and T. Yurek, Efficient view maintenance at data warehouses, SIGMOD 1997, Proceedings ACM SIGMOD International Conference on Management of Data, May 13–15, 1997, Tucson, Arizona, USA (J. Peckham, ed.), 1997, pp. 417–427.

    Google Scholar 

  3. M. Akhtar Ali, Alvaro A. A. Fernandes, and Norman W. Paton, Incremental maintenance of materialized OQL views, Proceedings of the third ACM international workshop on Data warehousing and OLAP, Washington, USA, 2000, pp. 41–48.

    Google Scholar 

  4. M. Akhtar Ali, Norman W. Paton, and Alvaro A. A. Fernandes, An experimental performance evaluation of incremental materialized view maintenance in object databases, Data Warehousing and Knowledge Discovery, Third International Conference, DaWaK 2001, Munich, Germany, September 5–7, 2001, Proceedings, 2001, pp. 240–253.

    Google Scholar 

  5. J.A. Blakeley, P-Å. Larson, and F.W. Tompa, Efficiently updating materialized views, Proceedings of the 1986 ACM SIGMOD International Conference on Management of Data, Washington, D.C., May 28–30, 1986 (C. Zaniolo, ed.), 1986, pp. 61–71.

    Google Scholar 

  6. L.S. Colby, A. Kawaguchi, D.F. Lieuwen, I.S. Mumick, and K.A. Ross, Supporting multiple view maintenance policies, SIGMOD 1997, Proceedings ACM SIGMOD International Conference on Management of Data, May 13–15, 1997, Tucson, Arizona, USA (J. Peckham, ed.), 1997, pp. 405–416.

    Google Scholar 

  7. H. Engström and K. Asthorsson, A data warehouse approach to maintenance of integrated biological data, Workshop on BioInformatics held in conjunction with the 19th International Conference on Data Engineering (ICDE’03) Bangalore, India, March 4, 2003, On-line proceedings, 14p., 2003.

    Google Scholar 

  8. H. Engström, S. Chakravarthy, and B. Lings, A user-centric view of data warehouse maintenance issues, Advances in Databases, 17th British National Conferenc on Databases, BNCOD 17, Exeter, UK, July 3–5, 2000, Proceedings (B. Lings and K.G. Jeffery, eds.), Lecture Notes in Computer Science, vol. 1832, Springer, 2000, pp. 68–80.

    Chapter  Google Scholar 

  9. _____, Data integration in heterogeneous environments: Multi-source policies, cost model, and implementation, Tech. report, University of Skövde, Sweden, 2002.

    Google Scholar 

  10. _____, Implementation and comparative evaluation of maintenance policies in a data warehouse environment, Advances in Databases, 19th British National Conference on Databases, BNCOD 19, Sheffield, UK, July 17–19, 2002, Proceedings (B. Eaglestone, S. North, and A. Poulovassilis, eds.), Lecture Notes in Computer Science, vol. 2405, Springer, 2002, pp. 90–102.

    Chapter  Google Scholar 

  11. _____, A systematic approach to selecting maintenance policies in a data warehouse environment, Advances in Database Technology-EDBT 2002, 8th International Conference on Extending Database Technology, Prague, Czech Republic, March 25–27, Proceedings (C.S. Jensen, K.G. Jeffery, J. Pokorný, S. Saltenis, E. Bertino, K. Böhm, and M. Jarke, eds.), Lecture Notes in Computer Science, vol. 2287, Springer, 2002, pp. 317–335.

    Chapter  Google Scholar 

  12. _____, A heuristic for refresh policy selection in heterogeneous environments, 19th International Conference on Data Engineering, Bangalore, India, March 5–8, 2003, Proceedings, 2003, pp. 674–676.

    Google Scholar 

  13. A. Gupta, H. V. Jagadish, and I. S. Mumick, Data integration using self-maintainable views, Advances in Database Technology-EDBT’96, 5th International Conference on Extending Database Technology, Avignon, France, March 25–29, 1996, Proceedings, 1996, pp. 140–144.

    Google Scholar 

  14. A. Gupta and I. S. Mumick, Maintenance of materialized views: Problems, techniques, and applications, IEEE Data Engineering Bulletin 18 (1995), no. 2, 3–18.

    Google Scholar 

  15. A. Gupta, I.S. Mumick, and V. S. Subrahmanian, Maintaining views incrementally, Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, Washington, D.C., May 26–28, 1993 (P. Buneman and S. Jajodia, eds.), 1993, pp. 157–166.

    Google Scholar 

  16. E.N. Hanson, A performance analysis of view materialization strategies, Proceedings of the Association for Computing Machinery Special Interest Group on Management of Data 1987 Annual Conference, San Francisco, California, May 27–29, 1987 (U. Dayal and I.L. Traiger, eds.), 1987, pp. 440–453.

    Google Scholar 

  17. R. Hull and G. Zhou, A framework for supporting data integration using the materialized and virtual approaches, Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, Montreal, Quebec, Canada, June 4–6, 1996 (H.V. Jagadish and I.S. Mumick, eds.), 1996, pp. 481–492.

    Google Scholar 

  18. _____, Towards the study of performance trade-offs between materialized and virtual integrated views, Proceedings of the Workshop on Materialized Views: Techniques and Applications (VIEWS’96), Montreal, Canada, 1996, pp. 91–102.

    Google Scholar 

  19. D. Quass, A. Gupta, I.S. Mumick, and J. Widom, Making views self-maintainable for data warehousing, Proceedings of the Fourth International Conference on Parallel and Distributed Information Systems, December 18–20, 1996, Miami Beach, Florida, USA, 1996, pp. 158–169.

    Google Scholar 

  20. N. Roussopoulos, Materialized views and data warehouses, SIGMOD Record 27 (1998), no. 1, 21–26.

    Article  Google Scholar 

  21. J. Srivastava and D. Rotem, Analytical modeling of materialized view maintenance, Proceedings of the Seventh ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, March 21–23, 1988, Austin, Texas, 1988, pp. 126–134.

    Google Scholar 

  22. M. Staudt and M. Jarke, Incremental maintenance of externally materialized views, VLDB’96, Proceedings of 22th International Conference on Very Large Data Bases, September 3–6, 1996, Mumbai (Bombay), India (T.M. Vijayaraman, A.P. Buchmann, C. Mohan, and N.L. Sarda, eds.), 1996, pp. 75–86.

    Google Scholar 

  23. A.S. Varde and E.A. Rundensteiner, MEDWRAP: Consistent view maintenance over distributed multi-relation sources, Database and Expert Systems Applications, 13th International Conference, DEXA 2002, Aix-en-Provence, France, September 2–6, 2002, Proceedings (A. Hameurlain, R. Cicchetti, and R. Traunmüller, eds.), 2002.

    Google Scholar 

  24. A. Vavouras, S. Gatziu, and K. R. Dittrich, The SIRIUS approach for refreshing data warehouses incrementally, Datenbanksysteme in Büro, Technik und Wissenschaft (BTW), GI-Fachtagung, Freiburg, 1.–3. März 1999, Proceedings (Alejandro P. Buchmann, ed.), Informatik Aktuell, 1999, pp. 80–96.

    Google Scholar 

  25. H. Wang, M.E. Orlowska, and W. Liang, Efficient refreshment of materialized views with multiple sources, Proceedings of the 1999 ACM CIKM International Conference on Information and Knowledge Management, Kansas City, Missouri, USA, November 2–6, 1999, 1999, pp. 375–382.

    Google Scholar 

  26. X. Zhang, L. Ding, and E.A. Rundensteiner, PVM: Parallel view maintenance under concurrent data updates of distributed sources, Data Warehousing and Knowledge Discovery, Third International Conference, DaWaK 2001, Munich, Germany, September 5–7, 2001, Proceedings (Y. Kambayashi, W. Winiwarter, and M. Arikawa, eds.), 2001.

    Google Scholar 

  27. Y. Zhuge, Incremental maintenance of consistent data warehouses, Ph.D. thesis, Stanford University, USA, 1999.

    Google Scholar 

  28. Y. Zhuge, H. Garcia-Molina, J. Hammer, and J. Widom, View maintenance in a warehousing environment, Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, San Jose, California, May 22–25, 1995 (M.J. Carey and D.A. Schneider, eds.), 1995, pp. 316–327.

    Google Scholar 

  29. Y. Zhuge, H. Garcia-Molina, and J.L. Wiener, The Strobe algorithms for multi-source warehouse consistency, Proceedings of the Fourth International Conference on Parallel and Distributed Information Systems, December 18–20, 1996, Miami Beach, Florida, USA, 1996, pp. 146–157.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Engström, H., Lings, B. (2003). Evaluating Maintenance Policies for Externally Materialised Multi-source Views. In: James, A., Younas, M., Lings, B. (eds) New Horizons in Information Management. BNCOD 2003. Lecture Notes in Computer Science, vol 2712. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45073-4_12

Download citation

  • DOI: https://doi.org/10.1007/3-540-45073-4_12

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40536-8

  • Online ISBN: 978-3-540-45073-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics