Skip to main content
SpringerLink
Log in

Maintaining Materialized Views for Data Warehouses with Multiple Remote Sources

  • Conference paper
  • First Online:
Web-Age Information Management (WAIM 2000)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1846))

Included in the following conference series:

Abstract

A data warehouse is a data repository which collects and maintains a large amount of data from multiple distributed, autonomous and possibly heterogeneous data sources. Often the data is stored in the form of materialized views in order to provide fast access to the integrated data. However, to maintain the data in the warehouse consistent with the source data is a challenging task in a multiple remote source environment. Transactions containing multiple updates at one or more sources further complicate the consistency issue. In this paper we first consider improving the refresh time of select-project-join (SPJ) type materialized views in a data warehouse by presenting a frequency-partitioned based algorithm, which takes into account the source update frequencies and the total space for auxiliary data. We then propose a solution in the design of data warehouses which can handle a variety of materialized views with different refreshment requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. D. Agrawal, A. El Abbadi, A. Singh, and T. Yurek. Efficient view maintenance at data warehouses. Proc. of ACM-SIGMOD Conf., 1997, 417–427.

    Google Scholar 

  2. J. A. Blakeley, P. A. Larson, and F. W. Tompa. Efficiently updating materialized views. Proc. of ACM-SIGMOD Conf., 1986, 61–71.

    Google Scholar 

  3. S. Ceri and J. Widom. Deriving production rules for incremental view maintenance. Proc. of the 17th VLDB Conf., 1991, 577–589.

    Google Scholar 

  4. L. Colby, T. Griffin, L. Libkin, I. Mumick, and H. Trickey. Algorithms for deferred view maintenance. Proc. of the 1996 ACM-SIGMOD Conf., 1996, 469–480.

    Google Scholar 

  5. IEEE Data Engineering Bulletin, Special Issue on Materialized Views and Data Warehousing. 18(2), June, 1995.

    Google Scholar 

  6. T. Griffin and L. Libkin. Incremental maintenance of views with duplicates. Proc. of ACM-SIGMOD Conf., 1995, 328–339.

    Google Scholar 

  7. A. Gupta, H. Jagadish, and I. Mumick. Data integration using self-maintainable views. Proc. 4th Int’l Conf. on Extending Database Technology, 1996, 140–146.

    Google Scholar 

  8. A. Gupta, I. Mumick, and V. S. Subrahmanian. Maintaining views incrementally. Proc. of ACM-SIGMOD Conf., 1993, 157–166.

    Google Scholar 

  9. R. Hull and G. Zhou. A framework for supporting data integration using the materialized and virtual approaches. Proc. of ACM-SIGMOD Conf., 1996.

    Google Scholar 

  10. R. Hull and G. Zhou. Towards the study of performance trade-offs between materialized and virtual integrated views. Proc. of Workshop on Materialized Views: Techniques and Applications, Montreal, Canada, 1996, 91–102.

    Google Scholar 

  11. W. J. Labio, R. Yerneni, H. Garcia-Molina. Shrinking the warehouse update window. Proc. of ACM-SIGMOD Conf., 1999, 383–394.

    Google Scholar 

  12. A. Labrinidis and N. Roussopoulos. Reduction of materialized view staleness using online updates. TR3878, DCS, Univ. of Maryland at College Park, 1998.

    Google Scholar 

  13. W. Liang, H. Li, H. Wang and M. Orlowska. Making multiple views self-maintainable in a data warehouse. DKE, 30(2), 1999, 121–134.

    Article  MATH  Google Scholar 

  14. Y. Perl and S. R. Schach. Max-min tree partitioning. J. ACM, 28(1), 1981, 5–15.

    Article  MATH  MathSciNet  Google Scholar 

  15. D. Quass, A. Gupta, I. S. Mumick, and J. Widom. Making views self-maintainable for data warehousing. Proc. of PDIS’96, FL, 1996, 158–169.

    Google Scholar 

  16. D. Quass and J. Widom. On-line warehouse view maintenance. Proc. of ACMSIGMOD Conf., Tucson, Arizona, 1997, 393–404.

    Google Scholar 

  17. D. Theodoratos, S. Ligoudistianos, and T. Sellis. Designing the global data warehouse with SPJ views. Proc. of the 11th Int’l Conf. on Advanced Information Systems Engineering, 1999, 180–194.

    Google Scholar 

  18. H. Wang, M. Orlowska, and W. Liang. Efficient refreshment of materialized views with multiple sources. Proc. of the 8th ACM-CIKM, 1999, 375–382.

    Google Scholar 

  19. J. Wiener, H. Gupta, W. Labio, Y. Zhuge, H. Garcia-Molina, J. Hammer, and J. Widom. A system prototype for warehouse view maintenance. Proc. of Workshop on Materialized Views, Montreal, Canada, 1996, 26–33.

    Google Scholar 

  20. Y. Zhuge, H. Garcia-Molina, J. Hammer, and J. Widom. View maintenance in a warehousing environment. Proc. of ACM-SIGMOD Conf., 1995, 316–327.

    Google Scholar 

  21. Y. Zhuge, H. Garcia-Molina, and J. L. Wiener. The strobe algorithms for multisource warehouse consistency. Proc. of PDIS’96, FL, 1996, 146–157.

    Google Scholar 

  22. Y. Zhuge, H. Garcia-Molina, and J. L. Wiener. Multiple view consistency for data warehousing. IEEE ICDE’97, Birmingham, UK, 1997, 289–300.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, The Australian National University, Canberra, ACT, 0200, Australia

    Weifa Liang & Chris Johnson

  2. Department Systems Engineering and Engineering Management, Chinese University of Hong Kong, Hong Kong

    Jeffrey X. Yu

Authors
  1. Weifa Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chris Johnson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jeffrey X. Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China

    Hongjun Lu

  2. Department of Computer Science, Fudan University, 220 Handan Road, Shanghai, China

    Aoying Zhou

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Liang, W., Johnson, C., Yu, J.X. (2000). Maintaining Materialized Views for Data Warehouses with Multiple Remote Sources. In: Lu, H., Zhou, A. (eds) Web-Age Information Management. WAIM 2000. Lecture Notes in Computer Science, vol 1846. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45151-X_29

Download citation

  • DOI: https://doi.org/10.1007/3-540-45151-X_29

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67627-0

  • Online ISBN: 978-3-540-45151-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation