Abstract
Most work on data warehousing addresses aspects related to the internal operation of a data warehouse server, such as selection of views to materialise, maintenance of aggregate views and performance of OLAP queries. Issues related to data warehouse maintenance, i.e. how changes to autonomous sources should be detected and propagated to a warehouse, have been addressed in a fragmented manner. Although data propagation policies, source database capabilities, and user requirements have been addressed individually, their co-dependencies and relationships have not been explored. In this paper, we present a comprehensive framework for evaluating data propagation policies against data warehouse requirements and source capabilities. We formalize data warehouse specification along the dimensions of staleness, response time, storage, and computation cost, and classify source databases according to their data propagation capabilities. A detailed cost-model is presented for a representative set of policies. A prototype tool has been developed to allow an exploration of the various trade-offs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M.E. Adiba, B.G. Lindsay: Database Snapshots. VLDB (1980)
D. Agrawal, A.E. Abbadi, A.K. Singh, T. Yurek: Efficient View Maintenance at Data Warehouses. SIGMOD Conf. (1997)
J.A. Blakeley, P.Å. Larson, F.W. Tompa: Efficiently Updating Materialized Views. SIGMOD Conf. (1986)
P. Buneman, E.K. Clemons: Efficient Monitoring Relational Databases. ACM Transactions on Database Systems 4(3) (1979)
C. Chaudhuri, U. Dayal: An Overview of DataWarehousing and OLAP Technology. SIGMOD Record 26(1) (1997)
L.S. Colby, T. Griffn, L. Libkin, I.S. Mumick, H. Trickey: Algorithms for Deferred View Maintenance. SIGMOD Conf. (1996)
L.S. Colby, A. Kawaguchi, D.F. Lieuwen, I.S. Mumick, K.A. Ross: Supporting Multiple View Maintenance Policies. SIGMOD Conf. (1997)
A. Delis, N. Roussopoulos: Management of Updates in the Enhanced Client-Server DBMS. IEEE-ICDCS (1994)
H. Engström, S. Chakravarthy, B. Lings: A Holistic Approach to the Evaluation of Data Warehouse Maintenance Policies. Technical report HS-IDA-TR-00-001, University of Skövde, Sweden (2000)
H. Engström, S. Chakravarthy, B. Lings: A User-centric View of Data Warehouse Maintenance Issues. BNCOD (2000)
H. Engström, G. Gelati, L. Lings: A Benchmark Comparison of Maintenance Policies in a DataWarehouse Environment. Technical Report HS-IDA-TR-01-005, University of Skövde, Sweden (2001)
A. Gupta, I.S. Mumick: Maintenance of Materialized Views: Problems, Techniques, and Applications. IEEE Data Engineering Bulletin 18(2) (1995)
H. Gupta, I.S. Mumick: Selection of Views to Materialize Under a Maintenance Cost Constraint. International Conf. on Database Theory (1999)
J. Hammer, H. Garcia-Molina, J. Widom, W. Labio, Y. Zhuge: The Stanford Data Warehousing Project. IEEE Data Engineering Bulletin 18(2) (1995)
E.N. Hanson: A Performance Analysis of View Materialization Strategies. SIGMOD Conf. (1987)
V. Harinarayan, A. Rajaraman, J.D. Ullman: Implementing Data Cubes Efficiently. SIGMOD Conf. (1996)
R. Hull, G. Zhou: A Framework for Supporting Data Integration Using the Materialized and Virtual Approaches. SIGMOD Conf. (1996)
R. Hull, G. Zhou: Towards the Study of Performance Trade-offs Between Materialized and Virtual Integrated Views. VIEWS’96 (1996)
A. Koschel, P.C. Lockemann: Distributed events in active database systems: Letting the genie out of the bottle. DKE 25(1–2) (1998)
M. Jarke, Y. Vassiliou: Data Warehouse Quality Design: A Review of the DWQ Project. Conf. on Information Quality, Cambridge (1997)
M. Lee, J. Hammer: Speeding Up Warehouse Physical Design Using A Randomized Algorithm. DMDW (1999)
B. Lindsay, L. Haas, C. Mohan, H. Pirahesh, P. Wilms: A Snapshot Differential Refresh Algorithm. SIGMOD Conf. (1986)
D. Lomet (editor), J. Widom (editor): Special Issue on Materialized Views and Data Warehousing. IEEE Data Engineering Bulletin 18(2) (1995)
D. Quass, J. Widom: On-Line Warehouse View Maintenance. SIGMOD Conf. (1997)
N. Roussopoulos, H. Kang: Principles and Techniques in the Design of ADMS±. IEEE Computer 19(12) (1986)
R. Roussopoulos, C.M. Chen, S. Kelley, A. Delis, Y. Papakonstantinou: The ADMS Project: Views “R” Us. IEEE Data Engineering Bulletin 18(2) (1995)
A. Segev, J. Park: Updating Distributed Materialized Views. TKDE 1(2) (1989)
A. Segev, W. Fang: Currency-Based Updates to Distributed Materialized Views. ICDE (1990)
A. Segev, W. Fang: Optimal Update Policies for Distributed Materialized Views. Management Science 37(7) (1991)
J. Srivastava, D. Rotem: Analytical Modeling of Materialized View Maintenance. PODS (1988)
D. Theodoratos, M. Bouzeghoub: Data Currency Quality Factors in Data Warehouse Design. DMDW (1999)
A. Vavouras, S. Gatziu, K.R. Dittrich: The SIRIUS Approach for Refreshing Data Warehouses Incrementally. BTW’99 (1999)
J. Widom: Research Problems in Data Warehousing. CIKM (1995)
M.C. Wu, A.P. Buchmann: Research Issues in Data Warehousing. BTW’97 (1997)
G. Zhou, R. Hull, R. King, J.C. Franchitti: Data Integration and Warehousing Using H2O. IEEE Data Engineering Bulletin 18(2) (1995)
Y Zhuge, H. Garcia-Molina, J. Hammer, J. Widom: View Maintenance in a Warehousing Environment. SIGMOD Conf. (1995)
Y. Zhuge, H. Garcia-Molina, J.L. Wiener: The Strobe Algorithms for Multi-Source Warehouse Consistency. PDIS (1996)
Y. Zhuge: Incremental Maintenance of Consistent Data Warehouses. PhD Thesis, Stanford University (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Engström, H., Chakravarthy, S., Lings, B. (2002). A Systematic Approach to Selecting Maintenance Policies in a Data Warehouse Environment. In: Jensen, C.S., et al. Advances in Database Technology — EDBT 2002. EDBT 2002. Lecture Notes in Computer Science, vol 2287. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45876-X_22
Download citation
DOI: https://doi.org/10.1007/3-540-45876-X_22
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43324-8
Online ISBN: 978-3-540-45876-0
eBook Packages: Springer Book Archive