Abstract
Data warehouse maintenance is the task of updating a materialised view to reflect changes to autonomous, heterogeneous and distributed sources. Selection of a maintenance policy has been shown to depend on source and view properties, and on the user specified criteria (such as staleness, response time etc.), which are mapped on to evaluation criteria. In our previous work, we have analysed source and view characteristics, and user requirements to derive a cost-model. Maintenance policy selection has thus been cast as an optimisation problem.
This paper takes a complementary approach to evaluating maintenance policies, by implementing a test-bed which allows us to vary source characteristics and wrapper location. The test-bed is instrumented to allow costs associated with a policy to be measured. An actual DBMS (InterBase) has been used as a relational source and an XML web server has been used as a non-relational source. The experiments clearly show that maintenance policy performance can be highly sensitive to source capabilities, which can therefore significantly affect policy selection. They have further substantiated some of the conjectures found in the literature. Some of the lessons learnt from this test-bed implementation and evaluation are reviewed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
D. Agrawal, A.E. Abbadi, A.K. Singh, T. Yurek: Efficient View Maintenance at Data Warehouses. SIGMOD Conference (1997)
M.A. Ali, A.A.A. Fernandes, N.W. Paton: Incremental Maintenance of Materialized OQL Views. DOLAP (2000)
S.S. Chawathe, H. Garcia-Molina: Meaningful Change Detection in Structured Data. SIGMOD Conference (1997)
L.S. Colby, A. Kawaguchi, D.F. Lieuwen, I.S. Mumick, K.A. Ross: Supporting Multiple View Maintenance Policies. SIGMOD Conference (1997)
H. Engström, S. Chakravarthy, B. Lings: A User-centric View of Data Warehouse Maintenance Issues. 17th British National Conference on Databases (2000)
H. Engström, G. Gelati, B. Lings: A Benchmark Comparison of Maintenance Policies in a Data Warehouse Environment. Technical report HS-IDA-TR-01-005 (2001)
H. Engström, S. Chakravarthy, B. Lings: A Systematic Approach to Selecting Maintenance Policies in a Data Warehouse Environment. EDBT (2002)
S. Gatziu, A. Vavouras: Data Warehousing: Concepts and Mechanisms. Informatik (Zeitschrift der Schweizerischen Informatikorganisationen) 0:1 (1999)
A. Gupta, I.S. Mumick: Maintenance of Materialized Views: Problems, Techniques, and Applications. IEEE Data Engineering Bulletin 18(2) (1995)
J. Hammer, H. Garcia-Molina, J. Widom, W Labio, Y. Zhuge: The Stanford Data Warehousing Project. IEEE Data Engineering Bulletin 18(2) (1995)
E.N. Hanson: A Performance Analysis of View Materialization Strategies. SIGMOD Conference (1987)
R. Hull, G. Zhou: A Framework for Supporting Data Integration Using the Materialized and Virtual Approaches. SIGMOD Conference (1996)
A. Labrinidis, N. Roussopoulos: WebView materialization. SIGMOD Conference (2000)
W.J. Labio, H. Garcia-Molina: Efficient Snapshot Differential Algorithms for Data Warehousing. VLDB (1996)
D. Lomet (editor), J. Widom (editor): Special Issue on Materialized Views and Data Warehousing. IEEE Data Engineering Bulletin 18(2) (1995)
A. Segev, J. Park: Updating Distributed Materialized Views. IEEE TKDE 1(2) (1989)
D. Theodoratos, M. Bouzeghoub: Data Currency Quality Satisfaction in the Design of a Data Warehouse. IJCIS 10(3) (2001)
A. Vavouras, S. Gatziu, K.R. Dittrich: The SIRIUS Approach for Refreshing Data Warehouses Incrementally. BTW (1999)
G. Zhou, R. Hull, R. King, J.C. Franchitti: Data Integration and Warehousing Using H2O. IEEE Data Engineering Bulletin 18(2) (1995)
Y Zhuge: Incremental Maintenance of Consistent Data Warehouses. PhD Thesis Stanford University (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Engström, H., Chakravarthy, S., Lings, B. (2002). Implementation and Comparative Evaluation of Maintenance Policies in a Data Warehouse Environment. In: Eaglestone, B., North, S., Poulovassilis, A. (eds) Advances in Databases. BNCOD 2002. Lecture Notes in Computer Science, vol 2405. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45495-0_14
Download citation
DOI: https://doi.org/10.1007/3-540-45495-0_14
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43905-9
Online ISBN: 978-3-540-45495-3
eBook Packages: Springer Book Archive