Abstract
This paper proposes an approach to data integration and migration from a collection of heterogeneous and independent data sources into a data warehouse schema. Current methodology assumes that the data is loaded into data warehouse using queries in order to extract data from multiple data sources. Extracting data from various data sources requires the establishment of generic data integration methodologies. Sometimes, various data anomalies arise when using complex queries across multiple data sources. A data warehouse can be abstractly seen as a set of materialized views. Selecting views for materialization in a data warehouse is one of the most important decisions making tasks in its design. However, there are few facilities in data integration systems that consider these important issues. In this paper, we propose the approach of introducing staging table’s schema that can be utilized to load required data from source tables into corresponding staging tables. Staging tables will be assumed to be temporary tables and each staging table will be empty before loading new data and using simple non-join queries to load data. We then focus on an approach to load data into data warehouse materialized views through staging tables including maintenance of materialized views.
Chapter PDF
Similar content being viewed by others
References
Cali, A., Calvanese, D., Giacomo, G., Lenzerini, M.: Data Integration under Integrity Constraints. In: Pidduck, A.B., Mylopoulos, J., Woo, C.C., Ozsu, M.T. (eds.) CAiSE 2002. LNCS, vol. 2348, pp. 262–279. Springer, Heidelberg (2002)
Kim, H., Lee, T., Lee, S., Chun, J.: Automated Data Warehousing for Rule-based CRM Systems, School of Computer Science and Engineering, vol. 17. Seoul National University, Korea. Australian Computer Society, Inc (2003)
Velegrakis, Y., Miller, J.R., Popa, L.: Mapping Adaptation under Evolving Schemas. In: VLDB Conference, vol. 29 (2003)
Describing and Utilization Constraints to Answer Queries in Data-Integration Systems. Information and Computer Science, University of California, Irvine (2001)
Thomas, G., Thompson, G.R., Chung, C.W., Barkmeyer, E., Carter, F., Templeton, M., Fox, S., Hartman, B.: Heterogeneous Database systems for production use. ACM Computing Survey 22, 237–266 (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ejaz, A., Kenneth, R. (2004). Utilizing Staging Tables in Data Integration to Load Data into Materialized Views. In: Zhang, J., He, JH., Fu, Y. (eds) Computational and Information Science. CIS 2004. Lecture Notes in Computer Science, vol 3314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30497-5_107
Download citation
DOI: https://doi.org/10.1007/978-3-540-30497-5_107
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24127-0
Online ISBN: 978-3-540-30497-5
eBook Packages: Computer ScienceComputer Science (R0)