Skip to main content
SpringerLink
Log in

Research Issues in Data Warehousing

  • Conference paper
Datenbanksysteme in Büro, Technik und Wissenschaft

Part of the book series: Informatik aktuell ((INFORMAT))

Abstract

Data warehousing is a booming industry with many interesting research problems. The database research community has concentrated on only a few aspects. In this paper, We summarize the state of the art, suggest architectural extensions and identify research problems in the areas of warehouse modeling and design, data cleansing and loading, data refreshing and purging, metadata management, extensions to relational operators, alternative implementations of traditional relational operators, special index structures and query optimization with aggregates.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aberdeen Group,Data Warehouse Query Tools: Evolving to Relational OLAP, Market Viewpoint, 8(8), July 1995.

    Google Scholar 

  2. Arbor Software,The Role of the Multidimensional Database in a Data Warehousing Solution, white paper available fromhttp://www.arborsoft.com/papers/, 1995.

    Google Scholar 

  3. Arbor Software,Relational OLAP: Expectations & Reality, white paper available fromhttp://www.arborsoft.com/papers/, 1995.

    Google Scholar 

  4. S. Agarwal, A.M. Keller, G. Wiederhold, K. Saraswat,Flexible Relation: An Ap¬proach for Integrating Data from Multiple, Possibly Inconsistent Databases, ICDE Conf., Taipei, 1995.

    Google Scholar 

  5. S. Agarwal, R. Agrawal, P. Deshpande, A. Gupta, J.F. Naughton, R. Ramakr-ishnan, S. Sarawagi,On the Computation of Multidimensional Aggregates, VLDB Conf., Bombay, 1996.

    Google Scholar 

  6. T. Barclay, R. Barnes, J. Gray, P. Sundaresan,Loading Databases Using Dataflow Parallelism, SIGMOD Record, 23(4), December 1994.

    Google Scholar 

  7. J.A. Blakeley, N. Coburn, P. Larson,Updating Derived Relations: Detecting Irrelevant and Autonomously Computable Updates, ACM TODS, 14(3), 1989.

    Google Scholar 

  8. C.J. Bontempo, CM. Saracco,Accelerating Indexed Searching, Database Program¬ming and Design (also available from http://www.dbpd.com/, July 1996.

    Google Scholar 

  9. S. Chaudhuri, U. Dayal, Data Warehousing and OLAP for Decision Support, Tutorials of 22th VLDB Conf., Bombay, 1996.

    Google Scholar 

  10. S.S. Chawathe, A. Rajaraman, H. Garcia-Molina, J. Widom,Change Detection in Hierarchically Structured Information, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  11. M.S. Chen, P.S. Yu, K.L. Wu,Scheduling and Processor Allocation for Parallel Execution of Multi-Join Queries, ICDE Conf., Tempe, 1992.

    Google Scholar 

  12. E.F. Codd, S.B. Codd, C.T. Salley,Providing OLAP (On-line Analytical Processing) to User-Analysts: An IT Mandate, white paper available from http://www.arborsoft.com/papers/, 1993.

    Google Scholar 

  13. M.S. Chen, P. S. Yu, K.L. Wu, Optimization of Parallel Execution for Multi-Join Queries, IEEE Trans, on Knowledge and Data Eng., 8(3), 1996.

    Google Scholar 

  14. L.S. Colby, T. Griffin, L. Libkin, I. S. Mumick, H. Trickey,Algorithms for Deferred View Maintenance, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  15. S. Dar, H.V. Jagadish, A.Y. Levy, D. Srivastava,Answering Queries with Aggregation Using Views, VLDB Conf., Bombay, 1996.

    Google Scholar 

  16. V. Deshpande, P. Larson,The Design and Implementation of a Parallel Join Al¬gorithm for Nested Relations on Shared-Memory Multiprocessors, ICDE Conf., Tempe, 1992.

    Google Scholar 

  17. C.E. Dyreson,Lazy Information Retrieval From an Incomplete Data Cube, VLDB Conf., Bombay, 1996.

    Google Scholar 

  18. H. Edelstein, Faster Data Warehouses: New tools provide high-performance querying through advanced indexing, Information Week, Dec. 4, 1995.

    Google Scholar 

  19. R. Findelstein, Understanding the Need for On-Line Analytical Servers, white paper available from http://www.arborsoft.com/papers/.

    Google Scholar 

  20. J. Gray, A. Bosworth, A. Layman, H. Pirahesh,Data Cube: A Relational Aggre¬gation Operator Generalizing Group-By, Cross-Tab, and Sub-Total, ICDE Conf., New Orleans, 1996.

    Google Scholar 

  21. T. Griffin, L. Libkin, Incremental Maintenance of Views with Duplicates, SIGMOD Conf., San Jose, 1995.

    Google Scholar 

  22. A. Gupta, I.S. Mumick, V.S. Subrahmanian,Maintaining Views Incrementally, SIGMOD Conf., Washingtion, D.C, 1993.

    Google Scholar 

  23. A. Gupta, I.S. Mumick,Maintenance of Materialized Views: Problems, Techniques, and Applications, Data Eng. Bulletin, 18(2), June 1995.

    Google Scholar 

  24. A. Gupta, I.S. Mumick, K.A. Ross,Adapting Materialized Views after Redefinitions, SIGMOD Conf., San Jose, 1995.

    Google Scholar 

  25. H. Gupta,Selection of views to materialize in a data warehouse, To be appeared in Int’l Conf. on Database Theory (ICDT), Greece, January, 1997.

    Google Scholar 

  26. J. Hammer, H. Garcia-Molina, J. Widom, W. Laobio, Y. Zhuge,The Stanford Data Warehousing Project, Data Eng. Bulletin, 18(2), June 1995.

    Google Scholar 

  27. J.V. Harrison, S. Dietrich,Maintenance of Materialized Views in a Deductive Database: An Update Propagation Approach, Workshop on Deductive Databases, JICSLP, 1992.

    Google Scholar 

  28. V. Harinarayan, A. Rajaraman, J. Ullman,Implementing Data Cubes Efficiently, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  29. W. Hong, M. Stonebraker,Optimization of Parallel Query Execution Plans in XPRS, Distributed and Parallel Databases, 1(1), January 1993.

    Google Scholar 

  30. H.I. Hsiao, M.S. Chen, P.S. Yu,On Parallel Execution of Multiple Pipelined Hash Joins, SIGMOD Conf., Minneapolis, 1994.

    Google Scholar 

  31. R. Hull, G. Zhou,A Framework for Supporting Data Integration Using the Materialized and Virtual Approaches, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  32. W.H. Inmon,Building the Data Warehouse, John Wiley & Sons, March, 1996.

    Google Scholar 

  33. Kenan Technologies,An Introduction to Multidimensional Database Technology, Available from http://www.kenan.com/, 1995.

    Google Scholar 

  34. H.A. Kuno, E.A. Rundensteiner,Using Object-oriented Principles to Optimize Update Propagation to Materialized Views, ICDE Conf., New Orleans, 1996.

    Google Scholar 

  35. W. J. Labio and H. Garcia-Molina,Efficient Snapshot Differential Algorithms for Data Warehousing, VLDB Conf., Bombay, 1996.

    Google Scholar 

  36. C. Lee, Z.A. Chang,Utilizing Page-Level Join Index for Optimization in Parallel Join Execution, IEEE Trans, on Knowledge and Data Eng., 7(1), February 1995.

    Google Scholar 

  37. L. Libkin, R. Machlin, L. Wong,A Query Language for Multidimensional Arrays: Design, Implementation, and Optimization Techniques, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  38. T. Patrick Martin, P. Larson, V. Deshpande,Parallel Hash-Based Join Algorithms for a Shared-Everything, IEEE Trans.on Knowledge and Data Eng., 6(5), 1994.

    Google Scholar 

  39. Metadata Coalition,http://www.metadata.org/.

    Google Scholar 

  40. MicroStrategy, Inc.,The Case for Relational OLAP, white paper available from http://www.strategy.com/, 1995.

    Google Scholar 

  41. C. Morpain, M. Cart, J. Ferrié, J. Pons,Maintaining Database Consistency in Presence of Value Dependencies in Multidatabase Systems, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  42. P. O’Neil, G. Graefe,Multi-Table Joins Through Bitmapped Join Indices, SIGMOD Record, 24(3), September 1995.

    Google Scholar 

  43. D. Quass, A. Gupta, I.S. Mumick, and J. Widom,Making Views Self-Maintainable for Data Warehousing, PDIS, Miami Beach, 1996.

    Google Scholar 

  44. N. Raden,Modeling the Data Warehouse, white paper available from http://www.netcom.com/.

    Google Scholar 

  45. S. Rao, A. Badia, D. Van Gucht,Providing Better Support for a Class of Decision Support Queries, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  46. Red Brick Systems,Decision-Makers, Business Data, and RISQL, white paper available from http://www.redbrick.com/rbs/whpapers.html, 1995.

    Google Scholar 

  47. K. A. Ross, D. Srivastava, S. Sudarshan,Materialized View Maintenance and Integrity Constraint Checking Trading Space for Time, SIGMOD Conf., Montreal, 1996.

    Google Scholar 

  48. N. Roussopoulos, CM. Chen, S. Kelley, A. Delis, Y. Papakonstantinou, The Maryland ADMS Project: Views R Us, Data Eng. Bulletin, 18(2), June 1995.

    Google Scholar 

  49. K. Sahin,Multidimensional Database Technology and Data Warehousing, Database Journal (also available from http://www.kenan.com/acumate/, December 1995.

    Google Scholar 

  50. M.J. Saylor, M.G. Acharya, R.G. Trenkamp,True Relational OLAP: The Future of Decision Support, Database Journal, November-December 1995.

    Google Scholar 

  51. P. Scheuermann, J. Shim, R. Vingralek, WATCHMAN: A Data Warehouse Intelligent Cache Manager, VLDB Conf., Bombay, 1996.

    Google Scholar 

  52. D.K. Shin, A.C. Meltzer,A New Join Algorithm, SIGMOD Record, 23(4), 1994.

    Google Scholar 

  53. A. Shukla, P. Deshpande, J.F. Naughton, K. Ramaswamy,Storage Estimation for Multidimensional Aggregates in the Presence of Hierarchies, VLDB, Bombay, 1996.

    Google Scholar 

  54. Stanford Technology Group, Inc.,Designing the Data Warehouse on Relational Databases, white paper available from http://pwp.starnetinc.com/larryg/whitepap.html, 1996.

    Google Scholar 

  55. M. Staudt, M. Jarke, Incremental Maintenance of Externally Materialized Views, VLDB Conf., Bombay, 1996.

    Google Scholar 

  56. P. Valduriez, Join Indices, ACM TODS, 12(2), June 1987.

    Google Scholar 

  57. J. Widom, Research Problems in Data Warehousing, Int’l Conf. on Info, and Knowledge Management (CIKM), November 1995.

    Google Scholar 

  58. J.L. Wiener, H. Gupta, W.J. Labio, Y. Zhuge, H. Garcia-Molina, J. Widom, A System Prototype for Warehouse View Maintenance, Workshop on Materialized Views: Techniques and Applications, June 1996.

    Google Scholar 

  59. W.P. Yan, P. Larson, Performing Group-By Before Join, ICDE, Houston, 1994.

    Google Scholar 

  60. G. Zhou, R. Hull, R. King, J.C. Franchitti, Supporting Data Integration and Warehousing Using H20, Data Eng. Bulletin, 18(2), 1995.

    Google Scholar 

  61. Y. Zhuge, H. Garcia-Molina, J. Hammer, J. Widom, View Maintenance in a Warehousing Environment, SIGMOD Conf., San Jose, 1995.

    Google Scholar 

  62. Y. Zhuge, H. Garcia-Molina, and J. L. Wiener, The Strobe Algorithms for Multi-Source Warehouse Consistency, PDIS, Miami Beach, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DVS1, Fachbereich Informatik, Technische Hochschule Darmstadt, Germany

    Ming-Chuan Wu & Alejandro P. Buchmann

Authors
  1. Ming-Chuan Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alejandro P. Buchmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institut für Informatik, Universität Zürich, Winterthurerstrasse 190, CH-8057, Zürich, Switzerland

    Klaus R. Dittrich  & Andreas Geppert  & 

Rights and permissions

Reprints and permissions

Copyright information

© 1997 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wu, MC., Buchmann, A.P. (1997). Research Issues in Data Warehousing. In: Dittrich, K.R., Geppert, A. (eds) Datenbanksysteme in Büro, Technik und Wissenschaft. Informatik aktuell. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-60730-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-60730-1_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-62569-8

  • Online ISBN: 978-3-642-60730-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation