research-article

Queries on dates: fast yet not blind

Authors:

Calisto ZuzarteAuthors Info & Claims

EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

Pages 497 - 502

https://doi.org/10.1145/1951365.1951424

Published: 21 March 2011 Publication History

Get Access

Abstract

Data warehouses are repositories of electronically stored data which are designed to support reporting and analysis. The analysis of historical data often involves aggregation over time. Thus, time is critical in the design of a data warehouse. We describe novel techniques for storing date information and optimization of queries that reference the date dimension. We show how to embed intelligence into the date key and how to exploit monotonic dependencies. We present the value of these techniques for the improvement of performance when combined with partitioning and indexes. We evaluate these techniques on our prototype implemented in IBM® DB2® V9.7 over the current draft version of the TPC-DS benchmark.

References

[1]

Pedersen, T., Jensen, Ch., and Dyreson, C. 2001. A foundation for capturing and querying complex multidimensional data. Information Systems 26 (2001) 383--423.

Digital Library

Google Scholar

[2]

Riedewald, M., Agrawal, D., and Abbadi, A. E. 2002. Efficient Integration and Aggregation of Historical Information. Proceedings of the 2002 ACM SIGMOD international conference on Management of data.

Digital Library

Google Scholar

[3]

Kimball, R., Ross, M., 2002. The Data Wareshouse Toolkit Second Edition. The Complete Guide to Dimensional modeling. John Wiley & Sun.

Digital Library

Google Scholar

[4]

Malinowski, E., Zimányi, E. 2006. A conceptual Solution for Representing Time in Data Warehouse Dimensions. Conferences in Research and Practice in Information Technology Series, Vol. 166.

Digital Library

Google Scholar

[5]

Inmon, W. 2002. Building the Data Warehouse. John Wiley & Sons.

Digital Library

Google Scholar

[6]

Jarke, M., Lenzerini, M., Y., Vassiluiou & Vassiliadis, P. 2003. Fundamentals of Data Warehouse. Springer.

Digital Library

Google Scholar

[7]

Gregersen, H. & Jensen, C. 1998. Conceptual modeling of time-varying information. Technical report, Time Center, TR-35.

Google Scholar

[8]

Lightstone, S., Teorey, T., Nadeau, T. 2007. Physical database design. Morgan Kaufmann.

Google Scholar

[9]

Agrawal, R., Gupta A., Sarawagi, S. 1995. Modeling multidimensional databases. IBM Technical Report 1995. Appeared also in Proceedings of the 13th International Conference on Data Engineering 1997, pp 232--243.

Digital Library

Google Scholar

[10]

Gyssens, M., Lakshmanan, L. V. S. 1997. A foundation for multidimensional databases, Proceedings of the 23rd Conference on Very Large Databases, pp 106--115.

Digital Library

Google Scholar

[11]

Shoshani, A. 1997. OLAP and statistical databases: similarities and differences, Proceedings of the 16th ACM Symposium on Principles of Database Systems, pp 185--196.

Digital Library

Google Scholar

[12]

http://www.ibm.com/software/data/db2.

Google Scholar

[13]

http://www.tpc.org.

Google Scholar

[14]

http://publib.boulder.ibm.com/infocenter/db2luw/v9.

Google Scholar

Cited By

View all

Karegar RMirsafian MGodfrey PGolab LKargar MSrivastava DSzlichta J(2022)Discovering Domain Orders via Order Dependencies2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00087(1098-1110)Online publication date: May-2022
https://doi.org/10.1109/ICDE53745.2022.00087
Kossmann JPapenbrock TNaumann F(2021)Data dependencies for query optimization: a surveyThe VLDB Journal10.1007/s00778-021-00676-3Online publication date: 14-Jun-2021
https://doi.org/10.1007/s00778-021-00676-3
Mihaylov AGodfrey PGolab LKargar MSrivastava DSzlichta J(2018)FASTOD: Bringing Order to Data2018 IEEE 34th International Conference on Data Engineering (ICDE)10.1109/ICDE.2018.00176(1561-1564)Online publication date: Apr-2018
https://doi.org/10.1109/ICDE.2018.00176
Show More Cited By

Index Terms

Queries on dates: fast yet not blind
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query processing and optimization (theory)

Recommendations

Best Practices in Data Warehousing to Support Business Initiatives and Needs
HICSS '04: Proceedings of the Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS'04) - Track 8 - Volume 8

The paper presents the data warehousing architecture and practices used at a major U.S. retailing company. Many considerations were assessed when deciding which data warehousing architecture to adopt. The paper discusses the two pre-dominant styles in ...
RAMEPs: a goal-ontology approach to analyse the requirements for data warehouse systems

The data warehouse (DW) systems design involves several tasks such as defining the DW schemas and the ETL processes specifications, and these have been extensively studied and practiced for many years. However, the problems in heterogeneous data ...
A framework for enriching Data Warehouse analysis with Question Answering systems

Business Intelligence (BI) applications allow their users to query, understand, and analyze existing data within their organizations in order to acquire useful knowledge, thus making better strategic decisions. The core of BI applications is a Data ...

Comments

Information & Contributors

Information

Published In

EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

March 2011

587 pages

ISBN:9781450305280

DOI:10.1145/1951365

Editors:
Anastasia Ailamaki
EPFL, Switzerland
,
Sihem Amer-Yahia
Yahoo! Research
,
Jignesh Pate
University of Wisconsin-Madison
,
Tore Risch
Uppsala University, Sweden
,
Pierre Senellart
Télécom ParisTech, France
,
Julia Stoyanovich
University of Pennsylvania

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EDBT/ICDT '11

Sponsor:

Microsoft Research

EDBT/ICDT '11: EDBT/ICDT '11 joint conference

March 21 - 24, 2011

Uppsala, Sweden

Acceptance Rates

Overall Acceptance Rate 7 of 10 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
196
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Karegar RMirsafian MGodfrey PGolab LKargar MSrivastava DSzlichta J(2022)Discovering Domain Orders via Order Dependencies2022 IEEE 38th International Conference on Data Engineering (ICDE)10.1109/ICDE53745.2022.00087(1098-1110)Online publication date: May-2022
https://doi.org/10.1109/ICDE53745.2022.00087
Kossmann JPapenbrock TNaumann F(2021)Data dependencies for query optimization: a surveyThe VLDB Journal10.1007/s00778-021-00676-3Online publication date: 14-Jun-2021
https://doi.org/10.1007/s00778-021-00676-3
Mihaylov AGodfrey PGolab LKargar MSrivastava DSzlichta J(2018)FASTOD: Bringing Order to Data2018 IEEE 34th International Conference on Data Engineering (ICDE)10.1109/ICDE.2018.00176(1561-1564)Online publication date: Apr-2018
https://doi.org/10.1109/ICDE.2018.00176
Szlichta JGodfrey PGolab LKargar MSrivastava D(2018)Effective and complete discovery of bidirectional order dependencies via set-based axiomsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-018-0510-027:4(573-591)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s00778-018-0510-0
Szlichta JGodfrey PGolab LKargar MSrivastava D(2017)Effective and complete discovery of order dependencies via set-based axiomatizationProceedings of the VLDB Endowment10.14778/3067421.306742210:7(721-732)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.14778/3067421.3067422
Floratou AÖzcan FSchiefer B(2015)Benchmarking SQL-on-Hadoop Systems: TPC or Not TPC?Big Data Benchmarking10.1007/978-3-319-20233-4_7(63-72)Online publication date: 14-Jun-2015
https://doi.org/10.1007/978-3-319-20233-4_7
Szlichta JGodfrey PGryz JZuzarte C(2013)Expressiveness and complexity of order dependenciesProceedings of the VLDB Endowment10.14778/2556549.25565686:14(1858-1869)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.14778/2556549.2556568
Szlichta JGodfrey PGryz J(2012)Fundamentals of order dependenciesProceedings of the VLDB Endowment10.14778/2350229.23502415:11(1220-1231)Online publication date: 1-Jul-2012
https://dl.acm.org/doi/10.14778/2350229.2350241

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Best Practices in Data Warehousing to Support Business Initiatives and Needs

RAMEPs: a goal-ontology approach to analyse the requirements for data warehouse systems

A framework for enriching Data Warehouse analysis with Question Answering systems

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations