Article

Extending relational query optimization to dynamic schemas for information integration in multidatabases

Authors:

Catharine M. Wyss,

Felix I. WyssAuthors Info & Claims

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

Pages 473 - 484

https://doi.org/10.1145/1247480.1247533

Published: 11 June 2007 Publication History

Abstract

This paper extends relational processing and optimization to the FISQL/FIRA languages for dynamic schema queries over multidatabases. Dynamic schema queries involve the creation and restructuring of metadata at runtime. We present a full implementation of a FISQL/FIRA engine, which includes subqueries and all transformational capabilities of FISQL/FIRA on distributed, multidatabase platforms. An important application of the system is to enhance traditional information architectures by enabling the creation and maintenance of dynamic wrappers and mapping queries at source databases within GAV, LAV, GLAV, peer-to-peer, or other integration frameworks. In addition to fully supporting FISQL/FIRA on multidatabases, our implementation introduces a bi-level optimization paradigm where purely relational sub-fragments of queries are pushed into source engines. This paradigm shares features of canonical distributed database processing, but has a new dimension through the extension of the relational model to dynamic schemas. We present empirical results showing the feasibility of optimization in this context, and discuss tradeoffs involved. Our system is the first to extend relational databases with these capabilities on this scale.

References

[1]

Francois Barbancon and Daniel P. Miranker. Implementing Federated Database Systems by Compiling Schema SQL. IDEAS 2002.

Digital Library

[2]

Conor Cunningham, C&3233;sar A. Galindo-Legaria, and Goetz Graefe. PIVOT and UNPIVOT: Optimization and Execution Strategies in an RDBMS. VLDB 2004.

Digital Library

[3]

Keir B. Davis and Fereidoon Sadri. Optimization of Schema SQL Queries. IDEAS 2001.

Digital Library

[4]

R. Dhamanka, Y. Lee, A. Doan, A. Halevy, and P. Domingos. iMAP: Discovering Complex Semantic Matches Between Database Schema. SIGMOD 2004.

Digital Library

[5]

George H. L. Fletcher and Catharine M. Wyss. Data Mapping as Search. EDBT 2006.

Digital Library

[6]

H. Garcia-Molina, Y. Papakonstantinou, D. Quass, A. Rajaraman, Y. Sagiv, J. Ullman, V. Vassalos, and J. Widom. The TSIMMIS approach to mediation: Data models and Languages. Journal of Intelligent Information Systems (JIIS), March/April 1997. Vol. 8, no. 2, pp 117--132.

Digital Library

[7]

John Grant, Witold Litwin, Nick Roussopoulos, and Timos Sellis. Query Languages for Relational Multidatabases. VLDB Journal, vol2. pp 153--171, 1993.

Digital Library

[8]

Marc Gyssens, Laks V. S. Lakshmanan, and Iyer N. Subramanian. Tables as a Paradigm for Querying and Restructuring. PODS96, pp. 93--103.

Digital Library

[9]

Laura Haas, Renee Miller, Bartholomew Niswonger, Mary Tork Roth, Peter Schwarz, and Edward Wimmers. Transforming Heterogeneous Data with Database Middleware: Beyond Integration. IEEE Bulletin of the Technical Committee on Data Engineering, March 1999. Vol. 22, no. 1, pp 31--36.

[10]

Qi He and Tok Wang Ling. Extending and Inferring Functional Dependencies in Schema Transformation. CIKM 2005.

Digital Library

[11]

L. V. S. Lakshmanan, F. Sadri, and S. N. Subramanian. On Efficiently Implementing SchemaSQL on an SQL Database System. VLDB 1999.

Digital Library

[12]

L. V. S. Lakshmanan, F. Sadri, and S. N. Subramanian. SchemaSQL - an extension to SQL for multidatabase interoperability. TODS Vol. 26, No. 4, December 2001.

Digital Library

[13]

Maurizio Lenzerini. Data Integration: ATheoretical Perspective. PODS 2002: 233--246.

Digital Library

[14]

Lin Liu. SIGMOD Record: Special Issue on Semantic Integration. 33:4, December 2004.

Digital Library

[15]

Witold Litwin, M. Ketabchi, and Ravi Krishnamurthy. First Order Normal Form for Relational Databases and Multidatabases. SIGMOD RECORD, Vol. 20, No. 4, December 1991.

Digital Library

[16]

Peter McBrien and Alexandra Poulovassilis. Data Integration by Bi-Directional Schema Transformation Rules. ICDE 2003.

[17]

Renée J. Miller, Mauricio A. Hernàndez, Laura M. Haas, Lingling Yan, C. T. Howard Ho, Ronald Fagin, and Lucian Popa. The Clio Project: Managing Heterogeneity. SIGMOD Record, 30:1,March 2001.

Digital Library

[18]

Amit P. Sheth and James A. Larson. Federated Database Systems for Managing Distributed, Heterogeneous, and Autonomous Databases. ACM Computing Surveys, 22:3, 1990.

Digital Library

[19]

M. T. Ozsu and P. Valduriez. Principles of Distributed Database Systems, 2nd ed. Prentice Hall, 1999.

Digital Library

[20]

Catharine M. Wyss and Edward L. Robertson. Relational Languages for Metadata Integration. TODS, Vol. 30, No. 2, June 2005.

Digital Library

[21]

Catharine M. Wyss and Edward L. Robertson. A formal characterization of PIVOT/UNPIVOT. CIKM 2005: 602--608.

Digital Library

[22]

http://www.microsoft.com/net, http://www.microsoft.com/vcsharp

[23]

http://www.antlr.org

[24]

http://www.microsoft.com/sql

Cited By

Terwilliger J(2013)Bidirectional by Necessity: Data Persistence and Adaptability for Evolving Application DevelopmentGenerative and Transformational Techniques in Software Engineering IV10.1007/978-3-642-35992-7_6(219-270)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35992-7_6
Kitagawa HWatanabe YKawashima HAmagasa T(2010)Stream-Based Real World Information Integration FrameworkWireless Sensor Network Technologies for the Information Explosion Era10.1007/978-3-642-13965-9_6(173-204)Online publication date: 2010
https://doi.org/10.1007/978-3-642-13965-9_6
Hosain SJamil H(2009)An Algebraic Language for Semantic Data Integration on the Hidden WebProceedings of the 2009 IEEE International Conference on Semantic Computing10.1109/ICSC.2009.94(237-244)Online publication date: 14-Sep-2009
https://dl.acm.org/doi/10.1109/ICSC.2009.94
Show More Cited By

Index Terms

Extending relational query optimization to dynamic schemas for information integration in multidatabases
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
    2. Query languages
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query processing and optimization (theory)

Recommendations

Relational languages for metadata integration

In this article, we develop a relational algebra for metadata integration, Federated Interoperable Relational Algebra (FIRA). FIRA has many desirable properties such as compositionality, closure, a deterministic semantics, a modest complexity, support ...
A formal characterization of PIVOT/UNPIVOT
CIKM '05: Proceedings of the 14th ACM international conference on Information and knowledge management

PIVOT is an important relational operation that allows data in rows to be exchanged for columns. Although most current relational database management systems support PIVOT-type operations, to date a purely formal, algebraic characterization of PIVOT has ...
Query languages for relational multidatabases

With the existence of many autonomous databases widely accessible through computer networks, users will require the capability to jointly manipulate data in different databases. A multidatabase system provides such a capability through a multidatabase ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '07: Proceedings of the 2007 ACM SIGMOD international conference on Management of data

June 2007

1210 pages

ISBN:9781595936868

DOI:10.1145/1247480

General Chairs:
Lizhu Zhou
Tsinghua University, China
,
Tok Wang Ling
National University of Singapore, Singapore
,
Program Chair:
Beng Chin Ooi
National University of Singapore, Singapore

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGMOD/PODS07

Sponsor:

SIGMOD/PODS07: International Conference on Management of Data

June 11 - 14, 2007

Beijing, China

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
27
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Terwilliger J(2013)Bidirectional by Necessity: Data Persistence and Adaptability for Evolving Application DevelopmentGenerative and Transformational Techniques in Software Engineering IV10.1007/978-3-642-35992-7_6(219-270)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35992-7_6
Kitagawa HWatanabe YKawashima HAmagasa T(2010)Stream-Based Real World Information Integration FrameworkWireless Sensor Network Technologies for the Information Explosion Era10.1007/978-3-642-13965-9_6(173-204)Online publication date: 2010
https://doi.org/10.1007/978-3-642-13965-9_6
Hosain SJamil H(2009)An Algebraic Language for Semantic Data Integration on the Hidden WebProceedings of the 2009 IEEE International Conference on Semantic Computing10.1109/ICSC.2009.94(237-244)Online publication date: 14-Sep-2009
https://dl.acm.org/doi/10.1109/ICSC.2009.94
Ohki KWatanabe YKitagawa H(2009)Evaluation of a Framework for Dynamic Source Selection in Stream Processing2009 International Conference on Complex, Intelligent and Software Intensive Systems10.1109/CISIS.2009.167(1106-1111)Online publication date: Mar-2009
https://doi.org/10.1109/CISIS.2009.167
Fletcher GWyss C(2009)Towards a General Framework for Effective Solutions to the Data Mapping ProblemJournal on Data Semantics XIV10.1007/978-3-642-10562-3_2(37-73)Online publication date: 15-Nov-2009
https://dl.acm.org/doi/10.1007/978-3-642-10562-3_2
Hernández MPapotti PTan W(2008)Data exchange with data-metadata translationsProceedings of the VLDB Endowment10.14778/1453856.14538881:1(260-273)Online publication date: 1-Aug-2008
https://dl.acm.org/doi/10.14778/1453856.1453888
Watanabe YAkiyama ROhki KKitagawa HKim WChoi H(2008)A video stream management system for heterogeneous information integration environmentsProceedings of the 2nd international conference on Ubiquitous information management and communication10.1145/1352793.1352836(202-207)Online publication date: 31-Jan-2008
https://dl.acm.org/doi/10.1145/1352793.1352836
Junqiang Liu Xiaoling Guan (2008)Dynamic information integration using object deputy model2008 8th IEEE International Conference on Computer and Information Technology10.1109/CIT.2008.4594663(137-142)Online publication date: Jul-2008
https://doi.org/10.1109/CIT.2008.4594663

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten