Abstract
Optimizing accesses to sources in a mediator/wrapper environment is a critical need. Due to a variety of reasons, relational-based optimization techniques are of no use when having to handle HTTP-based web sources, so new approaches which take into account client/server communication costs must be devised. This paper describes a cost model that stores values from a complete set of web source-focused parameters obtained by the web wrappers, by using a novel updating technique that handles the values measured by the wrappers in previous query executions, and generates a new model instance in each new iteration with an efficient processing cost. This instance allows rapid value updates caused by changes of the server quality or bandwidth, so typical in this context. The results of these techniques are demonstrated both theoretically and by means of an implementation showing how performance improves in real-world web sources when compared to classical approaches.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Adali, S., Candan, K., Papakonstantinou, Y., Subrahmanian, V.S.: Query Caching and Optimization in distributed mediator systems. In: ACM SIGMOD Conference on Management of Data (1996)
Citeseer Scientific Literature Digital Library, http://citeseer.ist.psu.edu
Du, W., Krishnamurthy, R., Shan, M.: Query Optimization in a Heterogeneous DMBS. In: 18th International Conference on Very Large Databases (1992)
Google Scholar Search Engine, http://scholar.google.com
Hidalgo, J., Pan, A., Losada, J., Álvarez, M.: Adding Physical Optimization to Cost Models in Information Mediators. In: 2005 IEEE Conference on e-Business Engineering (2005)
Hidalgo, J., Pan, A., Losada, J., Álvarez, M., Viña, A.: Building the Architecture of a Statistics-based Query Optimization Solution for Heterogeneous Mediators. In: 6th International Conference on Information Integration and Web-based Applications & Services (2004)
Ives, Z., Florescu, D., Friedman, M., Levy, A., Weld, D.S.: An Adaptive Query Execution System for Data Integration. In: 24th International Conference on Very Large Databases (1999)
Naacke, H., Gardarin, G., Tomasic, A.: Leveraging mediator cost models with heterogeneous data sources. In: ICDE (1998)
Ozcan, R., Haas, L.: Cost Models DO Matter: Providing Cost Information for Diverse Data Sources in a Federated System. In: The VLDB Conference (1999)
Pan, A., Raposo, J., Álvarez, M., Montoto, P., Orjales, V., Hidalgo, J., Ardao, L., Molano, A., Viña, A.: The DENODO Data Integration Platform. In: 28th International Conference on Very Large Databases (2002)
Papakonstantinou, Y., Gupta, A., Haas, L.: Capabilities-Based Query Rewriting in Mediator Systems. In: Fourth International Conference on Parallel and Distributed Information Systems (1996)
Rahal, A., Zhu, Q., Larson, P.-A.: Evolutionary Techniques for Updating Query Cost Models in a Dynamic Multidatabase Environment. The VLDB Journal – The International Journal on Very Large Data Bases 13(2) (2004)
Raposo, J., Pan, A., Hidalgo, J., Viña, A.: The WARGO System: Semi-automatic Wrapper Generation in presence of Complex Data Access Modes. In: 2nd International Workshop on Web Based Collaboration (2002)
Wiederhold, G.: Mediators in the Architecture of Future Information Systems. IEEE Computer, 38–49 (March 1992)
XIWT. Cross-Industry Working Team. Internet Service Performance: Data Analysis and Visualization (July 2000), http://www.xiwt.org/documents/IPERF-paper2.pdf
Zadorozhny, V., Raschid, L., Vidal, M.E.: Efficient Evaluation of Queries in a Mediator for WebSources. In: ACM SIGMOD International Conference on Management of Data (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hidalgo, J., Pan, A., Álvarez, M., Guerrero, J. (2006). Efficiently Updating Cost Repository Values for Query Optimization on Web Data Sources in a Mediator/Wrapper Environment. In: Etzion, O., Kuflik, T., Motro, A. (eds) Next Generation Information Technologies and Systems. NGITS 2006. Lecture Notes in Computer Science, vol 4032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11780991_1
Download citation
DOI: https://doi.org/10.1007/11780991_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35472-7
Online ISBN: 978-3-540-35473-4
eBook Packages: Computer ScienceComputer Science (R0)