Abstract
Distributed databases operating over wide-area networks such as the Internet, must deal with the unpredictable nature of the performance of communication. The response times of accessing remote sources can vary widely due to network congestion, link failure, and other problems. In such an unpredictable environment, the traditional iterator-based query execution model performs poorly. We have developed a class of methods, called query scrambling, for dealing explicitly with the problem of unpredictable response times. Query scrambling dynamically modifies query execution plans on-the-fly in reaction to unexpected delays in data access. In this paper we focus on the dynamic scheduling of query operators in the context of query scrambling. We explore various choices for dynamic scheduling and examine, through a detailed simulation, the effects of these choices. Our experimental environment considers pipelined and non-pipelined join processing in a client with multiple remote data sources and delayed or possibly bursty arrivals of data. Our performance results show that scrambling rescheduling is effective in hiding the impact of delays on query response time for a number of different delay scenarios.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
S. Adali, K. Candan, Y. Papakonstantinou, and V. Subrahmanian. Query caching and optimization in distributed mediator systems. In Proc. of the ACM SIGMOD Int. Conf., Montreal, Canada, 1996.
L. Amsaleg, M. Franklin, A. Tomasic, and T. Urhan. Scrambling query plans to cope with unexpected delays. In Proc. of the Int. Conf. on Parallel and Distributed Information Systems (PDIS), Miami Beach, Florida, December 1996.
Laurent Amsaleg, Michael J. Franklin, and Anthony Tomasic. Query scrambling for bursty data arrival. Technical Report UMCP-CSD CS-TR-3714, University of Maryland, College Park, Maryland, November 1996.
G. Antoshenkov. Dynamic query optimization in Rdb/VMS. In Proc. of the Data Engineering Int. Conf., pages 538-547, Vienna, Austria, 1993.
J. Blakeley, W. McKenna, and G. Graefe. Experiences building the open OODB query optimizer. In Proc. of the ACM SIGMOD Int. Conf., page 287, Washington, DC, May 1993.
P. Bodorik, J. Riordon, and C. Jacob. Dynamic distributed query processing techniques. In Proc. of the 17th annual ACM Computer Science Conf., pages 348-357, Louisville, Kentucky, February 1989.
K. Brown. Prpl: A database workload specification language. Master's thesis, University of Winsconsin, Madison, Winsconsin, 1992.
O. Bukhres and A. Elmagarmid. Object-Oriented Multidatabase Systems. Prentice Hall, 1996.
M. Carey, D. DeWitt, M. Franklin, N. Hall, M. McAuliffe, J. Naughton, D. Schuh, M. Solomon, C. Tan, O. Tsatalos, S. White, and M. Zwilling. Shoring up persistent applications. In Proc. of the ACM SIGMOD Int. Conf., Minneapolis, Minnesota, May 1994.
R. Cole and G. Graefe. Optimization of dynamic query execution plans. In Proc. of the ACM SIGMOD Int. Conf., pages 150-160, Minneapolis, Minnesota, May 1994.
S. Dar, M. Franklin, B. Jónsson, D. Srivastava, and M. Tan. Semantic data caching and replacement. In Proc. of the 22th VLDB Int. Conf, Bombay, India, September 1996.
M. Franklin, B. Jónsson, and D. Kossmann. Performance tradeoffs for client-server query processing. In Proc. of the ACM SIGMOD Int. Conf., Montréal, Canada, June 1996.
G. Graefe. Query evaluation techniques for large databases. ACM Computing Surveys, 25(2):73-170, June 1993.
W. Kim. Modern Database Systems: The Object Model, Interoperability, and Beyond. ACM Press, New York, NY, 1995.
A. Mendelzon, G. Mihaila, and T. Milo. Querying the world wide web. In Proc. of the Int. Conf. on Parallel and Distribution Information Systems (PDIS), Miami Beach, Florida, December 1996.
F. Ozcan, S. Nural, P. Koksal, C. Evrendilek, and A. Dogac. Dynamic query optimization on a distributed object management platform. In Conference on Information and Knowledge Management, Baltimore, Maryland, November 1996.
S. Sarawagi and M. Stonebraker. Reordering execution in tertiary memory databases. In VLDB, Bombay, India, 1996.
M. Shan, R. Ahmen, J. Davis, W. Du, and W. Kent. Modern Database Systems: The Object Model, Interoperability, and Beyond, chapter Pegasus: A Heterogeneous Information Management System. ACM Press, 1995.
M. Stonebraker, P. Aoki, W. Litwin, A. Pfeffer, A. Sah, J. Sidell, C. Staelin, and A. Yu. Mariposa: A wide-area distributed database system. The VLDB Journal, 5(1):48-63, January 1996.
G. Thomas, G. Thompson, C. Chung, E. Barkmeyer, F. Carter, M. Templeton, S. Fox, and B. Hartman. Heterogeneous distributed database systems for product use. ACM Computing Surveys, 22(3), 1990.
A. Tomasic, L. Raschid, and P. Valduriez. Scaling heterogeneous databases and the design of DISCO. In The IEEE Int. Conf. on Distributed Computing Systems (ICDCS-16), Hong Kong, 1996.
Transaction Processing Performance Council (TPC). TPC Benchmark D (Decision Support), May 1995. Standard Specification, Revision 1.0.
T. Urhan, M. Franklin, and L. Amsaleg. Cost based query scrambling for initial delays. In Proc. of the ACM SIGMOD Int. Conf., Seattle, Washington, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Amsaleg, L., Franklin, M.J. & Tomasic, A. Dynamic Query Operator Scheduling for Wide-Area Remote Access. Distributed and Parallel Databases 6, 217–246 (1998). https://doi.org/10.1023/A:1008646115473
Issue Date:
DOI: https://doi.org/10.1023/A:1008646115473