Abstract
Consistently good performance required by mission-critical information systems has made it a pressing demand for self-tuning technologies in DBMSs. Automated Statistics management is an important step towards a self-tuning DBMS and plays a key role in improving the quality of execution plans generated by the optimizer, and hence leads to shorter query processing times. In this paper, we present SASM, a framework for Self-Adaptive Statistics Management where, using query feedback information, an appropriate set of histograms is recommended and refined, and through histogram refining and reconstruction, fixed amount of memory is dynamically distributed to histograms which are most useful to the current workload. Extensive experiments showed the effectiveness of our techniques.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Weikum, G., Moenkeberg, A., Hasse, C., Zabback, P.: Self-tuning Database Technology and Informatino Services: from Wishful Thinking to Viable Engineering. In: Proceedings of the 28th International Conference on Very Large DataBases, HongKong, China, pp. 20–31 (2002)
Chaudhuri, S., Datar, M., Narasayya, V.: Index selection for databases: a hardness study and a principled heuristic solution. IEEE Transactions on Knowledge and Data Engineering 16(11), 1313–1323 (2004)
Zilio, D.C., Zuzarte, C., Lohman, G.M., Cochrane, R.J., Gryz, J., Alton, E., Valentin, G.: Recommending Materizlized Views and Indexes with the IBM DB2 Design Advisor. In: Proceedings of the International Conference on Autonomic Computing, New York, USA, pp. 180–187 (2004)
Automated Selection of Materialized Views and Indexes for SQL Databases. In: Proceedings of the 26th International Conference on Very Large Data Bases, Cairo, Egypt, pp. 496-505 (2000)
Chaudhuri, S., Narasayya, V.: An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server. In: Proceedings of the 23rd International Conference on Very Large Data Bases, Athens, Greece, pp. 146–155 (1997)
Sattler, K.-U., Schallehn, E., Geist, I.: Autonomous Query-Driven Index Tuning. In: Proceedings of the International Database Engineering and Applications Symposium, pp. 439–448 (2004)
Agrawal, S., Narasayya, V., Yang, B.: Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Paris, France, pp. 359–370 (2004)
Chaudhuri, S., Narasayya, V.: Automating Statistics Management for Query Optimizers. In: Proceedings of the 16th International Conference on Data Engineering (2000)
Aboulnaga, A., Haas, P., Kandi, M., Lightstone, S., Lohman, G., Mark, V., Popivanov, I., Raman, V.: Automated Statistics Collection in DB2 UDB. In: Proccedings of the 30th International Conference on Very Large Data Bases, Toronto, Canada, pp. 1146–1157 (2004)
Ilyas, I., Markl, V., Haas, P.J., Brown, P.G., Aboulnaga, A.: Automatic Relationship Discovery in Self-Managing Database Systems. In: Proceedings of the International Conference on Autonomic Computing (2004)
Ilyas, I.F., Markl, V., Haas, P.J., Brown, P.G., Aboulnaga, A.: CORDS: Automatic Generation of Correlation Statistics in DB2. In: Proceedings of the 30th International Conference on Very Large Data Bases, Toronto, Canada, pp. 1341–1344 (2004)
IIyas, I.F., Markl, V., Haas, P., Brown, P., Aboulnaga, A.: CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies. In: Proceedings of ACM SIGMOD Internation Conference on Management of Data, Paris, France (2004)
Ioannidis, Y.: The History of Histograms. In: Proceedings of the 29th International Conference on Very Large DataBases, Berlin, Germany, pp. 19–30 (2003)
Bruno, N., Chaudhuri, S.: Exploiting Statistics on Query Expressions for Optimization. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Madison, Wisconsin, USA, pp. 263–274 (2002)
Stillger, M., Lohman, G., Mark, V., Kandil, M.: LEO-DB2’s Learning Optimizer. In: Proceedings of the 27th International Conference on Very Large DataBases, Roma, Italy, pp. 19–28 (2001)
Aboulnaga, A., Chaudhuri, S.: Self-Tuning Histograms: Building Histograms without Looking at Data. In: Proceedings of ACM SIGMOD International Conference on Management of Data, pp. 181–192 (1999)
Bruno, N., Chaudhuri, S., Gravano, L.: STHoles:A Multidimensional Workload-Aware Histogram. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Santa Barbara, CA, USA, pp. 211–222 (2001)
Li, X., Zhou, B., Dong, J.: Self-Learning Histograms for Changing Workloads. In: To appear in the Ninth International Database Engineering and Applications Symposium, Montreal, Canada (2005)
Jagadish, H.V., Jin, H., Ooi, B.C., Tan, K.-L.: Global Optimization of Histogram. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Santa Barbara, California, USA, pp. 223–234 (2001)
Lim, L., Wang, M., Vitter, J.S.: SASH: A Self-Adaptive Histogram Set for Dynamically Changing Workloads. In: Proceedings of the 29th International Conference on Very Large DataBases, Berlin, Germany, pp. 369–380 (2003)
Zipf, G.: Human Behavior and the Principle of Least Effort. Addison-Wesley, Reading (1949)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Li, X., Chen, G., Dong, J., Wang, Y. (2005). Self-adaptive Statistics Management for Efficient Query Processing. In: Fan, W., Wu, Z., Yang, J. (eds) Advances in Web-Age Information Management. WAIM 2005. Lecture Notes in Computer Science, vol 3739. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11563952_10
Download citation
DOI: https://doi.org/10.1007/11563952_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29227-2
Online ISBN: 978-3-540-32087-6
eBook Packages: Computer ScienceComputer Science (R0)