skip to main content
10.1145/1316874.1316892acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Towards workload shift detection and prediction for autonomic databases

Published: 09 November 2007 Publication History

Abstract

Due to the complexity of industry-scale database systems, the total cost of ownership for these systems is no longer dominated by hardware and software, but by administration expenses. Autonomic databases intend to reduce these costs by providing self-management features. Existing approaches towards this goal are supportive advisors for the database administrator and feedback control loops for online monitoring, analysis and re-configuration. But while advisors are too resource-consuming for continuous operation, feedback control loops suffer from overreaction, oscillation and interference.
In this position paper we give a general analysis of the parameters that affect the self-management of a database. Out of these parameters, we identify that the workload has major influence on both physical design of data and DBMS configuration. Hence, we propose to employ a workload model for light-weight, continuous workload monitoring and analysis. This model can be used for the identification and prediction of significant workload shifts, which require autonomic re-configuration of the database.

References

[1]
A. Aboulnaga, P. J. Haas, S. Lightstone, G. M. Lohman, V. Markl, I. Popivanov, and V. Raman. Automated statistics collection in DB2 UDB. In Proceedings of the 30th International Conference on Very Large Data Bases, pages 1146--1157. Morgan Kaufmann, 2004.
[2]
S. Agrawal, E. Chu, and V. Narasayya. Automatic physical design tuning: workload as a sequence. In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 683--694. ACM Press, 2006.
[3]
S. Agrawal et al. Database Tuning Advisor for Microsoft SQL Server 2005. In Proceedings of the 30th International Conference on Very Large Data Bases, pages 1110--1121. Morgan Kaufmann, 2004.
[4]
N. Bruno and S. Chaudhuri. To tune or not to tune?: a lightweight physical design alerter. In Proceedings of the 32nd international conference on Very large data bases, pages 499--510. VLDB Endowment, 2006.
[5]
N. Bruno and S. Chaudhuri. An online approach to physical design tuning. In Proceedings of the 23nd International Conference on Data Engineering, pages 826--835. IEEE Computer Society, 2007.
[6]
B. Dageville, D. Das, K. Dias, K. Yagoub, M. Zait, and M. Ziauddin. Automatic SQL tuning in Oracle 10g. In Proceedings of the 30th International Conference on Very Large Data Bases, pages 1098--1109. Morgan Kaufmann, 2004.
[7]
B. Dageville and K. Dias. Oracle's self-tuning architecture and solutions. IEEE Data Engineering Bulletin, 29(3), 2006.
[8]
Y. Diao, J. L. Hellerstein, S. Parekh, R. Griffith, G. Kaiser, and D. Phung. Self-managing systems: A control theory foundation. In Proceedings of the 12th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems, pages 441--448. IEEE Computer Society, 2005.
[9]
S. Elnaffar, W. Powley, D. Benoit, and P. Martin. Today's DBMSs: How autonomic are they? In Proceedings of the 14th International Workshop on Database and Expert Systems Applications, pages 651--655. IEEE Computer Society, 2003.
[10]
S. S. Elnaffar and P. Martin. An intelligent framework for predicting shifts in the workloads of autonomic database management systems. In Proceedings of IEEE International Conference on Advances in Intelligent Systems -- Theory and Applications, 2004.
[11]
Ganik and Corbi. The dawning of the autonomic computing era. IBM SYSTEMS JOURNAL, 42(1):5--18, 2003.
[12]
T. Härder and A. Reuter. Concepts for implementing a centralized database management system. In Proceedings International Computing Symposium on Application Systems Development, pages 28--59. B. G. Teubner, 1983.
[13]
E. Kwan, S. Lightstone, A. Storm, and L. Wu. Automatic configuration for IBM DB2 Universal Database. Performance technical report, International Business Machines Corporation, 2002.
[14]
T. Lahiri, A. Nithrkashyap, S. Kumar, B. Hirano, K. Pate, and P. Kumar. The self-managing database: Automatic SGA memory management. White paper, Oracle Corporation, 2003.
[15]
P. Martin, S. Elnaffar, and T. Wasserman. Workload models for autonomic database management systems. In Proceedings of the International Conference on Autonomic and Autonomous Systems, page 10. IEEE Computer Society, 2006.
[16]
S. Parekh et al. Throttling utilities in the IBM DB2 Universal Database server. In Proceedings of the American Control Conference, pages 1986--1991. IEEE Computer Society, 2004.
[17]
K. Schnaitter, S. Abiteboul, T. Milo, and N. Polyzotis. On-line index selection for shifting workloads. In Proceedings of ICDE Workshops (SMDB 2007), pages 459--468. IEEE Computer Society, 2007.
[18]
A. J. Storm, C. Garcia-Arellano, S. S. Lightstone, Y. Diao, and M. Surendra. Adaptive self-tuning memory in DB2. In Proceedings of 32nd International Conference on Very Large Data Bases, pages 1081--1092. ACM, 2006.
[19]
G. Weikum, A. Mönkeberg, C. Hasse, and P. Zabback. Self-tuning database technology and information services: from wishful thinking to viable engineering. In Proceedings of 28th International Conference on Very Large Data Bases, pages 20--31. Morgan Kaufmann, 2002.
[20]
P. Yu, M.-S. Chen, H.-U. Heiss, and S. Lee. On workload characterization of relational database environments. IEEE Transactions on Software Engineering, 18(4):347--355, 1992.
[21]
D. C. Zilio et al. Recommending materialized views and indexes with IBM DB2 Design Advisor. In Proceedings of the International Conference on Autonomic Computing, pages 180--188. IEEE Computer Society, 2004.

Cited By

View all

Index Terms

  1. Towards workload shift detection and prediction for autonomic databases

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    PIKM '07: Proceedings of the ACM first Ph.D. workshop in CIKM
    November 2007
    184 pages
    ISBN:9781595938329
    DOI:10.1145/1316874
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 November 2007

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. DBMS architecture
    2. autonomic databases
    3. workload modelling
    4. workload shift detection
    5. workload shift prediction

    Qualifiers

    • Research-article

    Conference

    CIKM07

    Acceptance Rates

    Overall Acceptance Rate 25 of 62 submissions, 40%

    Upcoming Conference

    CIKM '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)36
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Modeling Shifting Workloads for Learned Database SystemsProceedings of the ACM on Management of Data10.1145/36392932:1(1-27)Online publication date: 26-Mar-2024
    • (2022)TiresiasProceedings of the VLDB Endowment10.14778/3551793.355185715:11(3126-3136)Online publication date: 29-Sep-2022
    • (2022)LightPro: Lightweight Probabilistic Workload Prediction Framework for Database-as-a-Service2022 IEEE International Conference on Web Services (ICWS)10.1109/ICWS55610.2022.00036(160-169)Online publication date: Jul-2022
    • (2022)TEALED: A Multi-Step Workload Forecasting Approach Using Time-Sensitive EMD and Auto LSTM Encoder-DecoderDatabase Systems for Advanced Applications10.1007/978-3-031-00126-0_55(706-713)Online publication date: 8-Apr-2022
    • (2021)Workload-Aware Performance Tuning for Autonomous DBMSs2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00267(2365-2368)Online publication date: Apr-2021
    • (2020)ChronoCache: Predictive and Adaptive Mid-Tier Query Result CachingProceedings of the 2020 ACM SIGMOD International Conference on Management of Data10.1145/3318464.3380593(2391-2406)Online publication date: 11-Jun-2020
    • (2018)Query-based Workload Forecasting for Self-Driving Database Management SystemsProceedings of the 2018 International Conference on Management of Data10.1145/3183713.3196908(631-645)Online publication date: 27-May-2018
    • (2017)The design of an adaptive column-store systemJournal of Big Data10.1186/s40537-017-0069-44:1Online publication date: 23-Mar-2017
    • (2015)Towards Self-management in a Distributed Column-Store SystemNew Trends in Databases and Information Systems10.1007/978-3-319-23201-0_12(97-107)Online publication date: 28-Aug-2015
    • (2012)Saving DBMS Resources While Running Batch Cycles in Data WarehousesKnowledge and Technology Adoption, Diffusion, and Transfer10.4018/978-1-4666-1752-0.ch009(118-132)Online publication date: 2012
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media