skip to main content
10.1145/1967486.1967634acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiiwasConference Proceedingsconference-collections
research-article

A reinforcement learning based self-healing algorithm for managing context adaptation

Published: 08 November 2010 Publication History

Abstract

In this paper we approach the context adaptation problem by defining a self-healing model that uses a policy-driven reinforcement learning mechanism to take run-time decisions. The self-healing property is enforced by monitoring the system's execution environment for evaluating the degree of fulfilling the context policies in the current context situation, and selecting the healing actions that may be executed. For action selection a reinforcement learning based approach is used to generate the best sequence of actions to be taken for keeping the context resources as close as possible to a policy compliant state.

References

[1]
Amoui, M., Salehie, M., Mirarab, S., and Tahvildari, L. 2008. Adaptive Action Selection in Autonomic Software Using Reinforcement Learning. Proc. of the Fourth International Conference on Autonomic and Autonomous Systems, 175--181. DOI= http://doi.ieeecomputersociety.org/10.1109/ICAS.2008.35.
[2]
Bahati, R. M. and Bauer, M. A. 2008. Adapting to Run-time Changes in Policies Driving Autonomic Management, Proceedings of the Fourth International Conference on Autonomic and Autonomous Systems, Pages 88--93, ISBN:978-0-7695-3093-2.
[3]
Chen, M., Zheng, A. X., Lloyd, J., Jordan, M. I., and Brewer, E. 2004. Failure Diagnosis Using Decision Trees. In 1st Int. Conference on Autonomic Computing, ISBN:0-7695-2114-2.
[4]
Cioara, T., Anghel, I., Salomie, I., and Dinsoreanu, M. 2009. A Policy-based Context Aware Self-Management Model. Proc. of 11th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, Romania (September 26--29 2009). DOI= http://doi.ieeecomputersociety.org/10.1109/SYNASC.2009.28.
[5]
Das, R., Kephart, J. O., Lefurgy, C., Tesauro, G., and Levine, D. W. 2008. Autonomic multiagent management of power and performance in data centers. In Proc. AAMAS2008, 107--114. DOI=http://portal.acm.org/citation.cfm?id=1402816#.
[6]
Fournier, D., Mokhtar, S. B., and Georgantas, N. 2006. Towards Ad hoc Contextual Services for Pervasive Computing. 1st workshop on Middleware for Service Oriented Computing (Melbourne 2006), 36--41. DOI= http://doi.acm.org/10.1145/1169091.1169097.
[7]
Kemppainen, T. 2007. Biology-inspired self-healing system design. University of Helsinki Department of Computer Science, Seminar on self-healing information systems.
[8]
Pournaras, E., Warnier, M., and Brazier, F. 2008. Using intelligent agents for self-adaptation and self-optimization of energy consumption in power networks. In Proc. of 1st Int. Workshop on Agents for Autonomic Computing.
[9]
GAMES Research Project, http://www.green-datacenters.eu/.
[10]
DSRL laboratory, http://dsrl.coned.utcluj.ro.

Cited By

View all
  • (2022)On Evaluating Self-Adaptive and Self-Healing Systems using Chaos Engineering2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)10.1109/ACSOS55765.2022.00018(1-10)Online publication date: Sep-2022
  • (2019)Modeling foundations for executable model-based testing of self-healing cyber-physical systemsSoftware and Systems Modeling (SoSyM)10.1007/s10270-018-00703-y18:5(2843-2873)Online publication date: 1-Oct-2019
  • (2010)An autonomic algorithm for energy efficiency in service centersProceedings of the Proceedings of the 2010 IEEE 6th International Conference on Intelligent Computer Communication and Processing10.1109/ICCP.2010.5606425(281-288)Online publication date: 26-Aug-2010

Index Terms

  1. A reinforcement learning based self-healing algorithm for managing context adaptation
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        iiWAS '10: Proceedings of the 12th International Conference on Information Integration and Web-based Applications & Services
        November 2010
        895 pages
        ISBN:9781450304214
        DOI:10.1145/1967486
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Sponsors

        • IIWAS: International Organization for Information Integration
        • Web-b: Web-b

        In-Cooperation

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 08 November 2010

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. context adaptation
        2. reinforcement learning
        3. self-healing

        Qualifiers

        • Research-article

        Conference

        iiWAS '10
        Sponsor:
        • IIWAS
        • Web-b

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)1
        • Downloads (Last 6 weeks)1
        Reflects downloads up to 13 Feb 2025

        Other Metrics

        Citations

        Cited By

        View all
        • (2022)On Evaluating Self-Adaptive and Self-Healing Systems using Chaos Engineering2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)10.1109/ACSOS55765.2022.00018(1-10)Online publication date: Sep-2022
        • (2019)Modeling foundations for executable model-based testing of self-healing cyber-physical systemsSoftware and Systems Modeling (SoSyM)10.1007/s10270-018-00703-y18:5(2843-2873)Online publication date: 1-Oct-2019
        • (2010)An autonomic algorithm for energy efficiency in service centersProceedings of the Proceedings of the 2010 IEEE 6th International Conference on Intelligent Computer Communication and Processing10.1109/ICCP.2010.5606425(281-288)Online publication date: 26-Aug-2010

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Figures

        Tables

        Media

        Share

        Share

        Share this Publication link

        Share on social media