Welcome to the InfoSci Platform
Reference Hub5
A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition

A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition

Xuezhi Yu, Chunyang Ye, Bingzhuo Li, Hui Zhou, Mengxing Huang
Copyright: © 2020 |Volume: 17 |Issue: 4 |Pages: 21
ISSN: 1545-7362|EISSN: 1546-5004|EISBN13: 9781799804925|DOI: 10.4018/IJWSR.2020100104
Cite Article Cite Article

MLA

Yu, Xuezhi, et al. "A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition." IJWSR vol.17, no.4 2020: pp.55-75. http://doi.org/10.4018/IJWSR.2020100104

APA

Yu, X., Ye, C., Li, B., Zhou, H., & Huang, M. (2020). A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition. International Journal of Web Services Research (IJWSR), 17(4), 55-75. http://doi.org/10.4018/IJWSR.2020100104

Chicago

Yu, Xuezhi, et al. "A Deep Q-Learning Network for Dynamic Constraint-Satisfied Service Composition," International Journal of Web Services Research (IJWSR) 17, no.4: 55-75. http://doi.org/10.4018/IJWSR.2020100104

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Traditional service composition methods usually address the constraint-satisfied service composition (CSSC) problem with static web services. Such solutions however are inapplicable to the dynamic scenarios where the services or their QoS values may change over time. Some recent studies are proposed to use reinforcement learning, especially, integrate the idea of Q-learning, to solve the dynamic CSSC problem. However, such Q-learning algorithm relies on Q-table to search for optimal candidate services. When the problem of CSSC becomes complex, the number of states in Q-table is very large and the cost of the Q-learning model will become extremely high. In this paper, the authors propose a novel solution to address this issue. By training a DQN network to replace the Q-table, this solution can effectively model the uncertainty of services with fine-grained QoS attributes and choose suitable candidate services to compose on the fly in the dynamic scenarios. Experimental results on both artificial and real datasets demonstrate the effectiveness of the method.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.