loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Yudai Tagawa ; Hernán Aguirre and Kiyoshi Tanaka

Affiliation: Department of Electrical and Computer Engineering, Shinshu University, Wakasato, Nagano, Japan

Keyword(s): Multi-Objective Optimization, Reinforcement Learning, Q-learning, MNK-landscapes.

Abstract: In this paper, we study distributed and centralized approaches of Q-learning for multi-objective optimization of binary problems and investigate their characteristics and performance on complex epistatic problems using MNK-landscapes. In the distributed approach an agent receives its reward optimizing one of the objective functions and collaborates with others to generate Pareto non-dominated solutions. In the centralized approach the agent receives its reward based on Pareto dominance optimizing simultaneously all objective functions. We encode a solution as part of a state and investigate two types of actions as one-bit mutation operators, two methods to generate an episode’s initial state and the number of steps an agent is allowed to explore without improving. We also compare with some evolutionary multi-objective optimizers showing that Q-learning based approaches scale up better as we increase the number of objectives on problems with large epistasis.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.144.86.138

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Tagawa, Y.; Aguirre, H. and Tanaka, K. (2023). A Study on Multi-Objective Optimization of Epistatic Binary Problems Using Q-learning. In Proceedings of the 15th International Joint Conference on Computational Intelligence - ECTA; ISBN 978-989-758-674-3; ISSN 2184-3236, SciTePress, pages 163-171. DOI: 10.5220/0012156300003595

@conference{ecta23,
author={Yudai Tagawa. and Hernán Aguirre. and Kiyoshi Tanaka.},
title={A Study on Multi-Objective Optimization of Epistatic Binary Problems Using Q-learning},
booktitle={Proceedings of the 15th International Joint Conference on Computational Intelligence - ECTA},
year={2023},
pages={163-171},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012156300003595},
isbn={978-989-758-674-3},
issn={2184-3236},
}

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computational Intelligence - ECTA
TI - A Study on Multi-Objective Optimization of Epistatic Binary Problems Using Q-learning
SN - 978-989-758-674-3
IS - 2184-3236
AU - Tagawa, Y.
AU - Aguirre, H.
AU - Tanaka, K.
PY - 2023
SP - 163
EP - 171
DO - 10.5220/0012156300003595
PB - SciTePress