Andrew Keenan
ABSTRACT
Q-Learning is a type of reinforcement learning which learns how to optimize an agent's choice of actions in a given environment based on experience. Typically, Q-Learning is implemented using a lookup table indexed by state/action tuples. For many applications, this approach can be difficult or impossible, as their state space is too large or cannot accurately be captured in a table. A neural network can act as a function approximator for the Q-Learning Table. This reduces learning time and allows for generalization on unvisited states The neural network can be trained using the Back propagation algorithm with the state/action tuple as input and the output of the update rule as the new target value. The weights of the network are updated to produce the correct output value for inputs in the training set. We have implemented this technique in a 2-D simulation of soccer, where agents learn how to maneuver the ball in order to score a goal.
Index Terms
- NeuroSoccer: Neural Network Q-Learning (Abstract Only)
Recommendations
Intelligent Traffic Light Control of Isolated Intersections Using Machine Learning Methods
SMC '13: Proceedings of the 2013 IEEE International Conference on Systems, Man, and CyberneticsTraffic congestion is one of the major problems in modern cities. This study applies machine learning methods to determine green times in order to minimize in an isolated intersection. Q-learning and neural networks are applied here to set signal light ...
A novel modular Q-learning architecture to improve performance under incomplete learning in a grid soccer game
Multi-agent reinforcement learning methods suffer from several deficiencies that are rooted in the large state space of multi-agent environments. This paper tackles two deficiencies of multi-agent reinforcement learning methods: their slow learning rate,...
A review on computational intelligence methods for controlling traffic signal timing
We have a review of applying machine learning methods (ML) for traffic signal timing.Signal timing through ML methods for a single intersection.Using genetic algorithm to determine NN and FLS parameters.Showing the better performance of ML methods ...
Comments