Authors:
Ondřej Šubrt
1
;
Martin Bodlák
2
;
Matouš Jandek
1
;
Vladimír Jarý
1
;
Antonín Květoň
2
;
Josef Nový
1
;
Miroslav Virius
1
and
Martin Zemko
1
Affiliations:
1
Czech Technical University in Prague, Prague, Czech Republic
;
2
Charles University, Prague, Czech Republic
Keyword(s):
Data Acquisition System, Artificial Intelligence, Reinforcement Learning, Load Balancing, Optimization.
Abstract:
Currently, modern experiments in high energy physics impose great demands on the reliability, efficiency, and data rate of Data Acquisition Systems (DAQ). The paper deals with the Load Balancing (LB) problem of the intelligent, FPGA-based Data Acquisition System (iFDAQ) of the COMPASS experiment at CERN and presents a methodology applied in finding optimal solution. Machine learning approaches, seen as a subfield of artificial intelligence, have become crucial for many well-known optimization problems in recent years. Therefore, algorithms based on machine learning are worth investigating with respect to the LB problem. Reinforcement learning (RL) represents a machine learning search technique using an agent interacting with an environment so as to maximize certain notion of cumulative reward. In terms of RL, the LB problem is considered as a multi-stage decision making problem. Thus, the RL proposal consists of a learning algorithm using an adaptive ε–greedy strategy and a policy re
trieval algorithm building a comprehensive search framework. Finally, the performance of the proposed RL approach is examined on two LB test cases and compared with other LB solution methods.
(More)