Understanding Exploration and Exploitation of Q-Learning Agents in B5G Network Management | IEEE Conference Publication | IEEE Xplore