Loading [a11y]/accessibility-menu.js
On No-Sensing Adversarial Multi-Player Multi-Armed Bandits With Collision Communications | IEEE Journals & Magazine | IEEE Xplore

On No-Sensing Adversarial Multi-Player Multi-Armed Bandits With Collision Communications


Abstract:

We study the notoriously difficult no-sensing adversarial multi-player multi-armed bandits (MP-MAB) problem from a new perspective. Instead of focusing on the hardness of...Show More

Abstract:

We study the notoriously difficult no-sensing adversarial multi-player multi-armed bandits (MP-MAB) problem from a new perspective. Instead of focusing on the hardness of multiple players, we introduce a new dimension of hardness, called attackability. All adversaries can be categorized based on the attackability and we introduce Adversary-Adaptive Collision-Communication (A2C2), a family of algorithms with forced-collision communication among players. Both attackability-aware and unaware settings are studied, and information-theoretic tools of the Z-channel model and error-correction coding are utilized to address the challenge of implicit communication without collision information in an adversarial environment. For the more challenging attackability-unaware problem, we propose a simple method to estimate the attackability enabled by a novel error-detection repetition code and randomized communication for synchronization. Theoretical analysis proves that asymptotic attackability-dependent sublinear regret can be achieved, with or without knowing the attackability. In particular, the asymptotic regret does not have an exponential dependence on the number of players, revealing a fundamental tradeoff between the two dimensions of hardness in this problem.
Published in: IEEE Journal on Selected Areas in Information Theory ( Volume: 2, Issue: 2, June 2021)
Page(s): 515 - 533
Date of Publication: 27 April 2021
Electronic ISSN: 2641-8770

Funding Agency:


References

References is not available for this document.