Exploiting Heterogeneity in Robust Federated Best-Arm Identification
  We study a federated variant of the best-arm identification problem in
stochastic multi-armed bandits: a set of clients, each of whom can sample only
a subset of the arms, collaborate via a server to identify the best arm (i.e.,
the arm with the highest mean reward) with prescribed confidence. For this
problem, we propose Fed-SEL, a simple communication-efficient algorithm that
builds on successive elimination techniques and involves local sampling steps
at the clients. To study the performance of Fed-SEL, we introduce a notion of
arm-heterogeneity that captures the level of dissimilarity between
distributions of arms corresponding to different clients. Interestingly, our
analysis reveals the benefits of arm-heterogeneity in reducing both the sample-
and communication-complexity of Fed-SEL. As a special case of our analysis, we
show that for certain heterogeneous problem instances, Fed-SEL outputs the
best-arm after just one round of communication. Our findings have the following
key implication: unlike federated supervised learning where recent work has
shown that statistical heterogeneity can lead to poor performance, one can
provably reap the benefits of both local computation and heterogeneity for
federated best-arm identification. As our final contribution, we develop
variants of Fed-SEL, both for federated and peer-to-peer settings, that are
robust to the presence of Byzantine clients, and hence suitable for deployment
in harsh, adversarial environments.
