Game of Gradients: Mitigating Irrelevant Clients in Federated Learning
  The paradigm of Federated learning (FL) deals with multiple clients
participating in collaborative training of a machine learning model under the
orchestration of a central server. In this setup, each client's data is private
to itself and is not transferable to other clients or the server. Though FL
paradigm has received significant interest recently from the research
community, the problem of selecting the relevant clients w.r.t. the central
server's learning objective is under-explored. We refer to these problems as
Federated Relevant Client Selection (FRCS). Because the server doesn't have
explicit control over the nature of data possessed by each client, the problem
of selecting relevant clients is significantly complex in FL settings. In this
paper, we resolve important and related FRCS problems viz., selecting clients
with relevant data, detecting clients that possess data relevant to a
particular target label, and rectifying corrupted data samples of individual
clients. We follow a principled approach to address the above FRCS problems and
develop a new federated learning method using the Shapley value concept from
cooperative game theory. Towards this end, we propose a cooperative game
involving the gradients shared by the clients. Using this game, we compute
Shapley values of clients and then present Shapley value based Federated
Averaging (S-FedAvg) algorithm that empowers the server to select relevant
clients with high probability. S-FedAvg turns out to be critical in designing
specific algorithms to address the FRCS problems. We finally conduct a thorough
empirical analysis on image classification and speech recognition tasks to show
the superior performance of S-FedAvg than the baselines in the context of
supervised federated learning settings.
