Federated Residual Learning
  We study a new form of federated learning where the clients train
personalized local models and make predictions jointly with the server-side
shared model. Using this new federated learning framework, the complexity of
the central shared model can be minimized while still gaining all the
performance benefits that joint training provides. Our framework is robust to
data heterogeneity, addressing the slow convergence problem traditional
federated learning methods face when the data is non-i.i.d. across clients. We
test the theory empirically and find substantial performance gains over
baselines.
