Sparse Personalized Federated Learning via Maximizing Correlation
  Federated Learning (FL) is a collaborative machine learning technique to
train a global model without obtaining clients' private data. The main
challenges in FL are statistical diversity among clients, limited computing
capability among clients' equipments, and the excessive communication overhead
between servers and clients. To address these challenges, we propose a novel
sparse personalized federated learning scheme via maximizing correlation
FedMac. By incorporating an approximated L1-norm and the correlation between
client models and global model into standard FL loss function, the performance
on statistical diversity data is improved and the communicational and
computational loads required in the network are reduced compared with
non-sparse FL. Convergence analysis shows that the sparse constraints in FedMac
do not affect the convergence rate of the global model, and theoretical results
show that FedMac can achieve good sparse personalization, which is better than
the personalized methods based on L2-norm. Experimentally, we demonstrate the
benefits of this sparse personalization architecture compared with the
state-of-the-art personalization methods (e.g. FedMac respectively achieves
98.95%, 99.37%, 90.90% and 89.06% accuracy on the MNIST, FMNIST, CIFAR-100 and
Synthetic datasets under non-i.i.d. variants).
