Differentially Private Federated Variational Inference
  In many real-world applications of machine learning, data are distributed
across many clients and cannot leave the devices they are stored on.
Furthermore, each client's data, computational resources and communication
constraints may be very different. This setting is known as federated learning,
in which privacy is a key concern. Differential privacy is commonly used to
provide mathematical privacy guarantees. This work, to the best of our
knowledge, is the first to consider federated, differentially private, Bayesian
learning. We build on Partitioned Variational Inference (PVI) which was
recently developed to support approximate Bayesian inference in the federated
setting. We modify the client-side optimisation of PVI to provide an
(${\epsilon}$, ${\delta}$)-DP guarantee. We show that it is possible to learn
moderately private logistic regression models in the federated setting that
achieve similar performance to models trained non-privately on centralised
data.
