OLIVE: Oblivious and Differentially Private Federated Learning on
  Trusted Execution Environment
  Differentially private federated learning (DP-FL) has received increasing
attention to mitigate the privacy risk in federated learning. Although
different schemes for DP-FL have been proposed, there is still a utility gap.
Employing central Differential Privacy in FL (CDP-FL) can provide a good
balance between the privacy and model utility, but requires a trusted server.
Using Local Differential Privacy for FL (LDP-FL) does not require a trusted
server, but suffers from lousy privacy-utility trade-off. Recently proposed
shuffle DP based FL has the potential to bridge the gap between CDP-FL and
LDP-FL without a trusted server; however, there is still a utility gap when the
number of model parameters is large. In this work, we propose OLIVE, a system
that combines the merits from CDP-FL and LDP-FL by leveraging Trusted Execution
Environment (TEE). Our main technical contributions are the analysis and
countermeasures against the vulnerability of TEE in OLIVE. Firstly, we
theoretically analyze the memory access pattern leakage of OLIVE and find that
there is a risk for sparsified gradients, which is common in FL. Secondly, we
design an inference attack to understand how the memory access pattern could be
linked to the training data. Thirdly, we propose oblivious yet efficient
algorithms to prevent the memory access pattern leakage in OLIVE. Our
experiments on real-world data demonstrate that OLIVE is efficient even when
training a model with hundreds of thousands of parameters and effective against
side-channel attacks on TEE.
