LAMP: Extracting Text from Gradients with Language Model Priors
  Recent work shows that sensitive user data can be reconstructed from gradient
updates, breaking the key privacy promise of federated learning. While success
was demonstrated primarily on image data, these methods do not directly
transfer to other domains such as text. In this work, we propose LAMP, a novel
attack tailored to textual data, that successfully reconstructs original text
from gradients. Our key insight is to model the prior probability of the text
with an auxiliary language model, utilizing it to guide the search towards more
natural text. Concretely, LAMP introduces a discrete text transformation
procedure that minimizes both the reconstruction loss and the prior text
probability, as provided by the auxiliary language model. The procedure is
alternated with a continuous optimization of the reconstruction loss, which
also regularizes the length of the reconstructed embeddings. Our experiments
demonstrate that LAMP reconstructs the original text significantly more
precisely than prior work: we recover 5x more bigrams and $23\%$ longer
subsequences on average. Moreover, we are first to recover inputs from batch
sizes larger than 1 for textual models. These findings indicate that gradient
updates of models operating on textual data leak more information than
previously thought.
