Bounding Information Leakage in Machine Learning
  Machine Learning services are being deployed in a large range of applications
that make it easy for an adversary, using the algorithm and/or the model, to
gain access to sensitive data. This paper investigates fundamental bounds on
information leakage. First, we identify and bound the success rate of the
worst-case membership inference attack, connecting it to the generalization
error of the target model. Second, we study the question of how much sensitive
information is stored by the algorithm about the training set and we derive
bounds on the mutual information between the sensitive attributes and model
parameters. Although our contributions are mostly of theoretical nature, the
bounds and involved concepts are of practical relevance. Inspired by our
theoretical analysis, we study linear regression and DNN models to illustrate
how these bounds can be used to assess the privacy guarantees of ML models.
