Differentially Private and Fair Classification via Calibrated Functional
  Mechanism
  Machine learning is increasingly becoming a powerful tool to make decisions
in a wide variety of applications, such as medical diagnosis and autonomous
driving. Privacy concerns related to the training data and unfair behaviors of
some decisions with regard to certain attributes (e.g., sex, race) are becoming
more critical. Thus, constructing a fair machine learning model while
simultaneously providing privacy protection becomes a challenging problem. In
this paper, we focus on the design of classification model with fairness and
differential privacy guarantees by jointly combining functional mechanism and
decision boundary fairness. In order to enforce $\epsilon$-differential privacy
and fairness, we leverage the functional mechanism to add different amounts of
Laplace noise regarding different attributes to the polynomial coefficients of
the objective function in consideration of fairness constraint. We further
propose an utility-enhancement scheme, called relaxed functional mechanism by
adding Gaussian noise instead of Laplace noise, hence achieving
$(\epsilon,\delta)$-differential privacy. Based on the relaxed functional
mechanism, we can design $(\epsilon,\delta)$-differentially private and fair
classification model. Moreover, our theoretical analysis and empirical results
demonstrate that our two approaches achieve both fairness and differential
privacy while preserving good utility and outperform the state-of-the-art
algorithms.
