Achieving Fairness with a Simple Ridge Penalty
  In this paper we present a general framework for estimating regression models
subject to a user-defined level of fairness. We enforce fairness as a model
selection step in which we choose the value of a ridge penalty to control the
effect of sensitive attributes. We then estimate the parameters of the model
conditional on the chosen penalty value. Our proposal is mathematically simple,
with a solution that is partly in closed form, and produces estimates of the
regression coefficients that are intuitive to interpret as a function of the
level of fairness. Furthermore, it is easily extended to generalised linear
models, kernelised regression models and other penalties; and it can
accommodate multiple definitions of fairness.
  We compare our approach with the regression model from Komiyama et al.
(2018), which implements a provably-optimal linear regression model; and with
the fair models from Zafar et al. (2019). We evaluate these approaches
empirically on six different data sets, and we find that our proposal provides
better goodness of fit and better predictive accuracy for the same level of
fairness. In addition, we highlight a source of bias in the original
experimental evaluation in Komiyama et al. (2018).
