Learning Fair Representations via Rate-Distortion Maximization
  Text representations learned by machine learning models often encode
undesirable demographic information of the user. Predictive models based on
these representations can rely on such information resulting in biased
decisions. We present a novel debiasing technique Fairness-aware Rate
Maximization (FaRM), that removes demographic information by making
representations of instances belonging to the same protected attribute class
uncorrelated using the rate-distortion function. FaRM is able to debias
representations with or without a target task at hand. FaRM can also be adapted
to simultaneously remove information about multiple protected attributes.
Empirical evaluations show that FaRM achieves state-of-the-art performance on
several datasets, and learned representations leak significantly less protected
attribute information against an attack by a non-linear probing network.
