Fairness implications of encoding protected categorical attributes
  Protected attributes are often presented as categorical features that need to
be encoded before feeding them into a machine learning algorithm. Encoding
these attributes is paramount as they determine the way the algorithm will
learn from the data. Categorical feature encoding has a direct impact on the
model performance and fairness. In this work, we compare the accuracy and
fairness implications of the two most well-known encoders: one-hot encoding and
target encoding. We distinguish between two types of induced bias that can
arise while using these encodings and can lead to unfair models. The first
type, irreducible bias, is due to direct group category discrimination and a
second type, reducible bias, is due to large variance in less statistically
represented groups. We take a deeper look into how regularization methods for
target encoding can improve the induced bias while encoding categorical
features. Furthermore, we tackle the problem of intersectional fairness that
arises when mixing two protected categorical features leading to higher
cardinality. This practice is a powerful feature engineering technique used for
boosting model performance. We study its implications on fairness as it can
increase both types of induced bias
