A Pilot Study on Detecting Unfairness in Human Decisions With Machine
  Learning Algorithmic Bias Detection
  Fairness in decision-making has been a long-standing issue in our society.
Despite the increasing number of research activities on unfairness mitigation
in machine learning models, there is little research focusing on mitigating
unfairness in human decisions. Fairness in human decisions is as important as,
if not more important than, fairness in machine learning models since there are
processes where humans make the final decisions and machine learning models can
inherit bias from the human decisions they were trained on. As a result, this
work aims to detect unfairness in human decisions, the very first step of
solving the unfair human decision problem.
  This paper proposes to utilize the existing machine learning fairness
detection mechanisms to detect unfairness in human decisions. The rationale
behind this is, while it is difficult to directly test whether a human makes
unfair decisions, with current research on machine learning fairness, it is now
easy to test, on a large scale at a low cost, whether a machine learning model
is unfair. By synthesizing unfair labels on four general machine learning
fairness datasets and one image processing dataset, this paper shows that the
proposed approach is able to detect (1) whether or not unfair labels exist in
the training data and (2) the degree and direction of the unfairness. We
believe that this work demonstrates the potential of utilizing machine learning
fairness to detect human decision fairness. Following this work, research can
be conducted on (1) preventing future unfair decisions, (2) fixing prior unfair
decisions, and (3) training a fairer machine learning model.
