In Pursuit of Interpretable, Fair and Accurate Machine Learning for
  Criminal Recidivism Prediction
  Objectives: We study interpretable recidivism prediction using machine
learning (ML) models and analyze performance in terms of prediction ability,
sparsity, and fairness. Unlike previous works, this study trains interpretable
models that output probabilities rather than binary predictions, and uses
quantitative fairness definitions to assess the models. This study also
examines whether models can generalize across geographic locations. Methods: We
generated black-box and interpretable ML models on two different criminal
recidivism datasets from Florida and Kentucky. We compared predictive
performance and fairness of these models against two methods that are currently
used in the justice system to predict pretrial recidivism: the Arnold PSA and
COMPAS. We evaluated predictive performance of all models on predicting six
different types of crime over two time spans. Results: Several interpretable ML
models can predict recidivism as well as black-box ML models and are more
accurate than COMPAS or the Arnold PSA. These models are potentially useful in
practice. Similar to the Arnold PSA, some of these interpretable models can be
written down as a simple table. Others can be displayed using a set of
visualizations. Our geographic analysis indicates that ML models should be
trained separately for separate locations and updated over time. We also
present a fairness analysis for the interpretable models. Conclusions:
Interpretable machine learning models can perform just as well as
non-interpretable methods and currently-used risk assessment scales, in terms
of both prediction accuracy and fairness. Machine learning models might be more
accurate when trained separately for distinct locations and kept up-to-date.
