Uncalibrated Models Can Improve Human-AI Collaboration
  In many practical applications of AI, an AI model is used as a decision aid
for human users. The AI provides advice that a human (sometimes) incorporates
into their decision-making process. The AI advice is often presented with some
measure of "confidence" that the human can use to calibrate how much they
depend on or trust the advice. In this paper, we demonstrate that human-AI
performance can be improved by calibrating this confidence to the humans using
the advice. In practice, this means presenting calibrated AI models as more or
less confident than they actually are. We show empirically that this can
improve human-AI performance (measured as the accuracy and confidence of the
human's final prediction after seeing the AI advice). We first train a model to
predict human incorporation of AI advice using data from thousands of human
interactions. This enables us to explicitly estimate how to transform the AI's
prediction confidence, making the AI uncalibrated, in order to improve the
final human prediction. We empirically validate our results across four
different tasks--dealing with images, text and tabular data--involving hundreds
of human participants. We further support our findings with simulation
analysis. Our findings suggest the importance of and a framework for jointly
optimizing the human-AI system in contrast to the standard paradigm of
optimizing the AI model alone.
