Deformable ProtoPNet: An Interpretable Image Classifier Using Deformable
  Prototypes
  Machine learning has been widely adopted in many domains, including
high-stakes applications such as healthcare, finance, and criminal justice. To
address concerns of fairness, accountability and transparency, predictions made
by machine learning models in these critical domains must be interpretable. One
line of work approaches this challenge by integrating the power of deep neural
networks and the interpretability of case-based reasoning to produce accurate
yet interpretable image classification models. These models generally classify
input images by comparing them with prototypes learned during training,
yielding explanations in the form of "this looks like that." However, methods
from this line of work use spatially rigid prototypes, which cannot explicitly
account for pose variations. In this paper, we address this shortcoming by
proposing a case-based interpretable neural network that provides spatially
flexible prototypes, called a deformable prototypical part network (Deformable
ProtoPNet). In a Deformable ProtoPNet, each prototype is made up of several
prototypical parts that adaptively change their relative spatial positions
depending on the input image. This enables each prototype to detect object
features with a higher tolerance to spatial transformations, as the parts
within a prototype are allowed to move. Consequently, a Deformable ProtoPNet
can explicitly capture pose variations, improving both model accuracy and the
richness of explanations provided. Compared to other case-based interpretable
models using prototypes, our approach achieves competitive accuracy, gives an
explanation with greater context, and is easier to train, thus enabling wider
use of interpretable models for computer vision.
