Interpretable Visualizations with Differentiating Embedding Networks
  We present a visualization algorithm based on a novel unsupervised Siamese
neural network training regime and loss function, called Differentiating
Embedding Networks (DEN). The Siamese neural network finds differentiating or
similar features between specific pairs of samples in a dataset, and uses these
features to embed the dataset in a lower dimensional space where it can be
visualized. Unlike existing visualization algorithms such as UMAP or $t$-SNE,
DEN is parametric, meaning it can be interpreted by techniques such as SHAP. To
interpret DEN, we create an end-to-end parametric clustering algorithm on top
of the visualization, and then leverage SHAP scores to determine which features
in the sample space are important for understanding the structures shown in the
visualization based on the clusters found. We compare DEN visualizations with
existing techniques on a variety of datasets, including image and scRNA-seq
data. We then show that our clustering algorithm performs similarly to the
state of the art despite not having prior knowledge of the number of clusters,
and sets a new state of the art on FashionMNIST. Finally, we demonstrate
finding differentiating features of a dataset. Code available at
https://github.com/isaacrob/DEN
