Analyzing the Effects of Handling Data Imbalance on Learned Features
  from Medical Images by Looking Into the Models
  One challenging property lurking in medical datasets is the imbalanced data
distribution, where the frequency of the samples between the different classes
is not balanced. Training a model on an imbalanced dataset can introduce unique
challenges to the learning problem where a model is biased towards the highly
frequent class. Many methods are proposed to tackle the distributional
differences and the imbalanced problem. However, the impact of these approaches
on the learned features is not well studied. In this paper, we look deeper into
the internal units of neural networks to observe how handling data imbalance
affects the learned features. We study several popular cost-sensitive
approaches for handling data imbalance and analyze the feature maps of the
convolutional neural networks from multiple perspectives: analyzing the
alignment of salient features with pathologies and analyzing the
pathology-related concepts encoded by the networks. Our study reveals
differences and insights regarding the trained models that are not reflected by
quantitative metrics such as AUROC and AP and show up only by looking at the
models through a lens.
