Mutual Information-based Disentangled Neural Networks for Classifying
  Unseen Categories in Different Domains: Application to Fetal Ultrasound
  Imaging
  Deep neural networks exhibit limited generalizability across images with
different entangled domain features and categorical features. Learning
generalizable features that can form universal categorical decision boundaries
across domains is an interesting and difficult challenge. This problem occurs
frequently in medical imaging applications when attempts are made to deploy and
improve deep learning models across different image acquisition devices, across
acquisition parameters or if some classes are unavailable in new training
databases. To address this problem, we propose Mutual Information-based
Disentangled Neural Networks (MIDNet), which extract generalizable categorical
features to transfer knowledge to unseen categories in a target domain. The
proposed MIDNet adopts a semi-supervised learning paradigm to alleviate the
dependency on labeled data. This is important for real-world applications where
data annotation is time-consuming, costly and requires training and expertise.
We extensively evaluate the proposed method on fetal ultrasound datasets for
two different image classification tasks where domain features are respectively
defined by shadow artifacts and image acquisition devices. Experimental results
show that the proposed method outperforms the state-of-the-art on the
classification of unseen categories in a target domain with sparsely labeled
training data.
