Open Set Domain Adaptation: Theoretical Bound and Algorithm
  The aim of unsupervised domain adaptation is to leverage the knowledge in a
labeled (source) domain to improve a model's learning performance with an
unlabeled (target) domain -- the basic strategy being to mitigate the effects
of discrepancies between the two distributions. Most existing algorithms can
only handle unsupervised closed set domain adaptation (UCSDA), i.e., where the
source and target domains are assumed to share the same label set. In this
paper, we target a more challenging but realistic setting: unsupervised open
set domain adaptation (UOSDA), where the target domain has unknown classes that
are not found in the source domain. This is the first study to provide a
learning bound for open set domain adaptation, which we do by theoretically
investigating the risk of the target classifier on unknown classes. The
proposed learning bound has a special term, namely open set difference, which
reflects the risk of the target classifier on unknown classes. Further, we
present a novel and theoretically guided unsupervised algorithm for open set
domain adaptation, called distribution alignment with ppen difference (DAOD),
which is based on regularizing this open set difference bound. The experiments
on several benchmark datasets show the superior performance of the proposed
UOSDA method compared with the state-of-the-art methods in the literature.
