Learning Domain-Invariant Relationship with Instrumental Variable for
  Domain Generalization
  Domain generalization (DG) aims to learn from multiple source domains a model
that generalizes well on unseen target domains. Existing methods mainly learn
input feature representations with invariant marginal distribution, while the
invariance of the conditional distribution is more essential for unknown domain
generalization. This paper proposes an instrumental variable-based approach to
learn the domain-invariant relationship between input features and labels
contained in the conditional distribution. Interestingly, with a causal view on
the data generating process, we find that the input features of one domain are
valid instrumental variables for other domains. Inspired by this finding, we
design a simple yet effective framework to learn the Domain-invariant
Relationship with Instrumental VariablE (DRIVE) via a two-stage IV method.
Specifically, it first learns the conditional distribution of input features of
one domain given input features of another domain, and then it estimates the
domain-invariant relationship by predicting labels with the learned conditional
distribution. Simulation experiments show the proposed method accurately
captures the domain-invariant relationship. Extensive experiments on several
datasets consistently demonstrate that DRIVE yields state-of-the-art results.
