Domain Generalization: A Survey
  Generalization to out-of-distribution (OOD) data is a capability natural to
humans yet challenging for machines to reproduce. This is because most learning
algorithms strongly rely on the i.i.d.~assumption on source/target data, which
is often violated in practice due to domain shift. Domain generalization (DG)
aims to achieve OOD generalization by using only source data for model
learning. Over the last ten years, research in DG has made great progress,
leading to a broad spectrum of methodologies, e.g., those based on domain
alignment, meta-learning, data augmentation, or ensemble learning, to name a
few; DG has also been studied in various application areas including computer
vision, speech recognition, natural language processing, medical imaging, and
reinforcement learning. In this paper, for the first time a comprehensive
literature review in DG is provided to summarize the developments over the past
decade. Specifically, we first cover the background by formally defining DG and
relating it to other relevant fields like domain adaptation and transfer
learning. Then, we conduct a thorough review into existing methods and
theories. Finally, we conclude this survey with insights and discussions on
future research directions.
