CrossTrainer: Practical Domain Adaptation with Loss Reweighting
  Domain adaptation provides a powerful set of model training techniques given
domain-specific training data and supplemental data with unknown relevance. The
techniques are useful when users need to develop models with data from varying
sources, of varying quality, or from different time ranges. We build
CrossTrainer, a system for practical domain adaptation. CrossTrainer utilizes
loss reweighting, which provides consistently high model accuracy across a
variety of datasets in our empirical analysis. However, loss reweighting is
sensitive to the choice of a weight hyperparameter that is expensive to tune.
We develop optimizations leveraging unique properties of loss reweighting that
allow CrossTrainer to output accurate models while improving training time
compared to naive hyperparameter search.
