Low Budget Active Learning via Wasserstein Distance: An Integer
  Programming Approach
  Active learning is the process of training a model with limited labeled data
by selecting a core subset of an unlabeled data pool to label. The large scale
of data sets used in deep learning forces most sample selection strategies to
employ efficient heuristics. This paper introduces an integer optimization
problem for selecting a core set that minimizes the discrete Wasserstein
distance from the unlabeled pool. We demonstrate that this problem can be
tractably solved with a Generalized Benders Decomposition algorithm. Our
strategy uses high-quality latent features that can be obtained by unsupervised
learning on the unlabeled pool. Numerical results on several data sets show
that our optimization approach is competitive with baselines and particularly
outperforms them in the low budget regime where less than one percent of the
data set is labeled.
