Single Shot Active Learning using Pseudo Annotators
  Standard myopic active learning assumes that human annotations are always
obtainable whenever new samples are selected. This, however, is unrealistic in
many real-world applications where human experts are not readily available at
all times. In this paper, we consider the single shot setting: all the required
samples should be chosen in a single shot and no human annotation can be
exploited during the selection process. We propose a new method, Active
Learning through Random Labeling (ALRL), which substitutes single human
annotator for multiple, what we will refer to as, pseudo annotators. These
pseudo annotators always provide uniform and random labels whenever new
unlabeled samples are queried. This random labeling enables standard active
learning algorithms to also exhibit the exploratory behavior needed for single
shot active learning. The exploratory behavior is further enhanced by selecting
the most representative sample via minimizing nearest neighbor distance between
unlabeled samples and queried samples. Experiments on real-world datasets
demonstrate that the proposed method outperforms several state-of-the-art
approaches.
