Self-Training: A Survey
  In recent years, semi-supervised algorithms have received a lot of interest
in both academia and industry. Among the existing techniques, self-training
methods have arguably received more attention in the last few years. These
models are designed to search the decision boundary on low density regions
without making extra assumptions on the data distribution, and use the unsigned
output score of a learned classifier, or its margin, as an indicator of
confidence. The working principle of self-training algorithms is to learn a
classifier iteratively by assigning pseudo-labels to the set of unlabeled
training samples with a margin greater than a certain threshold. The
pseudo-labeled examples are then used to enrich the labeled training data and
train a new classifier in conjunction with the labeled training set. We present
self-training methods for binary and multiclass classification and their
variants which were recently developed using Neural Networks. Finally, we
discuss our ideas for future research in self-training. To the best of our
knowledge, this is the first thorough and complete survey on this subject.
