Does label smoothing mitigate label noise?
  Label smoothing is commonly used in training deep learning models, wherein
one-hot training labels are mixed with uniform label vectors. Empirically,
smoothing has been shown to improve both predictive performance and model
calibration. In this paper, we study whether label smoothing is also effective
as a means of coping with label noise. While label smoothing apparently
amplifies this problem --- being equivalent to injecting symmetric noise to the
labels --- we show how it relates to a general family of loss-correction
techniques from the label noise literature. Building on this connection, we
show that label smoothing is competitive with loss-correction under label
noise. Further, we show that when distilling models from noisy data, label
smoothing of the teacher is beneficial; this is in contrast to recent findings
for noise-free problems, and sheds further light on settings where label
smoothing is beneficial.
