Task-Driven Data Verification via Gradient Descent
  We introduce a novel algorithm for the detection of possible sample
corruption such as mislabeled samples in a training dataset given a small clean
validation set. We use a set of inclusion variables which determine whether or
not any element of the noisy training set should be included in the training of
a network. We compute these inclusion variables by optimizing the performance
of the network on the clean validation set via "gradient descent on gradient
descent" based learning. The inclusion variables as well as the network trained
in such a way form the basis of our methods, which we call Corruption Detection
via Gradient Descent (CDGD). This algorithm can be applied to any supervised
machine learning task and is not limited to classification problems. We provide
a quantitative comparison of these methods on synthetic and real world
datasets.
