Fighting Fire with Fire: Contrastive Debiasing without Bias-free Data
  via Generative Bias-transformation
  Despite their remarkable ability to generalize with over-capacity networks,
deep neural networks often learn to abuse spurious biases in the data instead
of using the actual task-related information. Since such shortcuts are only
effective within the collected dataset, the resulting biased model
underperforms on real-world inputs, or cause unintended social repercussions
such as gender discrimination. To counteract the influence of bias, existing
methods either exploit auxiliary information which is rarely obtainable in
practice, or sift for bias-free samples in the training data, hoping for the
sufficient existence of clean samples. However, such presumptions about the
data are not always guaranteed. In this paper, we propose Contrastive Debiasing
via Generative Bias-transformation~(CDvG) which is capable of operating in more
general environments where existing methods break down due to unmet
presumptions such as insufficient bias-free samples. Motivated by our
observation that not only discriminative models, as previously known, but also
generative models tend to focus on the bias when possible, CDvG uses a
translation model to transform the bias in the sample to another mode of bias
while preserving task-relevant information. Through contrastive learning, we
set transformed biased views against another, learning bias-invariant
representations. Experimental results on synthetic and real-world datasets
demonstrate that our framework outperforms the current state-of-the-arts, and
effectively prevents the models from being biased even when bias-free samples
are extremely scarce.
