Assisting the Adversary to Improve GAN Training
  Some of the most popular methods for improving the stability and performance
of GANs involve constraining or regularizing the discriminator. In this paper
we consider a largely overlooked regularization technique which we refer to as
the Adversary's Assistant (AdvAs). We motivate this using a different
perspective to that of prior work. Specifically, we consider a common mismatch
between theoretical analysis and practice: analysis often assumes that the
discriminator reaches its optimum on each iteration. In practice, this is
essentially never true, often leading to poor gradient estimates for the
generator. To address this, AdvAs is a theoretically motivated penalty imposed
on the generator based on the norm of the gradients used to train the
discriminator. This encourages the generator to move towards points where the
discriminator is optimal. We demonstrate the effect of applying AdvAs to
several GAN objectives, datasets and network architectures. The results
indicate a reduction in the mismatch between theory and practice and that AdvAs
can lead to improvement of GAN training, as measured by FID scores.
