Effect of Input Noise Dimension in GANs
  Generative Adversarial Networks (GANs) are by far the most successful
generative models. Learning the transformation which maps a low dimensional
input noise to the data distribution forms the foundation for GANs. Although
they have been applied in various domains, they are prone to certain challenges
like mode collapse and unstable training. To overcome the challenges,
researchers have proposed novel loss functions, architectures, and optimization
methods. In our work here, unlike the previous approaches, we focus on the
input noise and its role in the generation.
  We aim to quantitatively and qualitatively study the effect of the dimension
of the input noise on the performance of GANs. For quantitative measures,
typically \emph{Fr\'{e}chet Inception Distance (FID)} and \emph{Inception Score
(IS)} are used as performance measure on image data-sets. We compare the FID
and IS values for DCGAN and WGAN-GP. We use three different image data-sets --
each consisting of different levels of complexity. Through our experiments, we
show that the right dimension of input noise for optimal results depends on the
data-set and architecture used. We also observe that the state of the art
performance measures does not provide enough useful insights. Hence we conclude
that we need further theoretical analysis for understanding the relationship
between the low dimensional distribution and the generated images. We also
require better performance measures.
