Asymmetric Generative Adversarial Networks for Image-to-Image
  Translation
  State-of-the-art models for unpaired image-to-image translation with
Generative Adversarial Networks (GANs) can learn the mapping from the source
domain to the target domain using a cycle-consistency loss. The intuition
behind these models is that if we translate from one domain to the other and
back again we should arrive at where we started. However, existing methods
always adopt a symmetric network architecture to learn both forward and
backward cycles. Because of the task complexity and cycle input difference
between the source and target image domains, the inequality in bidirectional
forward-backward cycle translations is significant and the amount of
information between two domains is different. In this paper, we analyze the
limitation of the existing symmetric GAN models in asymmetric translation
tasks, and propose an AsymmetricGAN model with both translation and
reconstruction generators of unequal sizes and different parameter-sharing
strategy to adapt to the asymmetric need in both unsupervised and supervised
image-to-image translation tasks. Moreover, the training stage of existing
methods has the common problem of model collapse that degrades the quality of
the generated images, thus we explore different optimization losses for better
training of AsymmetricGAN, and thus make image-to-image translation with higher
consistency and better stability. Extensive experiments on both supervised and
unsupervised generative tasks with several publicly available datasets
demonstrate that the proposed AsymmetricGAN achieves superior model capacity
and better generation performance compared with existing GAN models. To the
best of our knowledge, we are the first to investigate the asymmetric GAN
framework on both unsupervised and supervised image-to-image translation tasks.
The source code, data and trained models are available at
https://github.com/Ha0Tang/AsymmetricGAN.
