Physics-informed Guided Disentanglement in Generative Networks
  Image-to-image translation (i2i) networks suffer from entanglement effects in
presence of physics-related phenomena in target domain (such as occlusions,
fog, etc), lowering altogether the translation quality, controllability and
variability. In this paper, we build upon collection of simple physics models
and present a comprehensive method for disentangling visual traits in target
images, guiding the process with a physical model that renders some of the
target traits, and learning the remaining ones. Because it allows explicit and
interpretable outputs, our physical models (optimally regressed on target)
allows generating unseen scenarios in a controllable manner. We also extend our
framework, showing versatility to neural-guided disentanglement. The results
show our disentanglement strategies dramatically increase performances
qualitatively and quantitatively in several challenging scenarios for image
translation.
