Do Autonomous Agents Benefit from Hearing?
  Mapping states to actions in deep reinforcement learning is mainly based on
visual information. The commonly used approach for dealing with visual
information is to extract pixels from images and use them as state
representation for reinforcement learning agent. But, any vision only agent is
handicapped by not being able to sense audible cues. Using hearing, animals are
able to sense targets that are outside of their visual range. In this work, we
propose the use of audio as complementary information to visual only in state
representation. We assess the impact of such multi-modal setup in
reach-the-goal tasks in ViZDoom environment. Results show that the agent
improves its behavior when visual information is accompanied with audio
features.
