Unsupervised Visuomotor Control through Distributional Planning Networks
  While reinforcement learning (RL) has the potential to enable robots to
autonomously acquire a wide range of skills, in practice, RL usually requires
manual, per-task engineering of reward functions, especially in real world
settings where aspects of the environment needed to compute progress are not
directly accessible. To enable robots to autonomously learn skills, we instead
consider the problem of reinforcement learning without access to rewards. We
aim to learn an unsupervised embedding space under which the robot can measure
progress towards a goal for itself. Our approach explicitly optimizes for a
metric space under which action sequences that reach a particular state are
optimal when the goal is the final state reached. This enables learning
effective and control-centric representations that lead to more autonomous
reinforcement learning algorithms. Our experiments on three simulated
environments and two real-world manipulation problems show that our method can
learn effective goal metrics from unlabeled interaction, and use the learned
goal metrics for autonomous reinforcement learning.
