Overcoming Exploration: Deep Reinforcement Learning in Complex
  Environments from Temporal Logic Specifications
  We present a Deep Reinforcement Learning (DRL) algorithm for a task-guided
robot with unknown continuous-time dynamics deployed in a large-scale complex
environment. Linear Temporal Logic (LTL) is applied to express a rich robotic
specification. To overcome the environmental challenge, we propose a novel path
planning-guided reward scheme that is dense over the state space, and
crucially, robust to infeasibility of computed geometric paths due to the
unknown robot dynamics. To facilitate LTL satisfaction, our approach decomposes
the LTL mission into sub-tasks that are solved using distributed DRL, where the
sub-tasks are trained in parallel, using Deep Policy Gradient algorithms. Our
framework is shown to significantly improve performance (effectiveness,
efficiency) and exploration of robots tasked with complex missions in
large-scale complex environments.
