Safe Reinforcement Learning with Nonlinear Dynamics via Model Predictive
  Shielding
  Reinforcement learning is a promising approach to synthesizing policies for
challenging robotics tasks. A key problem is how to ensure safety of the
learned policy---e.g., that a walking robot does not fall over or that an
autonomous car does not run into an obstacle. We focus on the setting where the
dynamics are known, and the goal is to ensure that a policy trained in
simulation satisfies a given safety constraint. We propose an approach, called
model predictive shielding (MPS), that switches on-the-fly between a learned
policy and a backup policy to ensure safety. We prove that our approach
guarantees safety, and empirically evaluate it on the cart-pole.
