Stabilizing Deep Reinforcement Learning with Conservative Updates
  In recent years, advances in deep learning have enabled the application of
reinforcement learning algorithms in complex domains. However, they lack the
theoretical guarantees which are present in the tabular setting and suffer from
many stability and reproducibility problems \citep{henderson2018deep}. In this
work, we suggest a simple approach for improving stability and providing
probabilistic performance improvement in off-policy actor-critic deep
reinforcement learning regimes. Experiments on continuous action spaces, in the
MuJoCo control suite, show that our proposed method reduces the variance of the
process and improves the overall performance.
