Episodic Memory Deep Q-Networks
  Reinforcement learning (RL) algorithms have made huge progress in recent
years by leveraging the power of deep neural networks (DNN). Despite the
success, deep RL algorithms are known to be sample inefficient, often requiring
many rounds of interaction with the environments to obtain satisfactory
performance. Recently, episodic memory based RL has attracted attention due to
its ability to latch on good actions quickly. In this paper, we present a
simple yet effective biologically inspired RL algorithm called Episodic Memory
Deep Q-Networks (EMDQN), which leverages episodic memory to supervise an agent
during training. Experiments show that our proposed method can lead to better
sample efficiency and is more likely to find good policies. It only requires
1/5 of the interactions of DQN to achieve many state-of-the-art performances on
Atari games, significantly outperforming regular DQN and other episodic memory
based RL algorithms.
