Creativity of AI: Automatic Symbolic Option Discovery for Facilitating
  Deep Reinforcement Learning
  Despite of achieving great success in real life, Deep Reinforcement Learning
(DRL) is still suffering from three critical issues, which are data efficiency,
lack of the interpretability and transferability. Recent research shows that
embedding symbolic knowledge into DRL is promising in addressing those
challenges. Inspired by this, we introduce a novel deep reinforcement learning
framework with symbolic options. This framework features a loop training
procedure, which enables guiding the improvement of policy by planning with
action models and symbolic options learned from interactive trajectories
automatically. The learned symbolic options alleviate the dense requirement of
expert domain knowledge and provide inherent interpretability of policies.
Moreover, the transferability and data efficiency can be further improved by
planning with the action models. To validate the effectiveness of this
framework, we conduct experiments on two domains, Montezuma's Revenge and
Office World, respectively. The results demonstrate the comparable performance,
improved data efficiency, interpretability and transferability.
