On the convergence of projective-simulation-based reinforcement learning
  in Markov decision processes
  In recent years, the interest in leveraging quantum effects for enhancing
machine learning tasks has significantly increased. Many algorithms speeding up
supervised and unsupervised learning were established. The first framework in
which ways to exploit quantum resources specifically for the broader context of
reinforcement learning were found is projective simulation. Projective
simulation presents an agent-based reinforcement learning approach designed in
a manner which may support quantum walk-based speed-ups. Although classical
variants of projective simulation have been benchmarked against common
reinforcement learning algorithms, very few formal theoretical analyses have
been provided for its performance in standard learning scenarios. In this
paper, we provide a detailed formal discussion of the properties of this model.
Specifically, we prove that one version of the projective simulation model,
understood as a reinforcement learning approach, converges to optimal behavior
in a large class of Markov decision processes. This proof shows that a
physically-inspired approach to reinforcement learning can guarantee to
converge.
