Convergence Guarantees for Deep Epsilon Greedy Policy Learning
  Policy learning is a quickly growing area. As robotics and computers control
day-to-day life, their error rate needs to be minimized and controlled. There
are many policy learning methods and bandit methods with provable error rates
that accompany them. We show an error or regret bound and convergence of the
Deep Epsilon Greedy method which chooses actions with a neural network's
prediction. We also show that Epsilon Greedy method regret upper bound is
minimized with cubic root exploration. In experiments with the real-world
dataset MNIST, we construct a nonlinear reinforcement learning problem. We
witness how with either high or low noise, some methods do and some do not
converge which agrees with our proof of convergence.
