Deep Exploration for Recommendation Systems
  We investigate the design of recommendation systems that can efficiently
learn from sparse and delayed feedback. Deep Exploration can play an important
role in such contexts, enabling a recommendation system to much more quickly
assess a user's needs and personalize service. We design an algorithm based on
Thompson Sampling that carries out Deep Exploration. We demonstrate through
simulations that the algorithm can substantially amplify the rate of positive
feedback relative to common recommendation system designs in a scalable
fashion. These results demonstrate promise that we hope will inspire
engineering of production recommendation systems that leverage Deep
Exploration.
