Randomized Allocation with Nonparametric Estimation for Contextual
  Multi-Armed Bandits with Delayed Rewards
  We study a multi-armed bandit problem with covariates in a setting where
there is a possible delay in observing the rewards. Under some mild assumptions
on the probability distributions for the delays and using an appropriate
randomization to select the arms, the proposed strategy is shown to be strongly
consistent.
