The Impact of Batch Learning in Stochastic Linear Bandits
  We consider a special case of bandit problems, named batched bandits, in
which an agent observes batches of responses over a certain time period. Unlike
previous work, we consider a practically relevant batch-centric scenario of
batch learning. That is to say, we provide a policy-agnostic regret analysis
and demonstrate upper and lower bounds for the regret of a candidate policy.
Our main theoretical results show that the impact of batch learning can be
measured proportional to the regret of online behavior. Primarily, we study two
settings of the problem: instance-independent and instance-dependent. While the
upper bound is the same for both settings, the worst-case lower bound is more
comprehensive in the former case and more accurate in the latter one. Also, we
provide a more robust result for the 2-armed bandit problem as an important
insight. Finally, we demonstrate the consistency of theoretical results by
conducting empirical experiments and reflect on the optimal batch size choice.
