Mitigating Bias in Adaptive Data Gathering via Differential Privacy
  Data that is gathered adaptively --- via bandit algorithms, for example ---
exhibits bias. This is true both when gathering simple numeric valued data ---
the empirical means kept track of by stochastic bandit algorithms are biased
downwards --- and when gathering more complicated data --- running hypothesis
tests on complex data gathered via contextual bandit algorithms leads to false
discovery. In this paper, we show that this problem is mitigated if the data
collection procedure is differentially private. This lets us both bound the
bias of simple numeric valued quantities (like the empirical means of
stochastic bandit algorithms), and correct the p-values of hypothesis tests run
on the adaptively gathered data. Moreover, there exist differentially private
bandit algorithms with near optimal regret bounds: we apply existing theorems
in the simple stochastic case, and give a new analysis for linear contextual
bandits. We complement our theoretical results with experiments validating our
theory.
