Differential Privacy of Dirichlet Posterior Sampling
  Besides the Laplace distribution and the Gaussian distribution, there are
many more probability distributions that are not well-understood in terms of
privacy-preserving property -- one of which is the Dirichlet distribution. In
this work, we study the inherent privacy of releasing a single draw from a
Dirichlet posterior distribution (the Dirichlet posterior sampling). As our
main result, we provide a simple privacy guarantee of the Dirichlet posterior
sampling with the framework of R\'enyi Differential Privacy (RDP).
Consequently, the RDP guarantee allows us to derive a simpler form of the
$(\varepsilon,\delta)$-differential privacy guarantee compared to those from
the previous work. As an application, we use the RDP guarantee to derive a
utility guarantee of the Dirichlet posterior sampling for privately releasing a
normalized histogram, which is confirmed by our experimental results. Moreover,
we demonstrate that the RDP guarantee can be used to track the privacy loss in
Bayesian reinforcement learning.
