Empirical Risk Minimization in Non-interactive Local Differential
  Privacy: Efficiency and High Dimensional Case
  In this paper, we study the Empirical Risk Minimization problem in the
non-interactive local model of differential privacy. In the case of constant or
low dimensionality ($p\ll n$), we first show that if the ERM loss function is
$(\infty, T)$-smooth, then we can avoid a dependence of the sample complexity,
to achieve error $\alpha$, on the exponential of the dimensionality $p$ with
base $1/\alpha$ (i.e., $\alpha^{-p}$), which answers a question in [smith 2017
interaction]. Our approach is based on polynomial approximation. Then, we
propose player-efficient algorithms with $1$-bit communication complexity and
$O(1)$ computation cost for each player. The error bound is asymptotically the
same as the original one. Also with additional assumptions we show a server
efficient algorithm. Next we consider the high dimensional case ($n\ll p$), we
show that if the loss function is Generalized Linear function and convex, then
we could get an error bound which is dependent on the Gaussian width of the
underlying constrained set instead of $p$, which is lower than that in [smith
2017 interaction].
