Efficiently Learning Structured Distributions from Untrusted Batches
  We study the problem, introduced by Qiao and Valiant, of learning from
untrusted batches. Here, we assume $m$ users, all of whom have samples from
some underlying distribution $p$ over $1, \ldots, n$. Each user sends a batch
of $k$ i.i.d. samples from this distribution; however an $\epsilon$-fraction of
users are untrustworthy and can send adversarially chosen responses. The goal
is then to learn $p$ in total variation distance. When $k = 1$ this is the
standard robust univariate density estimation setting and it is well-understood
that $\Omega (\epsilon)$ error is unavoidable. Suprisingly, Qiao and Valiant
gave an estimator which improves upon this rate when $k$ is large.
Unfortunately, their algorithms run in time exponential in either $n$ or $k$.
  We first give a sequence of polynomial time algorithms whose estimation error
approaches the information-theoretically optimal bound for this problem. Our
approach is based on recent algorithms derived from the sum-of-squares
hierarchy, in the context of high-dimensional robust estimation. We show that
algorithms for learning from untrusted batches can also be cast in this
framework, but by working with a more complicated set of test functions.
  It turns out this abstraction is quite powerful and can be generalized to
incorporate additional problem specific constraints. Our second and main result
is to show that this technology can be leveraged to build in prior knowledge
about the shape of the distribution. Crucially, this allows us to reduce the
sample complexity of learning from untrusted batches to polylogarithmic in $n$
for most natural classes of distributions, which is important in many
applications. To do so, we demonstrate that these sum-of-squares algorithms for
robust mean estimation can be made to handle complex combinatorial constraints
(e.g. those arising from VC theory), which may be of independent technical
interest.
