High-Dimensional Non-Parametric Density Estimation in Mixed Smooth
  Sobolev Spaces
  Density estimation plays a key role in many tasks in machine learning,
statistical inference, and visualization. The main bottleneck in
high-dimensional density estimation is the prohibitive computational cost and
the slow convergence rate. In this paper, we propose novel estimators for
high-dimensional non-parametric density estimation called the adaptive
hyperbolic cross density estimators, which enjoys nice convergence properties
in the mixed smooth Sobolev spaces. As modifications of the usual Sobolev
spaces, the mixed smooth Sobolev spaces are more suitable for describing
high-dimensional density functions in some applications. We prove that, unlike
other existing approaches, the proposed estimator does not suffer the curse of
dimensionality under Integral Probability Metric, including H\"older Integral
Probability Metric, where Total Variation Metric and Wasserstein Distance are
special cases. Applications of the proposed estimators to generative
adversarial networks (GANs) and goodness of fit test for high-dimensional data
are discussed to illustrate the proposed estimator's good performance in
high-dimensional problems. Numerical experiments are conducted and illustrate
the efficiency of our proposed method.
