Fast Approximation and Estimation Bounds of Kernel Quadrature for
  Infinitely Wide Models
  An infinitely wide model is a weighted integration $\int \varphi(x,v) d
\mu(v)$ of feature maps. This model excels at handling an infinite number of
features, and thus it has been adopted to the theoretical study of deep
learning. Kernel quadrature is a kernel-based numerical integration scheme
developed for fast approximation of expectations $\int f(x) d p(x)$. In this
study, regarding the weight $\mu$ as a signed (or complex/vector-valued)
distribution of parameters, we develop the general kernel quadrature (GKQ) for
parameter distributions. The proposed method can achieve a fast approximation
rate $O(e^{-p})$ with parameter number $p$, which is faster than the
traditional Barron's rate, and a fast estimation rate $\widetilde{O}(1/n)$ with
sample size $n$. As a result, we have obtained a new norm-based complexity
measure for infinitely wide models. Since the GKQ implicitly conducts the
empirical risk minimization, we can understand that the complexity measure also
reflects the generalization performance in the gradient learning setup.
