Complex-to-Real Random Features for Polynomial Kernels
  Kernel methods are ubiquitous in statistical modeling due to their
theoretical guarantees as well as their competitive empirical performance.
Polynomial kernels are of particular importance as their feature maps model the
interactions between the dimensions of the input data. However, the
construction time of explicit feature maps scales exponentially with the
polynomial degree and a naive application of the kernel trick does not scale to
large datasets. In this work, we propose Complex-to-Real (CtR) random features
for polynomial kernels that leverage intermediate complex random projections
and can yield kernel estimates with much lower variances than their real-valued
analogs. The resulting features are real-valued, simple to construct and have
the following advantages over the state-of-the-art: 1) shorter construction
times, 2) lower kernel approximation errors for commonly used degrees, 3) they
enable us to obtain a closed-form expression for their variance.
