Kernel Interpolation as a Bayes Point Machine
  A Bayes point machine is a single classifier that approximates the majority
decision of an ensemble of classifiers. This paper observes that kernel
interpolation is a Bayes point machine for Gaussian process classification.
This observation facilitates the transfer of results from both ensemble theory
as well as an area of convex geometry known as Brunn-Minkowski theory to derive
PAC-Bayes risk bounds for kernel interpolation. Since large margin, infinite
width neural networks are kernel interpolators, the paper's findings may help
to explain generalisation in neural networks more broadly. Supporting this
idea, the paper finds evidence that large margin, finite width neural networks
behave like Bayes point machines too.
