Convergence Rates for Learning Linear Operators from Noisy Data
  We study the Bayesian inverse problem of learning a linear operator on a
Hilbert space from its noisy pointwise evaluations on random input data. Our
framework assumes that this target operator is self-adjoint and diagonal in a
basis shared with the Gaussian prior and noise covariance operators arising
from the imposed statistical model and is able to handle target operators that
are compact, bounded, or even unbounded. We establish posterior contraction
rates with respect to a family of Bochner norms as the number of data tend to
infinity and derive related lower bounds on the estimation error. In the large
data limit, we also provide asymptotic convergence rates of suitably defined
excess risk and generalization gap functionals associated with the posterior
mean point estimator. In doing so, we connect the posterior consistency results
to nonparametric learning theory. Furthermore, these convergence rates
highlight and quantify the difficulty of learning unbounded linear operators in
comparison with the learning of bounded or compact ones. Numerical experiments
confirm the theory and demonstrate that similar conclusions may be expected in
more general problem settings.
