Polynomial convergence of iterations of certain random operators in
  Hilbert space
  We study the convergence of random iterative sequence of a family of
operators on infinite dimensional Hilbert spaces, which are inspired by the
Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless
regression, as studied in [1]. We demonstrate that its polynomial convergence
rate depends on the initial state, while the randomness plays a role only in
the choice of the best constant factor and we close the gap between the upper
and lower bounds.
