Gen-Oja: A Two-time-scale approach for Streaming CCA
  In this paper, we study the problems of principal Generalized Eigenvector
computation and Canonical Correlation Analysis in the stochastic setting. We
propose a simple and efficient algorithm, Gen-Oja, for these problems. We prove
the global convergence of our algorithm, borrowing ideas from the theory of
fast-mixing Markov chains and two-time-scale stochastic approximation, showing
that it achieves the optimal rate of convergence. In the process, we develop
tools for understanding stochastic processes with Markovian noise which might
be of independent interest.
