Splitting Gaussian Process Regression for Streaming Data
  Gaussian processes offer a flexible kernel method for regression. While
Gaussian processes have many useful theoretical properties and have proven
practically useful, they suffer from poor scaling in the number of
observations. In particular, the cubic time complexity of updating standard
Gaussian process models make them generally unsuitable for application to
streaming data. We propose an algorithm for sequentially partitioning the input
space and fitting a localized Gaussian process to each disjoint region. The
algorithm is shown to have superior time and space complexity to existing
methods, and its sequential nature permits application to streaming data. The
algorithm constructs a model for which the time complexity of updating is
tightly bounded above by a pre-specified parameter. To the best of our
knowledge, the model is the first local Gaussian process regression model to
achieve linear memory complexity. Theoretical continuity properties of the
model are proven. We demonstrate the efficacy of the resulting model on
multi-dimensional regression tasks for streaming data.
