Improving Long-Horizon Forecasts with Expectation-Biased LSTM Networks
  State-of-the-art forecasting methods using Recurrent Neural Net- works (RNN)
based on Long-Short Term Memory (LSTM) cells have shown exceptional performance
targeting short-horizon forecasts, e.g given a set of predictor features,
forecast a target value for the next few time steps in the future. However, in
many applica- tions, the performance of these methods decays as the forecasting
horizon extends beyond these few time steps. This paper aims to explore the
challenges of long-horizon forecasting using LSTM networks. Here, we illustrate
the long-horizon forecasting problem in datasets from neuroscience and energy
supply management. We then propose expectation-biasing, an approach motivated
by the literature of Dynamic Belief Networks, as a solution to improve
long-horizon forecasting using LSTMs. We propose two LSTM ar- chitectures along
with two methods for expectation biasing that significantly outperforms
standard practice.
