Recurrent Neural Networks for Dynamical Systems: Applications to
  Ordinary Differential Equations, Collective Motion, and Hydrological Modeling
  Classical methods of solving spatiotemporal dynamical systems include
statistical approaches such as autoregressive integrated moving average, which
assume linear and stationary relationships between systems' previous outputs.
Development and implementation of linear methods are relatively simple, but
they often do not capture non-linear relationships in the data. Thus,
artificial neural networks (ANNs) are receiving attention from researchers in
analyzing and forecasting dynamical systems. Recurrent neural networks (RNN),
derived from feed-forward ANNs, use internal memory to process variable-length
sequences of inputs. This allows RNNs to applicable for finding solutions for a
vast variety of problems in spatiotemporal dynamical systems. Thus, in this
paper, we utilize RNNs to treat some specific issues associated with dynamical
systems. Specifically, we analyze the performance of RNNs applied to three
tasks: reconstruction of correct Lorenz solutions for a system with a
formulation error, reconstruction of corrupted collective motion trajectories,
and forecasting of streamflow time series possessing spikes, representing three
fields, namely, ordinary differential equations, collective motion, and
hydrological modeling, respectively. We train and test RNNs uniquely in each
task to demonstrate the broad applicability of RNNs in reconstruction and
forecasting the dynamics of dynamical systems.
