Euler State Networks
  Inspired by the numerical solution of ordinary differential equations, in
this paper we propose a novel Reservoir Computing (RC) model, called the Euler
State Network (EuSN). The introduced approach makes use of forward Euler
discretization and antisymmetric recurrent matrices to design reservoir
dynamics that are both stable and non-dissipative by construction.
  Our mathematical analysis shows that the resulting model is biased towards
unitary effective spectral radius and zero local Lyapunov exponents,
intrinsically operating at the edge of stability. Experiments on synthetic
tasks indicate the marked superiority of the proposed approach, compared to
standard RC models, in tasks requiring long-term memorization skills.
Furthermore, results on real-world time series classification benchmarks point
out that EuSN is capable of matching (or even surpassing) the level of accuracy
of trainable Recurrent Neural Networks, while allowing up to 100-fold savings
in computation time and energy consumption.
