Accurate online training of dynamical spiking neural networks through
  Forward Propagation Through Time
  The event-driven and sparse nature of communication between spiking neurons
in the brain holds great promise for flexible and energy-efficient AI. Recent
advances in learning algorithms have demonstrated that recurrent networks of
spiking neurons can be effectively trained to achieve competitive performance
compared to standard recurrent neural networks. Still, as these learning
algorithms use error-backpropagation through time (BPTT), they suffer from high
memory requirements, are slow to train, and are incompatible with online
learning. This limits the application of these learning algorithms to
relatively small networks and to limited temporal sequence lengths. Online
approximations to BPTT with lower computational and memory complexity have been
proposed (e-prop, OSTL), but in practice also suffer from memory limitations
and, as approximations, do not outperform standard BPTT training. Here, we show
how a recently developed alternative to BPTT, Forward Propagation Through Time
(FPTT) can be applied in spiking neural networks. Different from BPTT, FPTT
attempts to minimize an ongoing dynamically regularized risk on the loss. As a
result, FPTT can be computed in an online fashion and has fixed complexity with
respect to the sequence length. When combined with a novel dynamic spiking
neuron model, the Liquid-Time-Constant neuron, we show that SNNs trained with
FPTT outperform online BPTT approximations, and approach or exceed offline BPTT
accuracy on temporal classification tasks. This approach thus makes it feasible
to train SNNs in a memory-friendly online fashion on long sequences and scale
up SNNs to novel and complex neural architectures.
