Sign and Relevance learning
  Standard models of biologically realistic, or inspired, reinforcement
learning employ a global error signal which implies shallow networks. However,
deep networks could offer a drastically superior performance by feeding the
error signal backwards through such a network which in turn is not biologically
realistic as it requires symmetric weights between top-down and bottom-up
pathways. Instead, we present a network combining local learning with global
modulation where neuromodulation controls the amount of plasticity change in
the whole network, while only the sign of the error is backpropagated through
the network. The neuromodulation can be understood as a rectified error, or
relevance, signal while the bottom-up sign of the error signal decides between
long-term potentiation and long-term depression. We demonstrate the performance
of this paradigm with a real robotic task.
