Learning to modulate random weights can induce task-specific contexts
  for economical meta and continual learning
  Neural networks are vulnerable to catastrophic forgetting when data
distributions are non-stationary during continual online learning; learning of
a later task often leads to forgetting of an earlier task. One solution
approach is model-agnostic continual meta-learning, whereby both task-specific
and meta parameters are trained. Here, we depart from this view and introduce a
novel neural-network architecture inspired by neuromodulation in biological
nervous systems. Neuromodulation is the biological mechanism that dynamically
controls and fine-tunes synaptic dynamics to complement the behavioral context
in real-time, which has received limited attention in machine learning. We
introduce a single-hidden-layer network that learns only a relatively small
context vector per task (task-specific parameters) that neuromodulates
unchanging, randomized weights (meta parameters) that transform the input. We
show that when task boundaries are available, this approach can eliminate
catastrophic forgetting entirely while also drastically reducing the number of
learnable parameters relative to other context-vector-based approaches.
Furthermore, by combining this model with a simple meta-learning approach for
inferring task identity, we demonstrate that the model can be generalized into
a framework to perform continual learning without knowledge of task boundaries.
Finally, we showcase the framework in a supervised continual online learning
scenario and discuss the implications of the proposed formalism.
