It's DONE: Direct ONE-shot learning with Hebbian weight imprinting
  Learning a new concept from one example is a superior function of human brain
and it is drawing attention in the field of machine learning as one-shot
learning task. In this paper, we propose the simplest method for this task with
a nonparametric weight imprinting, named Direct ONE-shot learning (DONE). DONE
adds new classes to a pretrained deep neural network (DNN) classifier with
neither training optimization nor pretrained-DNN modification. DONE is inspired
by Hebbian theory and directly uses the neural activity input of the final
dense layer obtained from a data that belongs to the new additional class as
the connectivity weight (synaptic strength) with a newly-provided-output neuron
for the new class, by transforming all statistical properties of the neural
activity into those of synaptic strength. DONE requires just one inference for
learning a new concept and its procedure is simple, deterministic, not
requiring parameter tuning and hyperparameters. The performance of DONE depends
entirely on the pretrained DNN model used as a backbone model, and we confirmed
that DONE with a well-trained backbone model performs a practical-level
accuracy. DONE has some advantages including a DNN's practical use that is
difficult to spend high cost for a training, an evaluation of existing DNN
models, and the understanding of the brain. DONE might be telling us one-shot
learning is an easy task that can be achieved by a simple principle not only
for humans but also for current well-trained DNN models.
