Deep Partial Updating
  Emerging edge intelligence applications require the server to continuously
retrain and update deep neural networks deployed on remote edge nodes in order
to leverage newly collected data samples. Unfortunately, it may be impossible
in practice to continuously send fully updated weights to these edge nodes due
to the highly constrained communication resource. In this paper, we propose the
weight-wise deep partial updating paradigm, which smartly selects only a subset
of weights to update at each server-to-edge communication round, while
achieving a similar performance compared to full updating. Our method is
established through analytically upper-bounding the loss difference between
partial updating and full updating, and only updates the weights which make the
largest contributions to the upper bound. Extensive experimental results
demonstrate the efficacy of our partial updating methodology which achieves a
high inference accuracy while updating a rather small number of weights.
