Ada-LISTA: Learned Solvers Adaptive to Varying Models
  Neural networks that are based on unfolding of an iterative solver, such as
LISTA (learned iterative soft threshold algorithm), are widely used due to
their accelerated performance. Nevertheless, as opposed to non-learned solvers,
these networks are trained on a certain dictionary, and therefore they are
inapplicable for varying model scenarios. This work introduces an adaptive
learned solver, termed Ada-LISTA, which receives pairs of signals and their
corresponding dictionaries as inputs, and learns a universal architecture to
serve them all. We prove that this scheme is guaranteed to solve sparse coding
in linear rate for varying models, including dictionary perturbations and
permutations. We also provide an extensive numerical study demonstrating its
practical adaptation capabilities. Finally, we deploy Ada-LISTA to natural
image inpainting, where the patch-masks vary spatially, thus requiring such an
adaptation.
