Implicit Regularization in Deep Tensor Factorization
  Attempts of studying implicit regularization associated to gradient descent
(GD) have identified matrix completion as a suitable test-bed. Late findings
suggest that this phenomenon cannot be phrased as a minimization-norm problem,
implying that a paradigm shift is required and that dynamics has to be taken
into account. In the present work we address the more general setup of tensor
completion by leveraging two popularized tensor factorization, namely Tucker
and TensorTrain (TT). We track relevant quantities such as tensor nuclear norm,
effective rank, generalized singular values and we introduce deep Tucker and TT
unconstrained factorization to deal with the completion task. Experiments on
both synthetic and real data show that gradient descent promotes solution with
low-rank, and validate the conjecture saying that the phenomenon has to be
addressed from a dynamical perspective.
