How Much Off-The-Shelf Knowledge Is Transferable From Natural Images To
  Pathology Images?
  Deep learning has achieved a great success in natural image classification.
To overcome data-scarcity in computational pathology, recent studies exploit
transfer learning to reuse knowledge gained from natural images in pathology
image analysis, aiming to build effective pathology image diagnosis models.
Since transferability of knowledge heavily depends on the similarity of the
original and target tasks, significant differences in image content and
statistics between pathology images and natural images raise the questions: how
much knowledge is transferable? Is the transferred information equally
contributed by pre-trained layers? To answer these questions, this paper
proposes a framework to quantify knowledge gain by a particular layer, conducts
an empirical investigation in pathology image centered transfer learning, and
reports some interesting observations. Particularly, compared to the
performance baseline obtained by random-weight model, though transferability of
off-the-shelf representations from deep layers heavily depend on specific
pathology image sets, the general representation generated by early layers does
convey transferred knowledge in various image classification applications. The
observation in this study encourages further investigation of specific metric
and tools to quantify effectiveness and feasibility of transfer learning in
future.
