The unreasonable effectiveness of Batch-Norm statistics in addressing
  catastrophic forgetting across medical institutions
  Model brittleness is a primary concern when deploying deep learning models in
medical settings owing to inter-institution variations, like patient
demographics and intra-institution variation, such as multiple scanner types.
While simply training on the combined datasets is fraught with data privacy
limitations, fine-tuning the model on subsequent institutions after training it
on the original institution results in a decrease in performance on the
original dataset, a phenomenon called catastrophic forgetting. In this paper,
we investigate trade-off between model refinement and retention of previously
learned knowledge and subsequently address catastrophic forgetting for the
assessment of mammographic breast density. More specifically, we propose a
simple yet effective approach, adapting Elastic weight consolidation (EWC)
using the global batch normalization (BN) statistics of the original dataset.
The results of this study provide guidance for the deployment of clinical deep
learning models where continuous learning is needed for domain expansion.
