Incremental Learning Techniques for Semantic Segmentation
  Deep learning architectures exhibit a critical drop of performance due to
catastrophic forgetting when they are required to incrementally learn new
tasks. Contemporary incremental learning frameworks focus on image
classification and object detection while in this work we formally introduce
the incremental learning problem for semantic segmentation in which a
pixel-wise labeling is considered. To tackle this task we propose to distill
the knowledge of the previous model to retain the information about previously
learned classes, whilst updating the current model to learn the new ones. We
propose various approaches working both on the output logits and on
intermediate features. In opposition to some recent frameworks, we do not store
any image from previously learned classes and only the last model is needed to
preserve high accuracy on these classes. The experimental evaluation on the
Pascal VOC2012 dataset shows the effectiveness of the proposed approaches.
