A review: Deep learning for medical image segmentation using
  multi-modality fusion
  Multi-modality is widely used in medical imaging, because it can provide
multiinformation about a target (tumor, organ or tissue). Segmentation using
multimodality consists of fusing multi-information to improve the segmentation.
Recently, deep learning-based approaches have presented the state-of-the-art
performance in image classification, segmentation, object detection and
tracking tasks. Due to their self-learning and generalization ability over
large amounts of data, deep learning recently has also gained great interest in
multi-modal medical image segmentation. In this paper, we give an overview of
deep learning-based approaches for multi-modal medical image segmentation task.
Firstly, we introduce the general principle of deep learning and multi-modal
medical image segmentation. Secondly, we present different deep learning
network architectures, then analyze their fusion strategies and compare their
results. The earlier fusion is commonly used, since it's simple and it focuses
on the subsequent segmentation network architecture. However, the later fusion
gives more attention on fusion strategy to learn the complex relationship
between different modalities. In general, compared to the earlier fusion, the
later fusion can give more accurate result if the fusion method is effective
enough. We also discuss some common problems in medical image segmentation.
Finally, we summarize and provide some perspectives on the future research.
