Learning Tumor Growth via Follow-Up Volume Prediction for Lung Nodules
  Follow-up serves an important role in the management of pulmonary nodules for
lung cancer. Imaging diagnostic guidelines with expert consensus have been made
to help radiologists make clinical decision for each patient. However, tumor
growth is such a complicated process that it is difficult to stratify high-risk
nodules from low-risk ones based on morphologic characteristics. On the other
hand, recent deep learning studies using convolutional neural networks (CNNs)
to predict the malignancy score of nodules, only provides clinicians with
black-box predictions. To this end, we propose a unified framework, named
Nodule Follow-Up Prediction Network (NoFoNet), which predicts the growth of
pulmonary nodules with high-quality visual appearances and accurate
quantitative results, given any time interval from baseline observations. It is
achieved by predicting future displacement field of each voxel with a WarpNet.
A TextureNet is further developed to refine textural details of WarpNet
outputs. We also introduce techniques including Temporal Encoding Module and
Warp Segmentation Loss to encourage time-aware and shape-aware representation
learning. We build an in-house follow-up dataset from two medical centers to
validate the effectiveness of the proposed method. NoFoNet significantly
outperforms direct prediction by a U-Net in terms of visual quality; more
importantly, it demonstrates accurate differentiating performance between high-
and low-risk nodules. Our promising results suggest the potentials in computer
aided intervention for lung nodule management.
