Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks
  for Brain Tumor Segmentation
  We propose combining memory saving techniques with traditional U-Net
architectures to increase the complexity of the models on the Brain Tumor
Segmentation (BraTS) challenge. The BraTS challenge consists of a 3D
segmentation of a 240x240x155x4 input image into a set of tumor classes.
Because of the large volume and need for 3D convolutional layers, this task is
very memory intensive. To address this, prior approaches use smaller cropped
images while constraining the model's depth and width. Our 3D U-Net uses a
reversible version of the mobile inverted bottleneck block defined in
MobileNetV2, MnasNet and the more recent EfficientNet architectures to save
activation memory during training. Using reversible layers enables the model to
recompute input activations given the outputs of that layer, saving memory by
eliminating the need to store activations during the forward pass. The inverted
residual bottleneck block uses lightweight depthwise separable convolutions to
reduce computation by decomposing convolutions into a pointwise convolution and
a depthwise convolution. Further, this block inverts traditional bottleneck
blocks by placing an intermediate expansion layer between the input and output
linear 1x1 convolution, reducing the total number of channels. Given a fixed
memory budget, with these memory saving techniques, we are able to train image
volumes up to 3x larger, models with 25% more depth, or models with up to 2x
the number of channels than a corresponding non-reversible network.
