Attention Cube Network for Image Restoration
  Recently, deep convolutional neural network (CNN) have been widely used in
image restoration and obtained great success. However, most of existing methods
are limited to local receptive field and equal treatment of different types of
information. Besides, existing methods always use a multi-supervised method to
aggregate different feature maps, which can not effectively aggregate
hierarchical feature information. To address these issues, we propose an
attention cube network (A-CubeNet) for image restoration for more powerful
feature expression and feature correlation learning. Specifically, we design a
novel attention mechanism from three dimensions, namely spatial dimension,
channel-wise dimension and hierarchical dimension. The adaptive spatial
attention branch (ASAB) and the adaptive channel attention branch (ACAB)
constitute the adaptive dual attention module (ADAM), which can capture the
long-range spatial and channel-wise contextual information to expand the
receptive field and distinguish different types of information for more
effective feature representations. Furthermore, the adaptive hierarchical
attention module (AHAM) can capture the long-range hierarchical contextual
information to flexibly aggregate different feature maps by weights depending
on the global context. The ADAM and AHAM cooperate to form an "attention in
attention" structure, which means AHAM's inputs are enhanced by ASAB and ACAB.
Experiments demonstrate the superiority of our method over state-of-the-art
image restoration methods in both quantitative comparison and visual analysis.
Code is available at https://github.com/YCHang686/A-CubeNet.
