Dual-Attention Graph Convolutional Network
  Graph convolutional networks (GCNs) have shown the powerful ability in text
structure representation and effectively facilitate the task of text
classification. However, challenges still exist in adapting GCN on learning
discriminative features from texts due to the main issue of graph variants
incurred by the textual complexity and diversity. In this paper, we propose a
dual-attention GCN to model the structural information of various texts as well
as tackle the graph-invariant problem through embedding two types of attention
mechanisms, i.e. the connection-attention and hop-attention, into the classic
GCN. To encode various connection patterns between neighbour words,
connection-attention adaptively imposes different weights specified to
neighbourhoods of each word, which captures the short-term dependencies. On the
other hand, the hop-attention applies scaled coefficients to different scopes
during the graph diffusion process to make the model learn more about the
distribution of context, which captures long-term semantics in an adaptive way.
Extensive experiments are conducted on five widely used datasets to evaluate
our dual-attention GCN, and the achieved state-of-the-art performance verifies
the effectiveness of dual-attention mechanisms.
