Improving Expressivity of Graph Neural Networks
  We propose a Graph Neural Network with greater expressive power than commonly
used GNNs - not constrained to only differentiate between graphs that
Weisfeiler-Lehman test recognizes to be non-isomorphic. We use a graph
attention network with expanding attention window that aggregates information
from nodes exponentially far away. We also use partially random initial
embeddings, allowing differentiation between nodes that would otherwise look
the same. This could cause problem with a traditional dropout mechanism,
therefore we use a "head dropout", randomly ignoring some attention heads
rather than some dimensions of the embedding.
