A Collective Learning Framework to Boost GNN Expressiveness
  Graph Neural Networks (GNNs) have recently been used for node and graph
classification tasks with great success, but GNNs model dependencies among the
attributes of nearby neighboring nodes rather than dependencies among observed
node labels. In this work, we consider the task of inductive node
classification using GNNs in supervised and semi-supervised settings, with the
goal of incorporating label dependencies. Because current GNNs are not
universal (i.e., most-expressive) graph representations, we propose a general
collective learning approach to increase the representation power of any
existing GNN. Our framework combines ideas from collective classification with
self-supervised learning, and uses a Monte Carlo approach to sampling
embeddings for inductive learning across graphs. We evaluate performance on
five real-world network datasets and demonstrate consistent, significant
improvement in node classification accuracy, for a variety of state-of-the-art
GNNs.
