Structural and Semantic Contrastive Learning for Unsupervised Node
  Representation Learning
  Graph Contrastive Learning (GCL) recently has drawn much research interest
for learning generalizable node representations in a self-supervised manner. In
general, the contrastive learning process in GCL is performed on top of the
representations learned by a graph neural network (GNN) backbone, which
transforms and propagates the node contextual information based on its local
neighborhoods. However, nodes sharing similar characteristics may not always be
geographically close, which poses a great challenge for unsupervised GCL
efforts since they have inherent limitations in capturing such global graph
knowledge. In this work, we go beyond the existing unsupervised GCL
counterparts and address their limitations by proposing a simple yet effective
framework -- Simple Neural Networks with Structural and Semantic Contrastive
Learning (S$^3$-CL). Notably, by virtue of the proposed structural and semantic
contrastive learning algorithms, even a simple neural network is able to learn
expressive node representations that preserve valuable global structural and
semantic patterns. Our experiments demonstrate that the node representations
learned by S$^3$-CL achieve superior performance on different downstream tasks
compared to the state-of-the-art GCL methods.
