Dynamic Graph Representation Learning via Graph Transformer Networks
  Dynamic graph representation learning is an important task with widespread
applications. Previous methods on dynamic graph learning are usually sensitive
to noisy graph information such as missing or spurious connections, which can
yield degenerated performance and generalization. To overcome this challenge,
we propose a Transformer-based dynamic graph learning method named Dynamic
Graph Transformer (DGT) with spatial-temporal encoding to effectively learn
graph topology and capture implicit links. To improve the generalization
ability, we introduce two complementary self-supervised pre-training tasks and
show that jointly optimizing the two pre-training tasks results in a smaller
Bayesian error rate via an information-theoretic analysis. We also propose a
temporal-union graph structure and a target-context node sampling strategy for
efficient and scalable training. Extensive experiments on real-world datasets
illustrate that DGT presents superior performance compared with several
state-of-the-art baselines.
