Incompleteness of graph convolutional neural networks for points clouds
  in three dimensions
  Graph neural networks (GNN) are very popular methods in machine learning and
have been applied very successfully to the prediction of the properties of
molecules and materials. First-order GNNs are well known to be incomplete,
i.e., there exist graphs that are distinct but appear identical when seen
through the lens of the GNN. More complicated schemes have thus been designed
to increase their resolving power. Applications to molecules (and more
generally, point clouds), however, add a geometric dimension to the problem.
The most straightforward and prevalent approach to construct graph
representation for molecules regards atoms as vertices in a graph and draws a
bond between each pair of atoms within a chosen cutoff. Bonds can be decorated
with the distance between atoms, and the resulting "distance graph NNs" (dGNN)
have empirically demonstrated excellent resolving power and are widely used in
chemical ML, with all known indistinguishable graphs being resolved in the
fully-connected limit. Here we show that even for the restricted case of
fully-connected graphs induced by 3D atom clouds dGNNs are not complete. We
construct pairs of distinct point clouds that generate graphs that, for any
cutoff radius, are equivalent based on a first-order Weisfeiler-Lehman test.
This class of degenerate structures includes chemically-plausible
configurations, setting an ultimate limit to the expressive power of some of
the well-established GNN architectures for atomistic machine learning. Models
that explicitly use angular or directional information in the description of
atomic environments can resolve these degeneracies.
