Efficient Approximation of Gromov-Wasserstein Distance using Importance
  Sparsification
  As a valid metric of metric-measure spaces, Gromov-Wasserstein (GW) distance
has shown the potential for the matching problems of structured data like point
clouds and graphs. However, its application in practice is limited due to its
high computational complexity. To overcome this challenge, we propose a novel
importance sparsification method, called Spar-GW, to approximate GW distance
efficiently. In particular, instead of considering a dense coupling matrix, our
method leverages a simple but effective sampling strategy to construct a sparse
coupling matrix and update it with few computations. We demonstrate that the
proposed Spar-GW method is applicable to the GW distance with arbitrary ground
cost, and it reduces the complexity from $\mathcal{O}(n^4)$ to
$\mathcal{O}(n^{2+\delta})$ for an arbitrary small $\delta>0$. In addition,
this method can be extended to approximate the variants of GW distance,
including the entropic GW distance, the fused GW distance, and the unbalanced
GW distance. Experiments show the superiority of our Spar-GW to
state-of-the-art methods in both synthetic and real-world tasks.
