Pseudo-Poincaré: A Unification Framework for Euclidean and Hyperbolic Graph Neural Networks
Hyperbolic neural networks have recently gained significant attention due to
their promising results on several graph problems including node classification
and link prediction. The primary reason for this success is the effectiveness
of the hyperbolic space in capturing the inherent hierarchy of graph datasets.
However, they are limited in terms of generalization, scalability, and have
inferior performance when it comes to non-hierarchical datasets. In this paper,
we take a completely orthogonal perspective for modeling hyperbolic networks.
We use Poincar\'e disk to model the hyperbolic geometry and also treat it as if
the disk itself is a tangent space at origin. This enables us to replace
non-scalable M\"obius gyrovector operations with an Euclidean approximation,
and thus simplifying the entire hyperbolic model to a Euclidean model cascaded
with a hyperbolic normalization function. Our approach does not adhere to
M\"obius math, yet it still works in the Riemannian manifold, hence we call it
Pseudo-Poincar\'e framework. We applied our non-linear hyperbolic normalization
to the current state-of-the-art homogeneous and multi-relational graph networks
and demonstrate significant improvements in performance compared to both
Euclidean and hyperbolic counterparts. The primary impact of this work lies in
its ability to capture hierarchical features in the Euclidean space, and thus,
can replace hyperbolic networks without loss in performance metrics while
simultaneously leveraging the power of Euclidean networks such as
interpretability and efficient execution of various model components.