Convolutional Neural Networks on non-uniform geometrical signals using
  Euclidean spectral transformation
  Convolutional Neural Networks (CNN) have been successful in processing data
signals that are uniformly sampled in the spatial domain (e.g., images).
However, most data signals do not natively exist on a grid, and in the process
of being sampled onto a uniform physical grid suffer significant aliasing error
and information loss. Moreover, signals can exist in different topological
structures as, for example, points, lines, surfaces and volumes. It has been
challenging to analyze signals with mixed topologies (for example, point cloud
with surface mesh). To this end, we develop mathematical formulations for
Non-Uniform Fourier Transforms (NUFT) to directly, and optimally, sample
nonuniform data signals of different topologies defined on a simplex mesh into
the spectral domain with no spatial sampling error. The spectral transform is
performed in the Euclidean space, which removes the translation ambiguity from
works on the graph spectrum. Our representation has four distinct advantages:
(1) the process causes no spatial sampling error during the initial sampling,
(2) the generality of this approach provides a unified framework for using CNNs
to analyze signals of mixed topologies, (3) it allows us to leverage
state-of-the-art backbone CNN architectures for effective learning without
having to design a particular architecture for a particular data structure in
an ad-hoc fashion, and (4) the representation allows weighted meshes where each
element has a different weight (i.e., texture) indicating local properties. We
achieve results on par with the state-of-the-art for the 3D shape retrieval
task, and a new state-of-the-art for the point cloud to surface reconstruction
task.
