A Computationally Efficient Neural Network Invariant to the Action of
  Symmetry Subgroups
  We introduce a method to design a computationally efficient $G$-invariant
neural network that approximates functions invariant to the action of a given
permutation subgroup $G \leq S_n$ of the symmetric group on input data. The key
element of the proposed network architecture is a new $G$-invariant
transformation module, which produces a $G$-invariant latent representation of
the input data. This latent representation is then processed with a multi-layer
perceptron in the network. We prove the universality of the proposed
architecture, discuss its properties and highlight its computational and memory
efficiency. Theoretical considerations are supported by numerical experiments
involving different network configurations, which demonstrate the effectiveness
and strong generalization properties of the proposed method in comparison to
other $G$-invariant neural networks.
