Equivariant bifurcation, quadratic equivariants, and symmetry breaking
  for the standard representation of $S_n$
  Motivated by questions originating from the study of a class of shallow
student-teacher neural networks, methods are developed for the analysis of
spurious minima in classes of gradient equivariant dynamics related to neural
nets. In the symmetric case, methods depend on the generic equivariant
bifurcation theory of irreducible representations of the symmetric group on $n$
symbols, $S_n$; in particular, the standard representation of $S_n$. It is
shown that spurious minima do not arise from spontaneous symmetry breaking but
rather through a complex deformation of the landscape geometry that can be
encoded by a generic $S_n$-equivariant bifurcation. We describe minimal models
for forced symmetry breaking that give a lower bound on the dynamic complexity
involved in the creation of spurious minima when there is no symmetry. Results
on generic bifurcation when there are quadratic equivariants are also proved;
this work extends and clarifies results of Ihrig & Golubitsky and Chossat,
Lauterback & Melbourne on the instability of solutions when there are quadratic
equivariants.
