Better, Faster Fermionic Neural Networks
  The Fermionic Neural Network (FermiNet) is a recently-developed neural
network architecture that can be used as a wavefunction Ansatz for
many-electron systems, and has already demonstrated high accuracy on small
systems. Here we present several improvements to the FermiNet that allow us to
set new records for speed and accuracy on challenging systems. We find that
increasing the size of the network is sufficient to reach chemical accuracy on
atoms as large as argon. Through a combination of implementing FermiNet in JAX
and simplifying several parts of the network, we are able to reduce the number
of GPU hours needed to train the FermiNet on large systems by an order of
magnitude. This enables us to run the FermiNet on the challenging transition of
bicyclobutane to butadiene and compare against the PauliNet on the
automerization of cyclobutadiene, and we achieve results near the state of the
art for both.
