Unsupervised Learning of Neurosymbolic Encoders
  We present a framework for the unsupervised learning of neurosymbolic
encoders, i.e., encoders obtained by composing neural networks with symbolic
programs from a domain-specific language. Such a framework can naturally
incorporate symbolic expert knowledge into the learning process and lead to
more interpretable and factorized latent representations than fully neural
encoders. Also, models learned this way can have downstream impact, as many
analysis workflows can benefit from having clean programmatic descriptions. We
ground our learning algorithm in the variational autoencoding (VAE) framework,
where we aim to learn a neurosymbolic encoder in conjunction with a standard
decoder. Our algorithm integrates standard VAE-style training with modern
program synthesis techniques. We evaluate our method on learning latent
representations for real-world trajectory data from animal biology and sports
analytics. We show that our approach offers significantly better separation
than standard VAEs and leads to practical gains on downstream tasks.
