Learning Bilingual Sentence Embeddings via Autoencoding and Computing
  Similarities with a Multilayer Perceptron
  We propose a novel model architecture and training algorithm to learn
bilingual sentence embeddings from a combination of parallel and monolingual
data. Our method connects autoencoding and neural machine translation to force
the source and target sentence embeddings to share the same space without the
help of a pivot language or an additional transformation. We train a multilayer
perceptron on top of the sentence embeddings to extract good bilingual sentence
pairs from nonparallel or noisy parallel data. Our approach shows promising
performance on sentence alignment recovery and the WMT 2018 parallel corpus
filtering tasks with only a single model.
