VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word
  Representations for Improved Definition Modeling
  In this paper, we tackle the task of definition modeling, where the goal is
to learn to generate definitions of words and phrases. Existing approaches for
this task are discriminative, combining distributional and lexical semantics in
an implicit rather than direct way. To tackle this issue we propose a
generative model for the task, introducing a continuous latent variable to
explicitly model the underlying relationship between a phrase used within a
context and its definition. We rely on variational inference for estimation and
leverage contextualized word embeddings for improved performance. Our approach
is evaluated on four existing challenging benchmarks with the addition of two
new datasets, "Cambridge" and the first non-English corpus "Robert", which we
release to complement our empirical study. Our Variational Contextual
Definition Modeler (VCDM) achieves state-of-the-art performance in terms of
automatic and human evaluation metrics, demonstrating the effectiveness of our
approach.
