Compare the likelihood of various sentences in a LM?
Hi!I have the beginning of a sentence (2-3 words) and couple candidate full sentences starting or ending with those words. Is there an easy way to use Transformers to know which of the full sentences was more likely to be output by a language model?
2021-07-18T16:16:43Z
Hi Olivier,What about comparing the averagelog-likelihoodsof yours candidates?