Can I get logits for each sequence I acqired from model.generate()?
Hi, I’m currently stucked in getting logits from model.generate. I’m wondering if it is possible to get logits of each seqeucne returned by model.generate. (like logits for each token returned by model.logits)
2020-11-27T23:35:06Z
Hi, one way to do that is to modifygeneration_utilshuggingface.cotransformers.generation_utils — transformers 3.5.0 documentationFor examples, we can extract logits of greedy search in thescoresvariable (there are many options on next-token search eg. greedy, beam or sample searches)