Logits in Question Answering model
Hi,I trained a question answering model based on the squad dataset. However, regardless on the model architecture I use (Electra, Bert, Roberta, etc.). There are cases when the model predicts an ‘start logit’ greater than the ‘end logit’.Why is this the case? All the samples in the squad dataset have an end position greater than the start position.Thanks!
2024-05-08T05:38:30Z
image953×1027 87.1 KBFrom NLP course at Huggingface