LongformerForQuestionAnswering - reaching TriviaQA leaderboard results
Hi everyone,I’m trying to reach the reported leaderboard results of Longformer (from the paper), and I am struggling.Steps that I took:I downloaded TriviaQA’s original dev set.I’m using LongformerForQuestionAnswering for evaluation.I normalize the predicted answers and compare them to the gold-label answers to compute ExactMatch.Am I missing something? Should any further processing be done before evaluating with LongformerForQuestionAnswering?I already looked at the Github repo of Longformer, it doens’t seem like they do any additional preprocessing to the dev data/context.
2020-12-09T12:41:46Z
Maybe@beltagycan help
2022-03-28T22:13:02Z
I’ve been struggling for weeks to fine-tune this model with kaggle data on tensorflow…