Confidence score for NER model
Hi everyone,I need to calculate the confidence score for predictions of a NER- BERT model. I know how to get the probability of the predictions for each token, but I need a score for a complete span after aggregation if the named entity has more than one token (I mean there are also some tokens with I-tags). I would like to know what is a good way to calculate such scores? is it ok to multiply the confidence scores of the first and last tokens in the span?Many thanks for your help
2023-05-31T14:30:48Z
Could you find a solution to your problem,@zahra196? I am wondering the same thing and am trying to think of a solution.