Transform VisualBERT prediction_logits to probabilities
Hello,I finetuned a VisualBertForPreTraining model in order to perform a binary classification task using the Hateful Memes Dataset. However, my issue is that among the model’s outputs, obtained in the following way:outputs = model(
    input_ids=input_ids, 
    attention_mask=attention_mask, 
    token_type_ids=token_type_ids, 
    visual_embeds=visual_embeds, 
    visual_attention_mask=visual_attention_mask, 
    visual_token_type_ids=visual_token_type_ids,
    labels=token_labels
)there are no probabilities for the classification. Therefore, I believe it’s necessary to construct a classification head for the prediction_logits present in the model’s output.Specifically, what I obtain asoutput.prediction_logitsduring the evaluation phase, for a batch of 16 inputs, is a tensor of sizetorch.Size([16, 150, 30522]).How can I transform this tensor into probabilities?Thank you very much in advance for your help.