How to calculate GPT-2 sentence loss (for each sentence) if batch has 2 or more sentences?
I need to calculate loss for batch of sentence but when i do this I get only average loss for all the sentences not all the loses for each sentence separatelly.from transformers import GPT2LMHeadModel, GPT2Tokenizer
model = GPT2LMHeadModel.from_pretrained('distilgpt2')
loss_list = model(input_ids, labels=input_ids)Is it possible to somehow calculate the loss of each sentence separatelly in one batch or I have to use only batch-size=1 which will be much slower.
2023-04-17T17:10:02Z
Did you figure this out?