Where to look for a loss definition for a pretrained model?
I am using facebook/opt-350m model:model = AutoModelForCausalLM.from_pretrained("facebook/opt-350m")As far as I understand, its default loss is the crossentropy loss. But how can I verify it, and where can I see the implementation details? Thank you.
2022-11-14T23:31:17Z
Hi, you can find the detailsherein themodeling_opt.pyfile
2022-11-15T00:25:01Z
Thanks a lot Steven! Just what I needed, and it also helped me to resolve another question I posted before. Thanks!