How to separate premise and hypothesis in Inference API
How should one separate the premise and hypothesis in the Host inference API on the model hub, for a natural language inference task?For example, for Roberta-large-mnli:roberta-large-mnli · Hugging Face,the “Hosted inference API” has an example input:I like you. </s></s> I love you.Does the model separate the premise and hypothesis based on</s></s>? Where is this documented? I could not find it.For another NLI model, the example input isI like you. I love you, which does not have</s></s>. This is fromynie/roberta-large-snli_mnli_fever_anli_R1_R2_R3-nli · Hugging FaceIf I want to upload my own model fine-tuned on MNLI, what should I do? I.e., how should I write themetadatain the model repo? What should the input look like? Thanks in advance!
2022-02-07T21:04:05Z
Good question, seems to also be related to this unanswered question:RoBERTa classification (with article + sentence)I’m pretty confused about this also. Here seem to be some relevant docs:RoBERTaIf our classification problem involves two pieces of text, should we be injecting these<s></s>characters between our two pieces of text? Presumably to give the model more of a hint that it is supposed to look at them (somewhat) separately?
2022-02-07T21:07:26Z
So far my tests indicate that when I do that, my training uses much more RAM, and has much worse accuracy… making me think that somehow using those tokens totally separates the examples (so they are separate instances in each batch)… which isn’t what I want if I want the model to look at both texts “together” with reference to the classification.