Zero shot classification for long form text
I’m looking to do topic prediction/classification on long form text (podcasts/transcripts) and I’m curious if anyone knows of a model for this? I’ve looked through the existing zero shot classification models but they all appear to be optimized for short form text like questions.If anyone knows of such a model I would appreciate it
2021-04-16T07:55:44Z
cc@joeddavwho is the zero-shot expert here
2021-04-20T15:07:25Z
Tbh your best approach is probably to just to do use one of the existing models and either (1) truncate the longer documents or (2) split them into smaller segments and ensemble the model’s predictions to get an overall label. There might be something more amenable to long sequences but I doubt it would do much better than that if there is.
2021-11-15T22:42:33Z
Just to clarify, current default behavior of the library when runningZeroShotClassificationPipelineon very long text will be (1) , i.e. truncation.(@joeddavcorrect me otherwise, that’s what I infer fromtransformers.pipelines.zero_shot_classification — transformers 4.13.0.dev0 documentation)
2024-07-15T05:25:41Z
Yes, that’s true. I tried with the same. Will hypothesis help for better results ?