Mutli-label classification for large free text input
I have a dataset with 2 columns,around 100k lineslarge amount of free text (around 10k words per cell).a list of labels that this free text belong to. usually between 5 to 30 list items.the full unique list items (labels) are around 12k.I was wondering what would be the best way to train a model on this dataset, as majority of transformers has a maximum of 512 or 1024 only tokens as input.
2024-12-03T20:02:08Z
Sounds likeAnnifcould be usable for you. See alsoAnnif-wikiandAnnif-tutorialfor instructions.(FYI, I’m one of Annif developers.)
2024-12-10T06:54:36Z
I was looking for ready model but for best practice concept that need to be used in this case.Thank you for your input.