How can train a POS model with XLNET?
Hi I am trying to tokenize and add POS tagging to a raw Japanese string, and I want to use XLNET for doing that. I can find thetokenizer here, but I cannot find one that I can use for POS tagging. Do I need to bridge with other models for doing that?
2022-04-18T20:31:02Z
If you’re looking for a starting point, I think you can model this as a token classification problem and fine-tune withXLNetForTokenClassificationhead, I also found an implementationherefor negation.
2022-04-18T23:08:46Z
@merveThank you so much for offering that as an example. A question popped up as I want to build a model from scratch. I have read the doc and I cannot find any option for feeding raw data intoXLNetConfig, have I missed anything?