Mix hierachy tokenizer level in trainer
Hi there, i have an idea to create a model with mix the character level and the word level in 1 big model (big model will contains 2 small model, 1 for character and 1 for the word) and i want to train it using Trainer, but i’m not able to do it. Anybody has tried it yet, can you give me some hint or some examples? thanks