T51.1 vocab seems to inlcude added tokens?
HIRight now, I am experimenting with things with t51.1, and I found something confusing.According to thisVocab Size does not change when adding new tokens · Issue #12632 · huggingface/transformers · GitHubThetokenizer.vocabsize should contain base vocab, but when I dolen(tokenizer)andtokenizer.vocab_size, they print out the same number, 32100, which, If I am not misunderstood, should not equal, right? because thelen(tokenizer)islen(vocab_size) + added_tokensCan someone clarify this, please?