bigscience-catalogue-data-dev
/

byte-level-bpe-tokenizer-nfkc-250k

Model card Files Files and versions Community

byte-level-bpe-tokenizer-nfkc-250k / tokenizer_config.json

Commit History

Add tokenizer

a7b042c

TimeRobber commited on Feb 17, 2022