instabase
/

llama2_tokenizer

Model card Files Files and versions

llama2_tokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

rpowalski's picture

copied from hf-internal-testing/llama-tokenizer

bca45fa almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
special_tokens_map.json

330 Bytes

copied from hf-internal-testing/llama-tokenizer almost 2 years ago
tokenizer.model

500 kB
xet

copied from hf-internal-testing/llama-tokenizer almost 2 years ago
tokenizer_config.json

1.16 kB

copied from hf-internal-testing/llama-tokenizer almost 2 years ago