jina-code-embeddings-1.5b / added_tokens.json
alvarobartt's picture
alvarobartt HF Staff
Add `AutoTokenizer.from_pretrained` export
2518e09 verified
raw
history blame contribute delete
30 Bytes
{
"<|endoftext|>": 151643
}