Where is the tokenizer.model file?
#31
by
bradhutchings
- opened
To make my own GGUF with llama.cpp/convert_hf_to_gguf.py, a tokenizer.model file is required. This was included with phi-3. Can this be added to this repo? Or are there good instructions for making the file?
Nevermind. The latest llama.cpp handles this case correctly.
bradhutchings
changed discussion status to
closed
I made a mistake. but I could not delete the comment