8B version not having tool call template in tokenizer_config.json
#4
by
komixenon
- opened
Previously, I was only using Ollama with the GGUF version, where I used the Llama 3.1 Modelfile and its corresponding template, and it worked. So, I wanted to test it in VLLM. After a bit of tinkering, I found that the 8B version could not call the tools at all. I then checked the chat_template and found that it did not specify any tool calls.