Tool Calling
Any fixes for tool calling or is that host side? Doesn’t seem to work in n8n, LM Studio or Jan AI. Chat template for tool calling seems to still be in the metadata. Custom thinking option also seem to be missing.
Thanks for your feedback!
We don't modify the tool calling settings - they should remain at default. However, we haven't verified that tool calling works properly with our model. For a quick solution, you can rebuild your GGUF model file with --override-kv to override metadata. See documentation here.
The --override-kv option allows you to override model metadata by key in the quantized model and can be specified multiple times.
Can you provide specific instructions to reproduce your issue? This would help us debug what settings might be wrong. For example:
- What tool calling format are you expecting?
- What error messages are you seeing?
- What's your current configuration in n8n/LM Studio/Jan AI?
Regarding the "custom thinking option" - can you clarify what you mean by this? It would help us understand if this is related to the tool calling issue or a separate concern.
Best,
Jinx Team