tool_call streaming returns no `arguments`, which is not compatible with langchain framework
#27
by
LeonLiao
- opened
{
"id": "chatcmpl-2340ca66-0b84-4457-873c-eb01df9a16a3",
"object": "chat.completion.chunk",
"created": 1753503840,
"model": "Qwen3-235B-A22B-2507",
"choices": [
{
"index": 0,
"delta": {
"tool_calls": [
{
"id": "chatcmpl-tool-761f2ae6acf64ba58c975590f6fe2a13",
"type": "function",
"index": 0,
"function": {
"name": "handoff_to_planner" ### no arguments, expected arguments: ""
}
}
]
},
"logprobs": null,
"finish_reason": null
}
]
}
after the function.name, even no arguments to be streamed, arguments:""
should be returned.
The vllm is using --enable-auto-tool-choice --tool-call-parser hermes
0.1.dev7515+gb0fd4da.cu126
Should I upgrade the vllm version or using different parser: https://github.com/vllm-project/vllm/blob/7728dd77bb802e1876012eb264df4d2fa2fc6f3c/vllm/entrypoints/openai/tool_parsers/qwen3coder_tool_parser.py
?