tool_call streaming returns no `arguments`, which is not compatible with langchain framework

#27
by LeonLiao - opened
{
  "id": "chatcmpl-2340ca66-0b84-4457-873c-eb01df9a16a3",
  "object": "chat.completion.chunk",
  "created": 1753503840,
  "model": "Qwen3-235B-A22B-2507",
  "choices": [
    {
      "index": 0,
      "delta": {
        "tool_calls": [
          {
            "id": "chatcmpl-tool-761f2ae6acf64ba58c975590f6fe2a13",
            "type": "function",
            "index": 0,
            "function": {
              "name": "handoff_to_planner" ### no arguments, expected arguments: ""
            }
          }
        ]
      },
      "logprobs": null,
      "finish_reason": null
    }
  ]
}

after the function.name, even no arguments to be streamed, arguments:"" should be returned.

The vllm is using --enable-auto-tool-choice --tool-call-parser hermes
0.1.dev7515+gb0fd4da.cu126

Should I upgrade the vllm version or using different parser: https://github.com/vllm-project/vllm/blob/7728dd77bb802e1876012eb264df4d2fa2fc6f3c/vllm/entrypoints/openai/tool_parsers/qwen3coder_tool_parser.py
?

Sign up or log in to comment