langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-21 17:45:23 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

agent function call case error : Can't parse single qwen tool call output #140

New Issue
Closed
opened 2026-02-16 10:18:13 -05:00 by yindo · 3 comments
yindo commented 2026-02-16 10:18:13 -05:00
Owner
Copy Link
Copy Source

Originally created by @lordk911 on GitHub (Mar 27, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.1.1

Plugin version

xorbitsai/inference:0.0.2; agent:0.0.12

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

agent function call round2, send tool responce conent back to llm will cause error : Can't parse single qwen tool call output

✔️ Error log

please ref to : https://github.com/xorbitsai/inference/issues/3136

2025-03-28 12:44:03,575 xinference.core.worker 535489 DEBUG    Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:03,576 xinference.core.worker 535489 DEBUG    Leave describe_model, elapsed time: 0 s
2025-03-28 12:44:03,738 xinference.core.worker 535489 DEBUG    Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:03,738 xinference.core.worker 535489 DEBUG    Leave describe_model, elapsed time: 0 s
2025-03-28 12:44:03,790 xinference.core.worker 535489 DEBUG    Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:03,790 xinference.core.worker 535489 DEBUG    Leave get_model, elapsed time: 0 s
2025-03-28 12:44:03,794 xinference.core.worker 535489 DEBUG    Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:03,794 xinference.core.worker 535489 DEBUG    Leave describe_model, elapsed time: 0 s
2025-03-28 12:44:03,799 xinference.core.model 3520338 DEBUG    Request chat, current serve request count: 0, request limit: inf for the model qwen2.5-32B-instruct2
2025-03-28 12:44:03,801 xinference.core.model 3520338 DEBUG    [request 46691bf8-0b8f-11f0-91df-c6b2c06beeef] Enter chat, args: ModelActor(qwen2.5-32B-instruct2-0),[{'role': 'system', 'content': '尽可能使用工具集中的工具解决用户的问题。\n1、如果获取不到必要的信息，要求用户补全信息。\n2、可以优先尝试使用列表信息工具。\n3、...,{'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'tools':..., kwargs: raw_params={'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'stream': False, 'temperatur...
2025-03-28 12:44:03,803 xinference.model.llm.vllm.core 3520338 DEBUG    Enter generate, prompt: <|im_start|>system
尽可能使用工具集中的工具解决用户的问题。
1、如果获取不到必要的信息，要求用户补全信息。
2、可以优先尝试使用列表信息工具。
3、工具返回的结果字段要全部显示。
4、使用 <当前时间> ，计算得出工具所需时间类参数。

当前时间：
2025-03-28

# Tools

You may call one or more functions to assist with the user query.

You are provided with function signatures within <tools></tools> XML tags:
<tools>
{"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u5ba2\u6237\u7684\u62a5\u4ef7\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u62a5\u4ef7\u5355\u540d\u79f0\u3001\u7c7b\u578b\u3001\u72b6\u6001\u3001\u4e1a\u52a1\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868", "parameters": {"properties": {"customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001\uff0c\u53ef\u9009", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_sales": {"description": "\u4e1a\u52a1\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_type": {"description": "\u62a5\u4ef7\u5355\u7c7b\u578b\uff0c\u53ef\u9009", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u7ec6\u4fe1\u606f\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u62a5\u4ef7\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u5305\u62ec\u62a5\u4ef7\u4fe1\u606f\u548c\u5173\u8054\u8ba2\u5355\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u60c5", "parameters": {"properties": {"quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0", "type": "string"}}, "required": ["quote_name"], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u8ba2\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u65e5\u671f\u3001\u8ba2\u5355\u7c7b\u578b\u3001\u8ba2\u5355\u72b6\u6001\u3001\u9500\u552e\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868", "parameters": {"properties": {"branch": {"description": "\u5206\u652f\u673a\u6784\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "date_range": {"description": "\u65e5\u671f\u8303\u56f4\uff0c\u683c\u5f0f\u4e3a\u0027YYYY-MM-DD,YYYY-MM-DD\u0027\uff0c\u4f18\u5148\u7ea7\u9ad8\u4e8eyear\u548cmonth\u53c2\u6570", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "month": {"description": "\u6708\u4efd\uff0c\u4e0e\u5e74\u4efd\u914d\u5408\u4f7f\u7528\uff0c\u7528\u4e8e\u6309\u5e74\u6708\u7b5b\u9009\u8ba2\u5355", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001", "type": "string"}, "order_type": {"description": "\u8ba2\u5355\u7c7b\u578b", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "sales_name": {"description": "\u9500\u552e\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "year": {"description": "\u5e74\u4efd\uff0c\u7528\u4e8e\u6309\u5e74\u4efd\u7b5b\u9009\u8ba2\u5355", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u8be6\u60c5\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u8ba2\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u8be6\u7ec6\u4fe1\u606f", "parameters": {"properties": {"order_num": {"description": "\u8ba2\u5355\u7f16\u7801", "type": "string"}}, "required": ["order_num"], "type": "object"}}, "type": "function"}
</tools>

For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:
<tool_call>
{"name": <function-name>, "arguments": <args-json-object>}
</tool_call><|im_end|>
<|im_start|>user
查询客户：xx有限公司,去年的订单<|im_end|>
<|im_start|>assistant
, generate config: {'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'top_p': 0.7, 'stream': False, 'stop': ['<|endoftext|>', '<|im_start|>', '<|im_end|>'], 'stop_token_ids': [151643, 151644, 151645]}
INFO 03-28 12:44:03 async_llm_engine.py:211] Added request 4669413c-0b8f-11f0-91df-c6b2c06beeef.
INFO 03-28 12:44:06 metrics.py:455] Avg prompt throughput: 2.3 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 3.8%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:07 async_llm_engine.py:179] Finished request 4669413c-0b8f-11f0-91df-c6b2c06beeef.
2025-03-28 12:44:07,479 xinference.model.llm.utils 3520338 DEBUG    Tool call content: [(None, '获取订单列表', {'customer_name': 'xx有限公司', 'year': '2024'})]
2025-03-28 12:44:07,486 xinference.core.model 3520338 DEBUG    [request 46691bf8-0b8f-11f0-91df-c6b2c06beeef] Leave chat, elapsed time: 3 s
2025-03-28 12:44:07,486 xinference.core.model 3520338 DEBUG    After request chat, current serve request count: 0 for the model qwen2.5-32B-instruct2
2025-03-28 12:44:08,243 xinference.core.worker 535489 DEBUG    Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:08,243 xinference.core.worker 535489 DEBUG    Leave describe_model, elapsed time: 0 s
2025-03-28 12:44:08,332 xinference.core.worker 535489 DEBUG    Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-1
2025-03-28 12:44:08,333 xinference.core.worker 535489 DEBUG    Leave get_model, elapsed time: 0 s
2025-03-28 12:44:08,336 xinference.core.worker 535489 DEBUG    Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0
2025-03-28 12:44:08,337 xinference.core.worker 535489 DEBUG    Leave describe_model, elapsed time: 0 s
2025-03-28 12:44:08,343 xinference.core.model 3520899 DEBUG    Request chat, current serve request count: 0, request limit: inf for the model qwen2.5-32B-instruct2
2025-03-28 12:44:08,345 xinference.core.model 3520899 DEBUG    [request 491e6bd2-0b8f-11f0-b695-c6b2c06beeef] Enter chat, args: ModelActor(qwen2.5-32B-instruct2-1),[{'role': 'system', 'content': '尽可能使用工具集中的工具解决用户的问题。\n1、如果获取不到必要的信息，要求用户补全信息。\n2、可以优先尝试使用列表信息工具。\n3、...,{'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'tools':..., kwargs: raw_params={'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'stream': False, 'temperatur...
2025-03-28 12:44:08,348 xinference.model.llm.vllm.core 3520899 DEBUG    Enter generate, prompt: <|im_start|>system
尽可能使用工具集中的工具解决用户的问题。
1、如果获取不到必要的信息，要求用户补全信息。
2、可以优先尝试使用列表信息工具。
3、工具返回的结果字段要全���显示。
4、使用 <当前时间> ，计算得出工具所需时间类参数。

当前时间：
2025-03-28

# Tools

You may call one or more functions to assist with the user query.

You are provided with function signatures within <tools></tools> XML tags:
<tools>
{"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u5ba2\u6237\u7684\u62a5\u4ef7\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u62a5\u4ef7\u5355\u540d\u79f0\u3001\u7c7b\u578b\u3001\u72b6\u6001\u3001\u4e1a\u52a1\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868", "parameters": {"properties": {"customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001\uff0c\u53ef\u9009", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_sales": {"description": "\u4e1a\u52a1\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_type": {"description": "\u62a5\u4ef7\u5355\u7c7b\u578b\uff0c\u53ef\u9009", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u7ec6\u4fe1\u606f\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u62a5\u4ef7\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u5305\u62ec\u62a5\u4ef7\u4fe1\u606f\u548c\u5173\u8054\u8ba2\u5355\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u60c5", "parameters": {"properties": {"quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0", "type": "string"}}, "required": ["quote_name"], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u8ba2\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u65e5\u671f\u3001\u8ba2\u5355\u7c7b\u578b\u3001\u8ba2\u5355\u72b6\u6001\u3001\u9500\u552e\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868", "parameters": {"properties": {"branch": {"description": "\u5206\u652f\u673a\u6784\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "date_range": {"description": "\u65e5\u671f\u8303\u56f4\uff0c\u683c\u5f0f\u4e3a\u0027YYYY-MM-DD,YYYY-MM-DD\u0027\uff0c\u4f18\u5148\u7ea7\u9ad8\u4e8eyear\u548cmonth\u53c2\u6570", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "month": {"description": "\u6708\u4efd\uff0c\u4e0e\u5e74\u4efd\u914d\u5408\u4f7f\u7528\uff0c\u7528\u4e8e\u6309\u5e74\u6708\u7b5b\u9009\u8ba2\u5355", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001", "type": "string"}, "order_type": {"description": "\u8ba2\u5355\u7c7b\u578b", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "sales_name": {"description": "\u9500\u552e\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "year": {"description": "\u5e74\u4efd\uff0c\u7528\u4e8e\u6309\u5e74\u4efd\u7b5b\u9009\u8ba2\u5355", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"}
{"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u8be6\u60c5\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u8ba2\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u8be6\u7ec6\u4fe1\u606f", "parameters": {"properties": {"order_num": {"description": "\u8ba2\u5355\u7f16\u7801", "type": "string"}}, "required": ["order_num"], "type": "object"}}, "type": "function"}
</tools>

For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:
<tool_call>
{"name": <function-name>, "arguments": <args-json-object>}
</tool_call><|im_end|>
<|im_start|>system
尽可能使用工具集中的工具解决用户的问题。
1、如果获取不到必要的信息，要求用户补全信息。
2、可以优先尝试使用列表信息工具。
3、工具返回的结果字段要全部显示。
4、使用 <当前时间> ，计算得出工具所需时间类参数。

当前时间：
2025-03-28<|im_end|>
<|im_start|>user
查询客户：xx有限公司,去年的订单<|im_end|>
<|im_start|>user
查询客户：xx有限公司,去年的订单<|im_end|>
<|im_start|>assistant
<|im_end|>
<|im_start|>user
<tool_response>
[{"order_id": "2-QNeMer0a", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DOVZVp2r", "intent_order_dt": null, "order_dt": null, "order_type": "负订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:28:26", "order_update_dt": "2024-01-08T09:28:26", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": -240.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-QnnRpGZ6", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-D3JdvrwE", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-14T15:46:27", "order_update_dt": "2024-01-14T15:46:27", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-DMZVe385", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DdoM4aZp", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:05:57", "order_update_dt": "2024-01-08T09:05:57", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-DvMz48MA", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-KlGXW7G7", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:02:21", "order_update_dt": "2024-01-08T09:28:42", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 240.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Ko339RNj", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DW44GE7X", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-03T09:54:15", "order_update_dt": "2024-01-03T09:54:15", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Dxowy75E", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-KZjJwxXB", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-15T16:30:49", "order_update_dt": "2024-01-15T16:30:49", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-YG9zv1Zx", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-Y6a78ywJ", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-05T14:08:46", "order_update_dt": "2024-01-05T14:08:46", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Ddok8gPq", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-QeW41oM6", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-14T15:56:58", "order_update_dt": "2024-01-14T15:56:58", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-KlGkNOxx", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-QNeL6aqP", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-11T10:40:07", "order_update_dt": "2024-01-11T10:40:07", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}]
</tool_response><|im_end|>
<|im_start|>assistant
, generate config: {'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'top_p': 0.7, 'stream': False, 'stop': ['<|endoftext|>', '<|im_start|>', '<|im_end|>'], 'stop_token_ids': [151643, 151644, 151645]}
INFO 03-28 12:44:08 async_llm_engine.py:211] Added request 491ea21e-0b8f-11f0-b695-c6b2c06beeef.
INFO 03-28 12:44:14 metrics.py:455] Avg prompt throughput: 6.1 tokens/s, Avg generation throughput: 0.1 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 9.8%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:19 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.0%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:24 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.2%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:29 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.4%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:34 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.8 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.6%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:39 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.8 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.8%, CPU KV cache usage: 0.0%.
INFO 03-28 12:44:40 async_llm_engine.py:179] Finished request 491ea21e-0b8f-11f0-b695-c6b2c06beeef.
2025-03-28 12:44:40,282 xinference.model.llm.utils 3520899 ERROR    Can't parse single qwen tool call output: 根据查询结果，客户“xx有限公司”在去年（2024年）有以下订单：

1. 订单编号：2-DOVZVp2r
   - 订单类型：负订单
   - 子类型：xxx销售单
   - 订单状态：完成
   - 金额：-240.0
   - 创建日期：2024-01-08

2. 订单编号：2-D3JdvrwE
   - 订单类型：意向订单
   - 子类型：xxx销售单
   - 订单状态：完成
   - 金额：0.0
   - 创建日期：2024-01-14

以上订单信息均来自于2024年，是由销售员山岳负责的。请注意，这些订单中的大部分金额为0，只有一个负订单和一个正订单。如果您需要进一步的详细信息，请告知我。. Error: Expecting value: line 1 column 1 (char 0)
2025-03-28 12:44:40,282 xinference.model.llm.utils 3520899 DEBUG    Tool call content: [('根据查询结果，客户“xx有限公司”在去年（2024年）有以下订单：\n\n1. 订单编号：2-DOVZVp2r\n   - 订单类型：负订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：-240.0\n   - 创建日期：2024-01-08\n\n2. 订单编号：2-D3JdvrwE\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-14\n\n3. 订单编号：2-DdoM4aZp\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-08\n\n4. 订单编号：2-KlGXW7G7\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：240.0\n   - 创建日期：2024-01-08\n\n5. 订单编号：2-DW44GE7X\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-03\n\n6. 订单编号：2-KZjJwxXB\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-15\n\n7. 订单编号：2-Y6a78ywJ\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-05\n\n8. 订单编号：2-QeW41oM6\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-14\n\n9. 订单编号：2-QNeL6aqP\n   - 订单类型：意向订单\n   - 子类型：xxx销售单\n   - 订单状态：完成\n   - 金额：0.0\n   - 创建日期：2024-01-11\n\n以上订单信息均来自于2024年，是由销售员山岳负责的。请注意，这些订单中的大部分金额为0，只有一个负订单和一个正订单。如果您需要进一步的详细信息，请告知我。', None, None)]
2025-03-28 12:44:40,289 xinference.core.model 3520899 DEBUG    [request 491e6bd2-0b8f-11f0-b695-c6b2c06beeef] Leave chat, elapsed time: 31 s
2025-03-28 12:44:40,289 xinference.core.model 3520899 DEBUG    After request chat, current serve request count: 0 for the model qwen2.5-32B-instruct2
Originally created by @lordk911 on GitHub (Mar 27, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.1.1 ### Plugin version xorbitsai/inference:0.0.2; agent:0.0.12 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce agent function call round2, send tool responce conent back to llm will cause error : Can't parse single qwen tool call output ### ✔️ Error log please ref to : https://github.com/xorbitsai/inference/issues/3136 ``` 2025-03-28 12:44:03,575 xinference.core.worker 535489 DEBUG Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:03,576 xinference.core.worker 535489 DEBUG Leave describe_model, elapsed time: 0 s 2025-03-28 12:44:03,738 xinference.core.worker 535489 DEBUG Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:03,738 xinference.core.worker 535489 DEBUG Leave describe_model, elapsed time: 0 s 2025-03-28 12:44:03,790 xinference.core.worker 535489 DEBUG Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:03,790 xinference.core.worker 535489 DEBUG Leave get_model, elapsed time: 0 s 2025-03-28 12:44:03,794 xinference.core.worker 535489 DEBUG Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:03,794 xinference.core.worker 535489 DEBUG Leave describe_model, elapsed time: 0 s 2025-03-28 12:44:03,799 xinference.core.model 3520338 DEBUG Request chat, current serve request count: 0, request limit: inf for the model qwen2.5-32B-instruct2 2025-03-28 12:44:03,801 xinference.core.model 3520338 DEBUG [request 46691bf8-0b8f-11f0-91df-c6b2c06beeef] Enter chat, args: ModelActor(qwen2.5-32B-instruct2-0),[{'role': 'system', 'content': '尽可能使用工具集中的工具解决用户的问题。\n1、如果获取不到必要的信息，要求用户补全信息。\n2、可以优先尝试使用列表信息工具。\n3、...,{'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'tools':..., kwargs: raw_params={'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'stream': False, 'temperatur... 2025-03-28 12:44:03,803 xinference.model.llm.vllm.core 3520338 DEBUG Enter generate, prompt: <|im_start|>system 尽可能使用工具集中的工具解决用户的问题。 1、如果获取不到必要的信息，要求用户补全信息。 2、可以优先尝试使用列表信息工具。 3、工具返回的结果字段要全部显示。 4、使用 <当前时间> ，计算得出工具所需时间类参数。 当前时间： 2025-03-28 # Tools You may call one or more functions to assist with the user query. You are provided with function signatures within <tools></tools> XML tags: <tools> {"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u5ba2\u6237\u7684\u62a5\u4ef7\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u62a5\u4ef7\u5355\u540d\u79f0\u3001\u7c7b\u578b\u3001\u72b6\u6001\u3001\u4e1a\u52a1\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868", "parameters": {"properties": {"customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001\uff0c\u53ef\u9009", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_sales": {"description": "\u4e1a\u52a1\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_type": {"description": "\u62a5\u4ef7\u5355\u7c7b\u578b\uff0c\u53ef\u9009", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u7ec6\u4fe1\u606f\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u62a5\u4ef7\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u5305\u62ec\u62a5\u4ef7\u4fe1\u606f\u548c\u5173\u8054\u8ba2\u5355\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u60c5", "parameters": {"properties": {"quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0", "type": "string"}}, "required": ["quote_name"], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u8ba2\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u65e5\u671f\u3001\u8ba2\u5355\u7c7b\u578b\u3001\u8ba2\u5355\u72b6\u6001\u3001\u9500\u552e\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868", "parameters": {"properties": {"branch": {"description": "\u5206\u652f\u673a\u6784\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "date_range": {"description": "\u65e5\u671f\u8303\u56f4\uff0c\u683c\u5f0f\u4e3a\u0027YYYY-MM-DD,YYYY-MM-DD\u0027\uff0c\u4f18\u5148\u7ea7\u9ad8\u4e8eyear\u548cmonth\u53c2\u6570", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "month": {"description": "\u6708\u4efd\uff0c\u4e0e\u5e74\u4efd\u914d\u5408\u4f7f\u7528\uff0c\u7528\u4e8e\u6309\u5e74\u6708\u7b5b\u9009\u8ba2\u5355", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001", "type": "string"}, "order_type": {"description": "\u8ba2\u5355\u7c7b\u578b", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "sales_name": {"description": "\u9500\u552e\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "year": {"description": "\u5e74\u4efd\uff0c\u7528\u4e8e\u6309\u5e74\u4efd\u7b5b\u9009\u8ba2\u5355", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u8be6\u60c5\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u8ba2\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u8be6\u7ec6\u4fe1\u606f", "parameters": {"properties": {"order_num": {"description": "\u8ba2\u5355\u7f16\u7801", "type": "string"}}, "required": ["order_num"], "type": "object"}}, "type": "function"} </tools> For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags: <tool_call> {"name": <function-name>, "arguments": <args-json-object>} </tool_call><|im_end|> <|im_start|>user 查询客户：xx有限公司,去年的订单<|im_end|> <|im_start|>assistant , generate config: {'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'top_p': 0.7, 'stream': False, 'stop': ['<|endoftext|>', '<|im_start|>', '<|im_end|>'], 'stop_token_ids': [151643, 151644, 151645]} INFO 03-28 12:44:03 async_llm_engine.py:211] Added request 4669413c-0b8f-11f0-91df-c6b2c06beeef. INFO 03-28 12:44:06 metrics.py:455] Avg prompt throughput: 2.3 tokens/s, Avg generation throughput: 0.0 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 3.8%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:07 async_llm_engine.py:179] Finished request 4669413c-0b8f-11f0-91df-c6b2c06beeef. 2025-03-28 12:44:07,479 xinference.model.llm.utils 3520338 DEBUG Tool call content: [(None, '获取订单列表', {'customer_name': 'xx有限公司', 'year': '2024'})] 2025-03-28 12:44:07,486 xinference.core.model 3520338 DEBUG [request 46691bf8-0b8f-11f0-91df-c6b2c06beeef] Leave chat, elapsed time: 3 s 2025-03-28 12:44:07,486 xinference.core.model 3520338 DEBUG After request chat, current serve request count: 0 for the model qwen2.5-32B-instruct2 2025-03-28 12:44:08,243 xinference.core.worker 535489 DEBUG Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:08,243 xinference.core.worker 535489 DEBUG Leave describe_model, elapsed time: 0 s 2025-03-28 12:44:08,332 xinference.core.worker 535489 DEBUG Enter get_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-1 2025-03-28 12:44:08,333 xinference.core.worker 535489 DEBUG Leave get_model, elapsed time: 0 s 2025-03-28 12:44:08,336 xinference.core.worker 535489 DEBUG Enter describe_model, args: <xinference.core.worker.WorkerActor object at 0x7f679e5c9940>, kwargs: model_uid=qwen2.5-32B-instruct2-0 2025-03-28 12:44:08,337 xinference.core.worker 535489 DEBUG Leave describe_model, elapsed time: 0 s 2025-03-28 12:44:08,343 xinference.core.model 3520899 DEBUG Request chat, current serve request count: 0, request limit: inf for the model qwen2.5-32B-instruct2 2025-03-28 12:44:08,345 xinference.core.model 3520899 DEBUG [request 491e6bd2-0b8f-11f0-b695-c6b2c06beeef] Enter chat, args: ModelActor(qwen2.5-32B-instruct2-1),[{'role': 'system', 'content': '尽可能使用工具集中的工具解决用户的问题。\n1、如果获取不到必要的信息，要求用户补全信息。\n2、可以优先尝试使用列表信息工具。\n3、...,{'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'tools':..., kwargs: raw_params={'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'stream': False, 'temperatur... 2025-03-28 12:44:08,348 xinference.model.llm.vllm.core 3520899 DEBUG Enter generate, prompt: <|im_start|>system 尽可能使用工具集中的工具解决用户的问题。 1、如果获取不到必要的信息，要求用户补全信息。 2、可以优先尝试使用列表信息工具。 3、工具返回的结果字段要全���显示。 4、使用 <当前时间> ，计算得出工具所需时间类参数。 当前时间： 2025-03-28 # Tools You may call one or more functions to assist with the user query. You are provided with function signatures within <tools></tools> XML tags: <tools> {"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u5ba2\u6237\u7684\u62a5\u4ef7\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u62a5\u4ef7\u5355\u540d\u79f0\u3001\u7c7b\u578b\u3001\u72b6\u6001\u3001\u4e1a\u52a1\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u5217\u8868", "parameters": {"properties": {"customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001\uff0c\u53ef\u9009", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_sales": {"description": "\u4e1a\u52a1\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "quote_type": {"description": "\u62a5\u4ef7\u5355\u7c7b\u578b\uff0c\u53ef\u9009", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u7ec6\u4fe1\u606f\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u62a5\u4ef7\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\uff0c\u5305\u62ec\u62a5\u4ef7\u4fe1\u606f\u548c\u5173\u8054\u8ba2\u5355\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u62a5\u4ef7\u5355\u8be6\u60c5", "parameters": {"properties": {"quote_name": {"description": "\u62a5\u4ef7\u5355\u540d\u79f0", "type": "string"}}, "required": ["quote_name"], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868\n\u6b64\u63a5\u53e3\u7528\u4e8e\u5206\u9875\u83b7\u53d6\u8ba2\u5355\u5217\u8868\uff0c\u652f\u6301\u6309\u5ba2\u6237\u540d\u79f0\u3001\u65e5\u671f\u3001\u8ba2\u5355\u7c7b\u578b\u3001\u8ba2\u5355\u72b6\u6001\u3001\u9500\u552e\u5458\u548c\u91d1\u989d\u8303\u56f4\u7b5b\u9009\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u5217\u8868", "parameters": {"properties": {"branch": {"description": "\u5206\u652f\u673a\u6784\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "customer_name": {"description": "\u5ba2\u6237\u540d\u79f0\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "date_range": {"description": "\u65e5\u671f\u8303\u56f4\uff0c\u683c\u5f0f\u4e3a\u0027YYYY-MM-DD,YYYY-MM-DD\u0027\uff0c\u4f18\u5148\u7ea7\u9ad8\u4e8eyear\u548cmonth\u53c2\u6570", "type": "string"}, "max_amount": {"description": "\u6700\u5927\u91d1\u989d", "type": "string"}, "min_amount": {"description": "\u6700\u5c0f\u91d1\u989d", "type": "string"}, "month": {"description": "\u6708\u4efd\uff0c\u4e0e\u5e74\u4efd\u914d\u5408\u4f7f\u7528\uff0c\u7528\u4e8e\u6309\u5e74\u6708\u7b5b\u9009\u8ba2\u5355", "type": "string"}, "order_status": {"description": "\u8ba2\u5355\u72b6\u6001", "type": "string"}, "order_type": {"description": "\u8ba2\u5355\u7c7b\u578b", "type": "string"}, "page": {"description": "\u9875\u7801\uff0c\u4ece1\u5f00\u59cb", "type": "number"}, "page_size": {"description": "\u6bcf\u9875\u8bb0\u5f55\u6570\uff0c\u9ed8\u8ba410\u6761", "type": "number"}, "sales_name": {"description": "\u9500\u552e\u5458\u59d3\u540d\uff0c\u652f\u6301\u6a21\u7cca\u67e5\u8be2", "type": "string"}, "year": {"description": "\u5e74\u4efd\uff0c\u7528\u4e8e\u6309\u5e74\u4efd\u7b5b\u9009\u8ba2\u5355", "type": "string"}}, "required": [], "type": "object"}}, "type": "function"} {"function": {"description": "\u83b7\u53d6\u8ba2\u5355\u8be6\u60c5\n\u6b64\u63a5\u53e3\u7528\u4e8e\u83b7\u53d6\u6307\u5b9a\u8ba2\u5355\u7684\u8be6\u7ec6\u4fe1\u606f\u3002", "name": "\u83b7\u53d6\u8ba2\u5355\u8be6\u7ec6\u4fe1\u606f", "parameters": {"properties": {"order_num": {"description": "\u8ba2\u5355\u7f16\u7801", "type": "string"}}, "required": ["order_num"], "type": "object"}}, "type": "function"} </tools> For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags: <tool_call> {"name": <function-name>, "arguments": <args-json-object>} </tool_call><|im_end|> <|im_start|>system 尽可能使用工具集中的工具解决用户的问题。 1、如果获取不到必要的信息，要求用户补全信息。 2、可以优先尝试使用列表信息工具。 3、工具返回的结果字段要全部显示。 4、使用 <当前时间> ，计算得出工具所需时间类参数。 当前时间： 2025-03-28<|im_end|> <|im_start|>user 查询客户：xx有限公司,去年的订单<|im_end|> <|im_start|>user 查询客户：xx有限公司,去年的订单<|im_end|> <|im_start|>assistant <|im_end|> <|im_start|>user <tool_response> [{"order_id": "2-QNeMer0a", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DOVZVp2r", "intent_order_dt": null, "order_dt": null, "order_type": "负订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:28:26", "order_update_dt": "2024-01-08T09:28:26", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": -240.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-QnnRpGZ6", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-D3JdvrwE", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-14T15:46:27", "order_update_dt": "2024-01-14T15:46:27", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-DMZVe385", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DdoM4aZp", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:05:57", "order_update_dt": "2024-01-08T09:05:57", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-DvMz48MA", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-KlGXW7G7", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-08T09:02:21", "order_update_dt": "2024-01-08T09:28:42", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 240.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Ko339RNj", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-DW44GE7X", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-03T09:54:15", "order_update_dt": "2024-01-03T09:54:15", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Dxowy75E", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-KZjJwxXB", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-15T16:30:49", "order_update_dt": "2024-01-15T16:30:49", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-YG9zv1Zx", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-Y6a78ywJ", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-05T14:08:46", "order_update_dt": "2024-01-05T14:08:46", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-Ddok8gPq", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-QeW41oM6", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-14T15:56:58", "order_update_dt": "2024-01-14T15:56:58", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}, {"order_id": "2-KlGkNOxx", "created_at": null, "updated_at": null, "glb": null, "org": null, "customer_org": null, "division": null, "accnt_name": "xx有限公司", "order_num": "2-QNeL6aqP", "intent_order_dt": null, "order_dt": null, "order_type": "意向订单", "sub_type": "xxx销售单", "order_status": "完成", "big_flg": null, "ori_order_num": null, "sales": "山岳", "sales_id": "1-562CH5X", "salesperson_org": null, "order_create_dt": "2024-01-11T10:40:07", "order_update_dt": "2024-01-11T10:40:07", "accnt_id": null, "price_list_id": null, "delivery_num": null, "payment_dt": null, "comments": null, "desc_text": null, "cancel_flg": null, "contact_name": null, "contact_phone_num": null, "elec_delivery_flg": null, "elec_delivery_dt": null, "elec_delivery_source": null, "spec_flg": null, "amount": 0.0, "create_order_type": null, "pre_currncy": null, "exchange_rate": null, "inv_org": null, "online_flg": null, "cpq_num": null, "type_yn": null, "full_invoice_num": null, "full_invoice_amount": null, "pay_amt": null, "sap_order_number": null, "sales_org": null, "first_inv_dt": null, "bill_cust": null, "pay_risk_level": null, "refund_reason": null, "order_bad_debt_tag": null, "order_bad_debt_amount": null, "invoice_bad_debt_amount": null}] </tool_response><|im_end|> <|im_start|>assistant , generate config: {'frequency_penalty': 0.0, 'max_tokens': 1024, 'presence_penalty': 0.0, 'temperature': 1.0, 'top_p': 0.7, 'stream': False, 'stop': ['<|endoftext|>', '<|im_start|>', '<|im_end|>'], 'stop_token_ids': [151643, 151644, 151645]} INFO 03-28 12:44:08 async_llm_engine.py:211] Added request 491ea21e-0b8f-11f0-b695-c6b2c06beeef. INFO 03-28 12:44:14 metrics.py:455] Avg prompt throughput: 6.1 tokens/s, Avg generation throughput: 0.1 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 9.8%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:19 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.0%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:24 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.2%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:29 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.9 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.4%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:34 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.8 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.6%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:39 metrics.py:455] Avg prompt throughput: 0.0 tokens/s, Avg generation throughput: 26.8 tokens/s, Running: 1 reqs, Swapped: 0 reqs, Pending: 0 reqs, GPU KV cache usage: 10.8%, CPU KV cache usage: 0.0%. INFO 03-28 12:44:40 async_llm_engine.py:179] Finished request 491ea21e-0b8f-11f0-b695-c6b2c06beeef. 2025-03-28 12:44:40,282 xinference.model.llm.utils 3520899 ERROR Can't parse single qwen tool call output: 根据查询结果，客户“xx有限公司”在去年（2024年）有以下订单： 1. 订单编号：2-DOVZVp2r - 订单类型：负订单 - 子类型：xxx销售单 - 订单状态：完成 - 金额：-240.0 - 创建日期：2024-01-08 2. 订单编号：2-D3JdvrwE - 订单类型：意向订单 - 子类型：xxx销售单 - 订单状态：完成 - 金额：0.0 - 创建日期：2024-01-14 以上订单信息均来自于2024年，是由销售员山岳负责的。请注意，这些订单中的大部分金额为0，只有一个负订单和一个正订单。如果您需要进一步的详细信息，请告知我。. Error: Expecting value: line 1 column 1 (char 0) 2025-03-28 12:44:40,282 xinference.model.llm.utils 3520899 DEBUG Tool call content: [('根据查询结果，客户“xx有限公司”在去年（2024年）有以下订单：\n\n1. 订单编号：2-DOVZVp2r\n - 订单类型：负订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：-240.0\n - 创建日期：2024-01-08\n\n2. 订单编号：2-D3JdvrwE\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-14\n\n3. 订单编号：2-DdoM4aZp\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-08\n\n4. 订单编号：2-KlGXW7G7\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：240.0\n - 创建日期：2024-01-08\n\n5. 订单编号：2-DW44GE7X\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-03\n\n6. 订单编号：2-KZjJwxXB\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-15\n\n7. 订单编号：2-Y6a78ywJ\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-05\n\n8. 订单编号：2-QeW41oM6\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-14\n\n9. 订单编号：2-QNeL6aqP\n - 订单类型：意向订单\n - 子类型：xxx销售单\n - 订单状态：完成\n - 金额：0.0\n - 创建日期：2024-01-11\n\n以上订单信息均来自于2024年，是由销售员山岳负责的。请注意，这些订单中的大部分金额为0，只有一个负订单和一个正订单。如果您需要进一步的详细信息，请告知我。', None, None)] 2025-03-28 12:44:40,289 xinference.core.model 3520899 DEBUG [request 491e6bd2-0b8f-11f0-b695-c6b2c06beeef] Leave chat, elapsed time: 31 s 2025-03-28 12:44:40,289 xinference.core.model 3520899 DEBUG After request chat, current serve request count: 0 for the model qwen2.5-32B-instruct2 ```
yindo added the bug label 2026-02-16 10:18:13 -05:00
yindo closed this issue 2026-02-16 10:18:13 -05:00
yindo commented 2026-02-16 10:18:13 -05:00
Author
Owner
Copy Link
Copy Source

@lordk911 commented on GitHub (Mar 31, 2025):

Dify function call agent conducted two rounds of queries on the large model.
1、request 46691bf8-0b8f-11f0-91df-c6b2c06beeef get back the function call json output.
2、request 491e6bd2-0b8f-11f0-b695-c6b2c06beeef Query the large model again based on the result obtained by invoking with the tools

Please notice the Tool call content key words.
It may be the problem of prompt or the llm self problem. on the round 2, the return result is still Tool call content ... In fact, it should be to directly return the result.

@Nov1c444

@lordk911 commented on GitHub (Mar 31, 2025): Dify function call agent conducted two rounds of queries on the large model. 1、request `46691bf8-0b8f-11f0-91df-c6b2c06beeef` get back the function call json output. 2、request `491e6bd2-0b8f-11f0-b695-c6b2c06beeef` Query the large model again based on the result obtained by invoking with the tools Please notice the `Tool call content` key words. It may be the problem of prompt or the llm self problem. on the round 2, the return result is still Tool call content ... In fact, it should be to directly return the result. @Nov1c444
yindo commented 2026-02-16 10:18:13 -05:00
Author
Owner
Copy Link
Copy Source

@lordk911 commented on GitHub (Mar 31, 2025):

https://github.com/xorbitsai/inference/issues/3136#issuecomment-2765557691

@lordk911 commented on GitHub (Mar 31, 2025): https://github.com/xorbitsai/inference/issues/3136#issuecomment-2765557691
yindo commented 2026-02-16 10:18:13 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Aug 15, 2025):

Hi, @lordk911. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported an error in Dify v1.1.1 with the agent plugin (0.0.12) related to function calls to the qwen tool.
  • The error "Can't parse single qwen tool call output" occurs during the second round of agent queries in a self-hosted Docker setup.
  • The second request returns "Tool call content" instead of the expected direct result, indicating a possible prompt or LLM issue.
  • You referenced a related discussion in the xorbitsai/inference repository and tagged @Nov1c444 for input.
  • The issue remains unresolved with no recent updates.

What's Next:

  • Please confirm if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If no further activity occurs, I will automatically close this issue in 5 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 15, 2025): Hi, @lordk911. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported an error in Dify v1.1.1 with the agent plugin (0.0.12) related to function calls to the qwen tool. - The error "Can't parse single qwen tool call output" occurs during the second round of agent queries in a self-hosted Docker setup. - The second request returns "Tool call content" instead of the expected direct result, indicating a possible prompt or LLM issue. - You referenced a related discussion in the xorbitsai/inference repository and tagged @Nov1c444 for input. - The issue remains unresolved with no recent updates. **What's Next:** - Please confirm if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If no further activity occurs, I will automatically close this issue in 5 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#140
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?