langgenius/dify-plugin-sdks
1
0
Fork 0
mirror of https://github.com/langgenius/dify-plugin-sdks.git synced 2026-07-22 02:15:22 -04:00
Code Issues 58 Packages Projects Releases 10 Wiki Activity

Empty reasoning_content chunks cause multiple <think> blocks / repeated Thoughts entries in chat UI #70

New Issue
Open
opened 2026-02-15 21:15:33 -05:00 by yindo · 0 comments
yindo commented 2026-02-15 21:15:33 -05:00
Owner
Copy Link
Copy Source

Originally created by @utsumi-fj on GitHub (Jan 8, 2026).

Description

When an LLM response stream includes a chunk with an empty reasoning_content, the Dify chat UI ends up rendering multiple <think> blocks. As a result, multiple Thoughts (x.x s) entries are displayed.

Screenshots:

Image Image

Environment

  • Dify 1.11.2 self-hosted (Docker)
  • Dify Plugin SDK 0.7.1
  • OpenAI-API-Compatible plugin 0.0.30
  • Model: openai/gpt-oss-20b (served via vLLM)
  • Access path: LiteLLM endpoint registered to the OpenAI-API-Compatible plugin

Details

When sending a streaming request directly to the LiteLLM endpoint, the stream may include a chunk with an empty reasoning_content:

$ curl -H "Content-Type: application/json" -H "Authorization: Bearer $API_KEY" http://localhost:4000/v1/chat/completions -d '{"model":"openai/gpt-oss-20b","stream":true,"messages":[{"role":"user","content":"Please explain Euler-Lagrange equation."}]}'
...
data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":"","role":"assistant"}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"We","reasoning":"We"}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":" need","reasoning":" need"}}]}

...

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"t","reasoning":"t"}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"(","reasoning":"("}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":""}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"∂","reasoning":"∂"}}]}

...

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"##"}}]}

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":" The"}}]}

...

It looks like the Dify Plugin SDK closes the current <think> block when it encounters a chunk like the following:

data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":""}}]}

However, an empty reasoning_content chunk does not indicate the end of reasoning. Treating it as a boundary causes the SDK/UI to start a new <think> block for subsequent reasoning tokens, which results in multiple Thoughts (x.x s) entries.

Expected behavior

  • Empty reasoning_content (e.g. "delta":{"reasoning_content":""}) should not close the current <think> block.
  • The <think> block should be closed only when reasoning_content is absent or null.
Originally created by @utsumi-fj on GitHub (Jan 8, 2026). # Description When an LLM response stream includes a chunk with an empty `reasoning_content`, the Dify chat UI ends up rendering multiple `<think>` blocks. As a result, multiple `Thoughts (x.x s)` entries are displayed. Screenshots: <img width="1671" height="863" alt="Image" src="https://github.com/user-attachments/assets/8fe99075-166b-44ab-aa3c-e6992f16b730" /> <img width="1679" height="872" alt="Image" src="https://github.com/user-attachments/assets/530b861f-9900-41bb-bb42-5536098a1aa2" /> # Environment - Dify 1.11.2 self-hosted (Docker) - Dify Plugin SDK 0.7.1 - OpenAI-API-Compatible plugin 0.0.30 - Model: `openai/gpt-oss-20b` (served via vLLM) - Access path: LiteLLM endpoint registered to the OpenAI-API-Compatible plugin # Details When sending a streaming request directly to the LiteLLM endpoint, the stream may include a chunk with an empty `reasoning_content`: ``` $ curl -H "Content-Type: application/json" -H "Authorization: Bearer $API_KEY" http://localhost:4000/v1/chat/completions -d '{"model":"openai/gpt-oss-20b","stream":true,"messages":[{"role":"user","content":"Please explain Euler-Lagrange equation."}]}' ... data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":"","role":"assistant"}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"We","reasoning":"We"}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":" need","reasoning":" need"}}]} ... data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"t","reasoning":"t"}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"(","reasoning":"("}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":""}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"∂","reasoning":"∂"}}]} ... data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"##"}}]} data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":" The"}}]} ... ``` It looks like the Dify Plugin SDK closes the current `<think>` block when it encounters a chunk like the following: ``` data: {"id":"chatcmpl-a5b6f10276aae84e","created":1767852482,"model":"my-openai/gpt-oss-20b","object":"chat.completion.chunk","choices":[{"index":0,"delta":{"reasoning_content":"","reasoning":""}}]} ``` However, an empty `reasoning_content` chunk does not indicate the end of reasoning. Treating it as a boundary causes the SDK/UI to start a new `<think>` block for subsequent reasoning tokens, which results in multiple `Thoughts (x.x s)` entries. # Expected behavior - Empty `reasoning_content` (e.g. `"delta":{"reasoning_content":""}`) should not close the current `<think>` block. - The `<think>` block should be closed only when `reasoning_content` is absent or null.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
documentation
enhancement
pull-request
Mirrored from GitHub Pull Request
 question
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugin-sdks#70
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?