[GH-ISSUE #3413] [BUG]: DeepSeek API returns truncated long response #2201

Closed
opened 2026-02-22 18:28:35 -05:00 by yindo · 1 comment
Owner

Originally created by @ambitiousCC on GitHub (Mar 7, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3413

How are you running AnythingLLM?

Docker (local)

What happened?

I found that when using the official API, the think content stops halfway and then waits for a long time before continuing to reply to the question. As shown in the figure, The content of the reasoning section is obviously truncated.

Image

The results of running the inference model locally are shown in the figure (only compatible with OpenAI's API)

Image

By the way, "\(" and "\)" are also mathematical symbol markers in LaTeX, and this model clearly uses this marking method, not "$". From the current return results, it seems that the "\( & \)" markers are not supported. When can compatibility be added?

Are there known steps to reproduce?

Using the official DeepSeek API, ask the same question as me:

Let $x,y$ and $z$ be positive real numbers that satisfy the following system of equations: \n\[\log_2\left({x \over yz}\right) = {1 \over 2}\]\n\[\log_2\left({y \over xz}\right) = {1 \over 3}\]\n\[\log_2\left({z \over xy}\right) = {1 \over 4}\]\nThen the value of $\left|\log_2(x^4y^3z^2)\right|$ is $\tfrac{m}{n}$ where $m$ and $n$ are relatively prime positive integers. Find $m+n$.
Originally created by @ambitiousCC on GitHub (Mar 7, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3413 ### How are you running AnythingLLM? Docker (local) ### What happened? I found that when using the official API, the think content stops halfway and then waits for a long time before continuing to reply to the question. As shown in the figure, The content of the reasoning section is obviously truncated. ![Image](https://github.com/user-attachments/assets/f837b072-33ce-42af-ab15-e5deae0a7028) The results of running the inference model locally are shown in the figure (only compatible with OpenAI's API) ![Image](https://github.com/user-attachments/assets/f4779295-bcd5-4fe4-bbeb-b7836f3fb09e) By the way, "\\(" and "\\)" are also mathematical symbol markers in LaTeX, and this model clearly uses this marking method, not "$". From the current return results, it seems that the "\\( & \\)" markers are not supported. When can compatibility be added? ### Are there known steps to reproduce? Using the official DeepSeek API, ask the same question as me: ``` Let $x,y$ and $z$ be positive real numbers that satisfy the following system of equations: \n\[\log_2\left({x \over yz}\right) = {1 \over 2}\]\n\[\log_2\left({y \over xz}\right) = {1 \over 3}\]\n\[\log_2\left({z \over xy}\right) = {1 \over 4}\]\nThen the value of $\left|\log_2(x^4y^3z^2)\right|$ is $\tfrac{m}{n}$ where $m$ and $n$ are relatively prime positive integers. Find $m+n$. ```
yindo added the possible bug label 2026-02-22 18:28:35 -05:00
yindo closed this issue 2026-02-22 18:28:35 -05:00
Author
Owner

@ambitiousCC commented on GitHub (Jun 26, 2025):

The new version no longer has this problem.

@ambitiousCC commented on GitHub (Jun 26, 2025): The new version no longer has this problem.
yindo changed title from [BUG]: DeepSeek API returns truncated long response to [GH-ISSUE #3413] [BUG]: DeepSeek API returns truncated long response 2026-06-05 14:45:09 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2201