Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2760] [FEAT]: Is there a way to disable streaming mode for GenericOpenAI #1775

New Issue
Closed
opened 2026-02-22 18:26:28 -05:00 by yindo · 2 comments
yindo commented 2026-02-22 18:26:28 -05:00
Owner
Copy Link
Copy Source

Originally created by @CharlesPeng1998 on GitHub (Dec 3, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2760

What would you like to see?

I am using a LLM that is served in OpenAI API spec but not supporting stream mode. I can see the response is just keep loading. I wonder if I can disable stream mode, or how can I modify the code to disable it?
image

Originally created by @CharlesPeng1998 on GitHub (Dec 3, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2760 ### What would you like to see? I am using a LLM that is served in OpenAI API spec but not supporting stream mode. I can see the response is just keep loading. I wonder if I can disable stream mode, or how can I modify the code to disable it? ![image](https://github.com/user-attachments/assets/f25efdb8-2328-4f68-a16a-7ce1327b38c7)
yindo added the enhancementfeature request labels 2026-02-22 18:26:28 -05:00
yindo closed this issue 2026-02-22 18:26:28 -05:00
yindo commented 2026-02-22 18:26:28 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 4, 2024):

Change
https://github.com/Mintplex-Labs/anything-llm/blob/6c9e234227aa32a02ba6a05ee978534760e3fd74/server/utils/AiProviders/genericOpenAi/index.js#L54C3-L56C4

to

 streamingEnabled() {
    return false;
  }
@timothycarambat commented on GitHub (Dec 4, 2024): Change https://github.com/Mintplex-Labs/anything-llm/blob/6c9e234227aa32a02ba6a05ee978534760e3fd74/server/utils/AiProviders/genericOpenAi/index.js#L54C3-L56C4 to ``` streamingEnabled() { return false; } ```
yindo commented 2026-02-22 18:26:29 -05:00
Author
Owner
Copy Link
Copy Source

@SecretiveShell commented on GitHub (Dec 6, 2024):

is there any way to disable this without having to vendor the repo?

@SecretiveShell commented on GitHub (Dec 6, 2024): is there any way to disable this without having to vendor the repo?
yindo changed title from [FEAT]: Is there a way to disable streaming mode for GenericOpenAI to [GH-ISSUE #2760] [FEAT]: Is there a way to disable streaming mode for GenericOpenAI 2026-06-05 14:42:37 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1775
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?