mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 22:23:50 -04:00
Closed
opened 2026-02-22 18:29:35 -05:00 by yindo
·
10 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
No Label
needs info / can't replicate
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#2417
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @JayCroghan on GitHub (May 2, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3754
Originally assigned to: @shatfield4 on GitHub.
How are you running AnythingLLM?
Docker (remote machine)
What happened?
I'm using a Generic OpenAI which worked before, didn't do anything with it for quite a while and I come back to it after users started telling me it stopped working.
I upgraded to latest version and I get the same issue. Everyone else in the company is able to make the requests successfully using streaming replies and I can do it from cURL.
[backend] error: Error: 500 true at APIError.generate (/app/server/node_modules/openai/error.js:66:20) at OpenAI.makeStatusError (/app/server/node_modules/openai/core.js:263:33) at OpenAI.makeRequest (/app/server/node_modules/openai/core.js:306:30) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async LLMPerformanceMonitor.measureStream (/app/server/utils/helpers/chat/LLMPerformanceMonitor.js:67:20) at async GenericOpenAiLLM.streamGetChatCompletion (/app/server/utils/AiProviders/genericOpenAi/index.js:195:35) at async streamChatWithWorkspace (/app/server/utils/chats/stream.js:248:20) at async /app/server/endpoints/chat.js:62:9Doesn't matter if I use my workspace with imported documents, new workspace, or imported confluence I get the same issue for all of them.
The return to the front end looks like this:
data: {"id":"ab162f47-78e7-4383-8cd6-d70ab82d7917","type":"abort","textResponse":null,"sources":[],"close":true,"error":"500 true"}Are there known steps to reproduce?
No response
@timothycarambat commented on GitHub (May 2, 2025):
Well the 500 suddenly from this external server seems like that would be the issue. Did the external provider change their API request schema or anything since they may have applied some updates since then that could be causing this issue?
What is the external service you are connecting to? The most we can do is test the connector against known service endpoints and see if we can repro the error. Other than that you would need to check the service provider behind the endpoint set in AnythingLLM
@shatfield4 commented on GitHub (May 2, 2025):
I tested the generic OpenAI connector with many popular providers and was not able to repro the error. Please let us know what external provider you are connecting to so we can see if we can get this fixed.
@JayCroghan commented on GitHub (May 2, 2025):
It’s not an external provider it’s an in house LLM provider that works to
OpenAI standards. So you think the 500 is being returned from the OpenAI
provider and not something internet in AnythingLLM?
On Sat 3 May 2025 at 05:46, Sean Hatfield @.***> wrote:
@timothycarambat commented on GitHub (May 3, 2025):
@JayCroghan correct, since that provider has not been modified and we just tested it against the following URLs
localhost:11434/api-> local ollamalocalhost:1234/v1-> LMStudioapi.openai.comapi.groq.comopenrouter.ai/api/v1All of which worked as one would expect. So the issue is most likely with that in house provider - do you have any information on how that provider is running or is this totally something custom?
@JayCroghan commented on GitHub (May 3, 2025):
Totally custom but I will have them look at this thread for proof that the
error is coming from the provider. It’s supposedly OpenAI standard but
maybe they added things that break the contract.
Thanks
On Sat 3 May 2025 at 14:02, Timothy Carambat @.***>
wrote:
@timothycarambat commented on GitHub (May 3, 2025):
Please let me know if they have a response object or something we can debug against
@JayCroghan commented on GitHub (May 5, 2025):
Ok so the team building the OpenAI host are too busy to help for a few days but I have 1000s of pages in one workspace and 5gb of stuff in another we use for onboarding.
I've been trying pretty unsuccessfully to MITM the docker requests to the LLM server, do you know of any tricks for printing the response from inside the container?
I have experience using -it like before AnythingLLM did hosted Confluence I hacked the connector to change the header and imported my space so if there is any way you think I can output the contents of the response to somewhere I can access it in the meantime I would love to.
@JayCroghan commented on GitHub (May 5, 2025):
I went into the node_module for openai and added console.log even when debugging is off, here is what it returns, can you see what is the issue that means it thinks it is getting a 500???
@timothycarambat commented on GitHub (May 5, 2025):
As you can see, the chat object makes good sense, nothing very wrong I can see here. A 500 means "Internal Server Error" so that means something is wrong with the server running the inference - you would need logs from that to further debug. But at least you know exactly where the error is coming from now exactly & it is outside of AnythingLLM
@JayCroghan commented on GitHub (May 5, 2025):
This is exactly what I was expecting, thanks. I’ve asked that team to try
and debug and see exactly what is going wrong on their end.
Thank you.
On Tue 6 May 2025 at 00:06, Timothy Carambat @.***>
wrote:
[BUG]: Error: 500 true for all generic OpenAI callsto [GH-ISSUE #3754] [BUG]: Error: 500 true for all generic OpenAI calls