mirror of
https://github.com/Mintplex-Labs/anything-llm.git
synced 2026-07-19 14:13:35 -04:00
[GH-ISSUE #1586] [BUG]: Error after embedding document ""Could not respond to message" #1029
Closed
opened 2026-02-22 18:22:45 -05:00 by yindo
·
25 comments
No Branch/Tag Specified
master
5846-bug-when-scrolling-up-scrolling-jumps
refactor-remove-workspace-pfp
5969-bug-stopgenerationbutton-disappears-on-the-first-prompt-that-initiates-an-agent-session
2235-bug-how-to-upload-a-folder-with-subfolders-with-files-to-anythingllm
5990-workspace-update-fails-with-unknown-argument-router_id-v1130v1150-intel-mac
opencomputer-examples
pg
feat/image-generation-translations
feat/image-generation
5924-bug-meeting-summary-fails-with-sincludes-is-not-a-function-when-default-llm-is-anthropic-claude
render
feat/uniform-modal-component
5883-bug-unescaped-content-in-json-strings-being-passed-to-document-generator-tools
5901-bug-api-update-embeddings-fails-prisma-argument-filename-is-missing-on-workspace_documentscreate-desktop-windows-v1141
hybrid-search
1981-translations
5752-bug-prompts-to-local-jan-endpoint-unresponsive
feat-disable-native-tool-calling-env-var
5676-bug-non-ollama-agent-providers-do-not-parse-and-present-reasoning-content
feat/markdown-web-scraping
5717-bug-apiv1documentupload-silently-drops-metadata-field-in-desktop-1130-arg-count-mismatch-nested-payload-key
fix/aibitat-context-overflow
5711-bug-erratic-deepseek-v4-flash-the-agent-model-failed-to-respond-400-the-reasoning_content
5631-feat-custom-api-request-timeouts-for-ai-providers
feat-reasoning-control
feat-agent-clarifying-questions-translations
5583-bug-lm-studio-provider-does-not-present-reasoning-output
5313-normalize-translations
feat/memory-translations
5305-lemonade-embedding-engine-swallows-errors-falsely-reports-documents-as-embedded
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
pptx-subagent
feat-render-images-from-mcp-tool-results
stt-provider-expansion-openai-api-compatible
feat-file-search-agent-tool
feat-native-embedder-job-queue
5189-normalize-translations
feat-file-search-agent-tool-translations
i18n-eslint
5140-auto-migration
5112-bug-openrouter-failed-message-bug
3506-feat-parameters-for-openrouter-models
4992-feat-preserve-scroll-position
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.15.0
v1.14.2
v1.14.1
v1.14.0
v1.13.0
v1.12.1
v1.12.0
v1.11.2
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
question
stage: specifications
wontfix
Mirrored from GitHub Pull Request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: Mintplex-Labs/anything-llm#1029
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @LLMuser on GitHub (May 31, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1586
How are you running AnythingLLM?
AnythingLLM desktop app
What happened?
Everytime I upload and embed a document I get the error ""Could not respond to message. An error occurred while streaming response. network error"".
Doesn´t matter which model I use. Happens even with fresh installation. After error occurs the application is frozen. After restart same error occurs.
I use Windows Server 2022 with NVIDIA Quadro K6000
Are there known steps to reproduce?
Install AnythingLLM. Upload and embed document (PDF). Type any message.
@shatfield4 commented on GitHub (May 31, 2024):
If this is happening with every LLM model you are using to try and chat, it sounds like this is probably an issue with Windows Server firewall blocking the connection to whatever model you are using. You will need to investigate and see if your firewall settings are blocking you.
@LLMuser commented on GitHub (Jun 3, 2024):
Thanx @shatfield4 but firewall is disabled. Without embedding documents all models work fine. So IMHO it seems that is has to do with the embedding model.
If I choose another embedder (e.g. Ollama instead of AnyghingLLM) in the preferences it a) takes much longer to embed a document and b) I get a different error: "Could not respond to message. LanceDBError: No vector column found to create index".
@timothycarambat commented on GitHub (Jun 3, 2024):
That response would typically indicate that the embedder failed to embed the content. With the default embedder can you send a chat on a brand new workspace with no documents? That should have no embedder call required.
Next, I would open
C:\Users\user\AppData\Roaming\anythingllm-desktop\storageand see if there is a folder with files in it namedstorage\models\Xenova\and there should be a subfolder forall-miniLM-l6or something to the effect.@LLMuser commented on GitHub (Jun 4, 2024):
Thanks @timothycarambat!
If I set the default embedder and make a brand new chat with no documents, there is no error message.
This folder exists. But I don´t understand what it indicates or what do do with it. Should I delete it? It has not created along with the brand new workspace though.
Thanks again for your support and your efforts on AnythingLLM!
@timothycarambat commented on GitHub (Jun 4, 2024):
lets try deleting the
Xenovafolder and then try to re-embed a file on a fresh and empty workspace. Be sure to close and re-open app after deleting that folder. Please test a smaller text file just to limit variables in debugging. The embedder downloads on the first use so it does not bloat the app if unused. Its only 25MB so it should not take long, however if it still fails then there is a possibility the MSFT C++ Distributable might not be installed on your system - which is possible, but really unlikely but it has happened before.https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170#latest-microsoft-visual-c-redistributable-version
@LLMuser commented on GitHub (Jun 4, 2024):
Did that. Same error.
I had MS Visual C++ installed, reinstalled vc_redist.x64.exe though but error still occurs after deleting the "Xenova" and re-embedding in a fresh and empty workspace.
@LucBruz commented on GitHub (Jun 6, 2024):
Hey, i got the exact same error as LLMuser.
I don't get why the ticket have been closed since the error is still there
@timothycarambat commented on GitHub (Jun 6, 2024):
Because this is not a bug and is a client-side specific issue. If the issue was a bug 100% of users would be impacted and that is not the case - so now it is a support ticket in Github and we prematurely close them as it crowds the repo.
@AppliactionsZealZone commented on GitHub (Jun 11, 2024):
Hey, i got the exact same error as LLMuser.
I don't get why the ticket have been closed since the error is still there
meto~~
@AppliactionsZealZone commented on GitHub (Jun 11, 2024):
Maybe my windows system computer installed too many environment variables led to this problem, how to troubleshoot become a very egg pain problem
@timothycarambat commented on GitHub (Jun 12, 2024):
Closed because it cannot be replicated. If anyone is willing to get any good logs you can do so: https://docs.useanything.com/debug
@ojoaustral commented on GitHub (Aug 16, 2024):
Hi, I'm experiencing the same problem on an ASUS Vivobook with Snapdragon(R) X Elite - X1E78100 - Qualcomm(R) Oryon(TM) CPU, 3417 Mhz, 12 Core(s), 32GB RAM. Windows 11.
I have tried several different LLMs and the problem begins when saving and embedding a context document. I get the same error as described above and the software freezes.
@timothycarambat commented on GitHub (Aug 16, 2024):
@ojoaustral That is a brand-new machine so should not be an issue with AVX2 support on that CPU. The LLM has no impact on the upload/embedding section. I am assuming you have both the default vectorDB and Embedder model selected in ANythingLLM?
@ojoaustral commented on GitHub (Aug 16, 2024):
Hey, thanks!
I have LanceDB as the Vector DB, and AnythingLLM embedder. I don't see an
AnythingLMM vector database option.
C
On Fri, Aug 16, 2024 at 2:29 PM Timothy Carambat @.***>
wrote:
@FlashGorshkov commented on GitHub (Aug 17, 2024):
I have the same error. MacOS 14.6 (23G80) Sonoma. Llama 3.1 70B.
@ojoaustral commented on GitHub (Aug 19, 2024):
Hi Tim,
Yes, I have the default vectorDB (LanceDB) and Embedder (AnythingLLM). The
same problem also happens when I try scraping a webpage. I checked the
Windows firewall and AnythingLLM.exe is enabled. Do you have any idea what
is going on? What can I try now?
Best,
C
On Fri, Aug 16, 2024 at 2:29 PM Timothy Carambat @.***>
wrote:
@timothycarambat commented on GitHub (Aug 19, 2024):
Nothing useful from https://docs.useanything.com/debug?
@FlowDownTheRiver commented on GitHub (Sep 11, 2024):
windows 10 64 bit log.txt
Using desktop app. I did everything this page suggested. I have run the program in cmd and got this log. when using a file in workspace.
it shows :
Could not respond to message.
An error occurred while streaming response. network error
in web browser.
it force closes the program in cli,so the client no longer works. That is why nothing works after we try to use a file for the embedder.
and deleted this as well.
Something is force closing the program when an embedding is used.
my cpu is avx intel i7 3930k, 1080 ti (11 gb vram) ,latest nvidia driver.
windows 10 , 22h2 build 19045.3758.
@timothycarambat if you need me to do some more stuff,let me know..
@PascalLaube commented on GitHub (Sep 24, 2024):
For me the Error went away as I started Anything LLM with administrative rights.
@FlowDownTheRiver commented on GitHub (Sep 24, 2024):
Unfortunately it didn't help. However I have installed chromadb ,and hosted chroma server locally. then when I choose chroma inside anything llm and put the localhost ip address it worked. At least this way I can use RAG.
the downside is I have to start my chroma server outside of anything llm. So I made a bat file which call chroma server and anything llm.
example main bat file :
@echo off
rem First command
start cmd /c call "Run_chroma_server.bat"
rem Second command runs in a new cmd instance simultaneously
start cmd /c call "C:\Users\USERNAME\AppData\Local\Programs\AnythingLLM\AnythingLLM.exe"
and :
Run_chroma_server.bat :
chroma run --path my_database
here {my_database} is the folder where you store your vector. it can be any folder you create.
I have tested the internal lancedb option in a friend's pc vs chromadb .In comparison I found that chroma worked faster as speedwise.
you can try chromadb with : pip install chromadb
inside anything llm by default chroma db runs on this local host : http://localhost:8000 , fill that in and you are good to go.
I have written this in case anybody wants to test.
@FlowDownTheRiver commented on GitHub (Sep 24, 2024):
@timothycarambat Is there a way for windows client when chroma database is selected it shall install chromadb internally and start its server internally and locally ,so we don't have to depend on external installation of chroma and start it outside anything llm or can you pack chromadb for the installation(windows at least). Why ,cos it seems to work on even with avx supported gpus. This can end all the problems for old machines . Please :)
@timothycarambat commented on GitHub (Sep 24, 2024):
@FlowDownTheRiver I wish it was that simple. IIRC Chroma was going to explore embedded Chroma, but the AVX2 CPU support is really kind of helpful because AVX2 support has been around for over ten years! No doubt whatever we get up to in the future will benefit from running a somewhat modern machine.
For now, it will have to be external, its not as easy as installing chroma automatically and that's a lot of complexity to support machine that are frankly a bit out of scope for us
@FlowDownTheRiver commented on GitHub (Sep 24, 2024):
@timothycarambat Thank you for your time and explaining. This is a great project regardless. I can work with external server since it is at least working for my needs. Thanks for this amazing project to you,to the team and to contributers as well.
@yetkind commented on GitHub (Sep 27, 2024):
I have the same error
@timothycarambat commented on GitHub (Sep 27, 2024):
https://docs.anythingllm.com/fetch-failed-on-upload
[BUG]: Error after embedding document ""Could not respond to message"to [GH-ISSUE #1586] [BUG]: Error after embedding document ""Could not respond to message"