[GH-ISSUE #3218] [BUG]: Failed to save LLM settings: Failed to fetch #2068

Closed
opened 2026-02-22 18:28:01 -05:00 by yindo · 7 comments
Owner

Originally created by @davini-dev on GitHub (Feb 14, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3218

How are you running AnythingLLM?

Docker (local)

What happened?

in the last update when trying to save the LLM it gives the error mentioned in the description...

Are there known steps to reproduce?

No response

Originally created by @davini-dev on GitHub (Feb 14, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3218 ### How are you running AnythingLLM? Docker (local) ### What happened? in the last update when trying to save the LLM it gives the error mentioned in the description... ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:28:01 -05:00
yindo closed this issue 2026-02-22 18:28:01 -05:00
Author
Owner

@timothycarambat commented on GitHub (Feb 14, 2025):

Check docker logs, this is not informative enough for me to advise in any particular way.
https://docs.anythingllm.com/installation-docker/local-docker for the right docker command

@timothycarambat commented on GitHub (Feb 14, 2025): Check docker logs, this is not informative enough for me to advise in any particular way. https://docs.anythingllm.com/installation-docker/local-docker for the right docker command
Author
Owner

@davini-dev commented on GitHub (Feb 15, 2025):

All migrations have been successfully applied.

┌─────────────────────────────────────────────────────────┐

│ Update available 5.3.1 -> 6.3.1 │

│ │

│ This is a major update - please follow the guide at │

https://pris.ly/d/major-version-upgrade

│ │

│ Run the following to update │

│ npm i --save-dev prisma@latest │

│ npm i @prisma/client@latest │

└─────────────────────────────────────────────────────────┘

[backend] info: [EncryptionManager] Self-assigning key & salt for encrypting arbitrary data.

[backend] info: [TokenManager] Initialized new TokenManager instance for model: gpt-3.5-turbo

[backend] info: [TokenManager] Returning existing instance for model: gpt-3.5-turbo

[backend] info: [TELEMETRY ENABLED] Anonymous Telemetry enabled. Telemetry helps Mintplex Labs Inc improve AnythingLLM.

[backend] info: prisma:info Starting a sqlite pool with 5 connections.

[backend] info: [TELEMETRY SENT] {"event":"server_boot","distinctId":"7ad912fe-9157-4e7f-9508-c249baa56fa8","properties":{"commit":"--","runtime":"docker"}}

[backend] info: [CommunicationKey] RSA key pair generated for signed payloads within AnythingLLM services.

[backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data.

[backend] info: Primary server in HTTP mode listening on port 3001

[backend] info: [BackgroundWorkerService] Feature is not enabled and will not be started.

[backend] info: [MetaGenerator] fetching custom meta tag settings...

[backend] error: Error: The OPENAI_API_KEY environment variable is missing or empty; either provide it, or instantiate the OpenAI client with an apiKey option, like new OpenAI({ apiKey: 'My API Key' }).

at new OpenAI (/app/server/node_modules/openai/index.js:53:19)

at openAiModels (/app/server/utils/helpers/customModels.js:84:18)

at getCustomModels (/app/server/utils/helpers/customModels.js:40:20)

at /app/server/endpoints/system.js:953:41

at Layer.handle [as handle_request] (/app/server/node_modules/express/lib/router/layer.js:95:5)

at next (/app/server/node_modules/express/lib/router/route.js:149:13)

at /app/server/utils/middleware/multiUserProtected.js:60:7

at Layer.handle [as handle_request] (/app/server/node_modules/express/lib/router/layer.js:95:5)

at next (/app/server/node_modules/express/lib/router/route.js:149:13)

at validatedRequest (/app/server/utils/middleware/validatedRequest.js:20:5)

[backend] info: EmbeddingEngine changed from undefined to native - resetting undefined namespaces

[backend] info: [Event Logged] - workspace_vectors_reset

[backend] info: Resetting anythingllm managed vector namespaces for

/usr/local/bin/docker-entrypoint.sh: line 7: 203 Illegal instruction (core dumped) node /app/server/index.js


yes...I followed the documentation above...but when trying to configure any LLM it gives me this error above

@davini-dev commented on GitHub (Feb 15, 2025): All migrations have been successfully applied. ┌─────────────────────────────────────────────────────────┐ │ Update available 5.3.1 -> 6.3.1 │ │ │ │ This is a major update - please follow the guide at │ │ https://pris.ly/d/major-version-upgrade │ │ │ │ Run the following to update │ │ npm i --save-dev prisma@latest │ │ npm i @prisma/client@latest │ └─────────────────────────────────────────────────────────┘ [backend] info: [EncryptionManager] Self-assigning key & salt for encrypting arbitrary data. [backend] info: [TokenManager] Initialized new TokenManager instance for model: gpt-3.5-turbo [backend] info: [TokenManager] Returning existing instance for model: gpt-3.5-turbo [backend] info: [TELEMETRY ENABLED] Anonymous Telemetry enabled. Telemetry helps Mintplex Labs Inc improve AnythingLLM. [backend] info: prisma:info Starting a sqlite pool with 5 connections. [backend] info: [TELEMETRY SENT] {"event":"server_boot","distinctId":"7ad912fe-9157-4e7f-9508-c249baa56fa8","properties":{"commit":"--","runtime":"docker"}} [backend] info: [CommunicationKey] RSA key pair generated for signed payloads within AnythingLLM services. [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [backend] info: Primary server in HTTP mode listening on port 3001 [backend] info: [BackgroundWorkerService] Feature is not enabled and will not be started. [backend] info: [MetaGenerator] fetching custom meta tag settings... [backend] error: Error: The OPENAI_API_KEY environment variable is missing or empty; either provide it, or instantiate the OpenAI client with an apiKey option, like new OpenAI({ apiKey: 'My API Key' }). at new OpenAI (/app/server/node_modules/openai/index.js:53:19) at openAiModels (/app/server/utils/helpers/customModels.js:84:18) at getCustomModels (/app/server/utils/helpers/customModels.js:40:20) at /app/server/endpoints/system.js:953:41 at Layer.handle [as handle_request] (/app/server/node_modules/express/lib/router/layer.js:95:5) at next (/app/server/node_modules/express/lib/router/route.js:149:13) at /app/server/utils/middleware/multiUserProtected.js:60:7 at Layer.handle [as handle_request] (/app/server/node_modules/express/lib/router/layer.js:95:5) at next (/app/server/node_modules/express/lib/router/route.js:149:13) at validatedRequest (/app/server/utils/middleware/validatedRequest.js:20:5) [backend] info: EmbeddingEngine changed from undefined to native - resetting undefined namespaces [backend] info: [Event Logged] - workspace_vectors_reset [backend] info: Resetting anythingllm managed vector namespaces for /usr/local/bin/docker-entrypoint.sh: line 7: 203 Illegal instruction (core dumped) node /app/server/index.js ------------------------------------ yes...I followed the documentation above...but when trying to configure any LLM it gives me this error above
Author
Owner

@flylan commented on GitHub (Mar 11, 2025):

same error

@flylan commented on GitHub (Mar 11, 2025): same error
Author
Owner

@davini-dev commented on GitHub (Mar 12, 2025):

I think it has to do with the environment or rights in some folder used by the system. I'm still trying to resolve it on some machines where it wasn't possible to install. What's your environment?

@davini-dev commented on GitHub (Mar 12, 2025): I think it has to do with the environment or rights in some folder used by the system. I'm still trying to resolve it on some machines where it wasn't possible to install. What's your environment?
Author
Owner

@timothycarambat commented on GitHub (Mar 13, 2025):

What CPU are you running? This issue has been posted thousands of times: https://github.com/Mintplex-Labs/anything-llm/issues?q=is%3Aissue%20state%3Aclosed%20Illegal%20instruction

It is almost always because people are using CPUs that are 10+yrs old that dont support AVX2

@timothycarambat commented on GitHub (Mar 13, 2025): What CPU are you running? This issue has been posted thousands of times: https://github.com/Mintplex-Labs/anything-llm/issues?q=is%3Aissue%20state%3Aclosed%20Illegal%20instruction It is almost always because people are using CPUs that are 10+yrs old that dont support AVX2
Author
Owner

@marev3 commented on GitHub (May 9, 2025):

It is almost always because people are using CPUs that are 10+yrs old that dont support AVX2

Is there any chance to bypass this?

@marev3 commented on GitHub (May 9, 2025): > It is almost always because people are using CPUs that are 10+yrs old that dont support AVX2 Is there any chance to bypass this?
Author
Owner

@timothycarambat commented on GitHub (May 9, 2025):

Yes, edit the .env file in the Docker storage folder mounted to the container and set the vector DB properties manually
https://github.com/Mintplex-Labs/anything-llm/blob/master/server/.env.example#L190-L228

We also have the lancedb_revert image but it is not maintained actively because of its on a super old version of lance that may or may not work

@timothycarambat commented on GitHub (May 9, 2025): Yes, edit the `.env` file in the Docker storage folder mounted to the container and set the vector DB properties manually https://github.com/Mintplex-Labs/anything-llm/blob/master/server/.env.example#L190-L228 We also have the lancedb_revert image but it is not maintained actively because of its on a super old version of lance that may or may not work
yindo changed title from [BUG]: Failed to save LLM settings: Failed to fetch to [GH-ISSUE #3218] [BUG]: Failed to save LLM settings: Failed to fetch 2026-06-05 14:44:22 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2068