Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #4691] [BUG]: #2973

New Issue
Closed
opened 2026-02-22 18:32:05 -05:00 by yindo · 4 comments
yindo commented 2026-02-22 18:32:05 -05:00
Owner
Copy Link
Copy Source

Originally created by @MohamedAmineB on GitHub (Nov 26, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4691

Originally assigned to: @shatfield4 on GitHub.

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Litellm chat model selection list always empty
Works good with Bruno desktop (postman like) :
Image

anything-llm desktop v1.9.0, same PC (same network setup), url set to the root (https://preprod.myLiteLlmSaaS.com/) :
Image

When adding .../v1 to base URL :
Image

Error in chat :
Image

Thx

Are there known steps to reproduce?

No response

Originally created by @MohamedAmineB on GitHub (Nov 26, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4691 Originally assigned to: @shatfield4 on GitHub. ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Litellm chat model selection list always empty Works good with Bruno desktop (postman like) : <img width="724" height="459" alt="Image" src="https://github.com/user-attachments/assets/73d8eb2b-6272-43fe-92be-79231f012969" /> anything-llm desktop v1.9.0, same PC (same network setup), url set to the root (https://preprod.myLiteLlmSaaS.com/) : <img width="460" height="323" alt="Image" src="https://github.com/user-attachments/assets/903d386e-3c13-4c68-96a1-c3d663a72415" /> When adding .../v1 to base URL : <img width="477" height="406" alt="Image" src="https://github.com/user-attachments/assets/1523c078-4ee3-49e9-859d-0a2cde956af3" /> Error in chat : <img width="1084" height="840" alt="Image" src="https://github.com/user-attachments/assets/396b1f48-f69e-4c60-a554-19055bc7db67" /> Thx ### Are there known steps to reproduce? _No response_
yindo added the needs info / can't replicateinvestigating labels 2026-02-22 18:32:05 -05:00
yindo closed this issue 2026-02-22 18:32:05 -05:00
yindo commented 2026-02-22 18:32:06 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Nov 27, 2025):

The likely issue here is we expect the URL to confrom to the OpenAI specification which means the correct URL for models according to AnythingLLM should be https://yourdomain.com/v1/models not https://yourdomain.com/models

https://github.com/Mintplex-Labs/anything-llm/blob/155900eae7b487732de78283587fa0f9a3aef58b/server/utils/helpers/customModels.js#L306-L310

That is the core of the issue for why /models is not resolving

@timothycarambat commented on GitHub (Nov 27, 2025): The likely issue here is we expect the URL to confrom to the OpenAI specification which means the correct URL for models according to AnythingLLM should be `https://yourdomain.com/v1/models` not `https://yourdomain.com/models` https://github.com/Mintplex-Labs/anything-llm/blob/155900eae7b487732de78283587fa0f9a3aef58b/server/utils/helpers/customModels.js#L306-L310 That is the core of the issue for why `/models` is not resolving
yindo commented 2026-02-22 18:32:06 -05:00
Author
Owner
Copy Link
Copy Source

@MohamedAmineB commented on GitHub (Nov 27, 2025):

don't work with .../v1 (or .../v1/models) :

Image Image

"-- loading available models --" is unclickable.

FYI :
Image

and, using system default for workspace LLM provider or using LiteLLM :

Image
@MohamedAmineB commented on GitHub (Nov 27, 2025): don't work with .../v1 (or .../v1/models) : <img width="331" height="157" alt="Image" src="https://github.com/user-attachments/assets/ddcfd91d-4576-40c2-a1ef-c9e590d039e9" /> <img width="374" height="208" alt="Image" src="https://github.com/user-attachments/assets/33fd573c-4d33-459e-8d3e-df73507333dd" /> "-- loading available models --" is unclickable. FYI : <img width="645" height="348" alt="Image" src="https://github.com/user-attachments/assets/6a3aa431-2a06-4f38-8d1b-9245fee5e409" /> and, using system default for workspace LLM provider or using LiteLLM : <img width="499" height="158" alt="Image" src="https://github.com/user-attachments/assets/e3ad869e-82f8-4954-ac84-3560f6cb33c7" />
yindo commented 2026-02-22 18:32:06 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 2, 2025):

I just deployed LiteLLM on Railway and was able to connect fine. That being said, it looks like your LiteLLM instance is set up properly with an API key and database URL. We certainly pass those onto our request to the proxy service.

LiteLLM supports both /models and /v1/models so just putting in https://preprod.mylitellmsaas.com/v1 should be all that is needed to resolve models

@timothycarambat commented on GitHub (Dec 2, 2025): I just deployed LiteLLM on Railway and was able to connect fine. That being said, it looks like your LiteLLM instance is set up properly with an API key and database URL. We certainly pass those onto our request to the proxy service. LiteLLM supports both `/models` and `/v1/models` so just putting in `https://preprod.mylitellmsaas.com/v1` should be all that is needed to resolve models
yindo commented 2026-02-22 18:32:06 -05:00
Author
Owner
Copy Link
Copy Source

@Ne0nd0g commented on GitHub (Dec 24, 2025):

See #4808 ; If I set the NODE_EXTRA_CA_CERTS environment variable to my internal certificate authority then everything worked.

@Ne0nd0g commented on GitHub (Dec 24, 2025): See #4808 ; If I set the `NODE_EXTRA_CA_CERTS` environment variable to my internal certificate authority then everything worked.
yindo changed title from [BUG]: to [GH-ISSUE #4691] [BUG]: 2026-06-05 14:49:35 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label investigating needs info / can't replicate
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2973
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?