[GH-ISSUE #5475] [BUG]: Generic OpenAI compatible model not in chat #5113

Closed
opened 2026-06-05 14:52:04 -04:00 by yindo · 3 comments
Owner

Originally created by @jagusztinl on GitHub (Apr 21, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5475

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I set up llama,cpp (generic OpenAI compatible model) but it is not visible in the dropdown list of chat window

Are there known steps to reproduce?

Set up a generic OpenAI model, then try to select it in chat

LLM Provider & Model (if applicable)

Generic OpenAI

Embedder Provider & Model (if applicable)

No response

Originally created by @jagusztinl on GitHub (Apr 21, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5475 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I set up llama,cpp (generic OpenAI compatible model) but it is not visible in the dropdown list of chat window <img src="https://github.com/user-attachments/assets/65c6d7c2-a086-48a5-b1b7-fe0d3bb8ea89" /> <img src="https://github.com/user-attachments/assets/a44e48ba-42b2-4eed-a1a5-04eb0891894f" /> ### Are there known steps to reproduce? Set up a generic OpenAI model, then try to select it in chat ### LLM Provider & Model (if applicable) Generic OpenAI ### Embedder Provider & Model (if applicable) _No response_
yindo added the possible bug label 2026-06-05 14:52:04 -04:00
yindo closed this issue 2026-06-05 14:52:04 -04:00
Author
Owner

@jagusztinl commented on GitHub (Apr 21, 2026):

No model to select, also Generic OpenAI model type not in the list

<!-- gh-comment-id:4289593107 --> @jagusztinl commented on GitHub (Apr 21, 2026): <img src="https://github.com/user-attachments/assets/006fb05c-40e3-4c68-82a4-04cd2e303f27" /> No model to select, also Generic OpenAI model type not in the list
Author
Owner

@timothycarambat commented on GitHub (Apr 21, 2026):

Not a bug. This is intentional, Generic does not show in the sidebar because it does not have a models endpoint support at this time.

<!-- gh-comment-id:4289789286 --> @timothycarambat commented on GitHub (Apr 21, 2026): Not a bug. This is intentional, Generic does not show in the sidebar because it does not have a models endpoint support at this time.
Author
Owner

@jagusztinl commented on GitHub (Apr 21, 2026):

Not a bug. This is intentional, Generic does not show in the sidebar because it does not have a models endpoint support at this time.

But how can I use it then? Unable to select it.

<!-- gh-comment-id:4290857154 --> @jagusztinl commented on GitHub (Apr 21, 2026): > Not a bug. This is intentional, Generic does not show in the sidebar because it does not have a models endpoint support at this time. But how can I use it then? Unable to select it.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5113