[GH-ISSUE #358] LM Studio Embeddings Integration #207

Closed
opened 2026-02-22 18:18:20 -05:00 by yindo · 6 comments
Owner

Originally created by @timothycarambat on GitHub (Nov 10, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/358

@netandreus Responded with

Hello, @franzbischoff ! Thank you for quick reply. I try to use master branch at actual top commit (https://github.com/Mintplex-Labs/anything-llm/commit/6e72519cafbb603b7559e6c47e36836454e69576) but still don't see ability to use LocalAI for Embeddings. Only OpenAI and Azuer OpenAI are available. Can you please add it?

Screenshot 2023-11-10 at 10 35 49
Originally created by @timothycarambat on GitHub (Nov 10, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/358 @netandreus Responded with > Hello, @franzbischoff ! Thank you for quick reply. I try to use master branch at actual top commit (https://github.com/Mintplex-Labs/anything-llm/commit/6e72519cafbb603b7559e6c47e36836454e69576) but still don't see ability to use LocalAI for Embeddings. Only OpenAI and Azuer OpenAI are available. Can you please add it? > > <img width="666" alt="Screenshot 2023-11-10 at 10 35 49" src="https://github.com/Mintplex-Labs/anything-llm/assets/313477/7e5ae80a-7a5b-4abc-b817-b600078251a2">
yindo added the enhancementfeature request labels 2026-02-22 18:18:20 -05:00
yindo closed this issue 2026-02-22 18:18:21 -05:00
Author
Owner

@Amejonah1200 commented on GitHub (Nov 11, 2023):

Afaik LM Studio doesn't have an embeddings feature, it would be nice to just provide a different URL for the embeddings API, so you could just host your own.

@Amejonah1200 commented on GitHub (Nov 11, 2023): Afaik LM Studio *doesn't* have an embeddings feature, it would be nice to just provide a different URL for the embeddings API, so you could just host your own.
Author
Owner

@Amejonah1200 commented on GitHub (Nov 12, 2023):

However, other providers have APIs for it:
https://localai.io/howtos/easy-setup-embeddings/
https://github.com/jmorganca/ollama/blob/main/docs/api.md#generate-embeddings

@Amejonah1200 commented on GitHub (Nov 12, 2023): However, other providers have APIs for it: https://localai.io/howtos/easy-setup-embeddings/ https://github.com/jmorganca/ollama/blob/main/docs/api.md#generate-embeddings
Author
Owner

@timothycarambat commented on GitHub (Nov 12, 2023):

Yeah, so this issue is not relevent anymore than because it wont be as easy as just supporting that. We would indeed have to support Ollama or LocalAI.

Ollama was on the list anyway!

@timothycarambat commented on GitHub (Nov 12, 2023): Yeah, so this issue is not relevent anymore than because it wont be as easy as just supporting that. We would indeed have to support Ollama or LocalAI. Ollama was on the list anyway!
Author
Owner

@Amejonah1200 commented on GitHub (Nov 12, 2023):

You are already planning on making provision of different base URL for OpenAI, you could make the same thing for embeddings.

@Amejonah1200 commented on GitHub (Nov 12, 2023): You are already planning on making provision of different base URL for OpenAI, you could make the same thing for embeddings.
Author
Owner

@netandreus commented on GitHub (Nov 13, 2023):

Yeah, so this issue is not relevent anymore than because it wont be as easy as just supporting that. We would indeed have to support Ollama or LocalAI.

Ollama was on the list anyway!

LocalAI please 🙏

@netandreus commented on GitHub (Nov 13, 2023): > Yeah, so this issue is not relevent anymore than because it wont be as easy as just supporting that. We would indeed have to support Ollama or LocalAI. > > Ollama was on the list anyway! LocalAI please 🙏
Author
Owner

@timothycarambat commented on GitHub (Nov 14, 2023):

Resolved by #361

@timothycarambat commented on GitHub (Nov 14, 2023): Resolved by #361
yindo changed title from LM Studio Embeddings Integration to [GH-ISSUE #358] LM Studio Embeddings Integration 2026-06-05 14:34:03 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#207