[GH-ISSUE #2592] [FEAT]: APIPie provider improvements #1680

Closed
opened 2026-02-22 18:26:01 -05:00 by yindo · 2 comments
Owner

Originally created by @timothycarambat on GitHub (Nov 6, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2592

Originally assigned to: @shatfield4 on GitHub.

What would you like to see?

Refer to https://github.com/Mintplex-Labs/anything-llm/issues/2464#issuecomment-2458680527 to end for more details or scope.

  1. Enable streaming on Apipie providers
  2. File chat model providers with the query param for chatx so we can reduce model selection for LLM Options.
  • Keep the full .cache of models, apply the post-filter after that request on the resulting file contents. We can reuse this cache for Embedding and Voice Support
  1. Investigate Voice and Embedder model support (filter appropriate models for each). If Embedding, TTS, or STT are viable break them into separate issues from this issue.
Originally created by @timothycarambat on GitHub (Nov 6, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2592 Originally assigned to: @shatfield4 on GitHub. ### What would you like to see? Refer to https://github.com/Mintplex-Labs/anything-llm/issues/2464#issuecomment-2458680527 to end for more details or scope. 1. Enable streaming on Apipie providers 2. File chat model providers with the query param for `chatx` so we can reduce model selection for LLM Options. - Keep the full .cache of models, apply the post-filter after that request on the resulting file contents. We can reuse this cache for Embedding and Voice Support 3. Investigate Voice and Embedder model support (filter appropriate models for each). If Embedding, TTS, or STT are viable break them into separate issues from this issue.
yindo added the enhancementIntegration Requestfeature request labels 2026-02-22 18:26:01 -05:00
yindo closed this issue 2026-02-22 18:26:01 -05:00
Author
Owner

@Toocky commented on GitHub (Nov 8, 2024):

@timothycarambat

Thanks for this would be amazing to see, one other feature that might be worth looking at is we also provide Pinecone Vector DBs for our users so if you are looking to implement TTS and Embedding it might also be worth looking at our Pinecone integration also.

Docs available here https://apipie.ai/docs/Features/Pinecone

@Toocky commented on GitHub (Nov 8, 2024): @timothycarambat Thanks for this would be amazing to see, one other feature that might be worth looking at is we also provide Pinecone Vector DBs for our users so if you are looking to implement TTS and Embedding it might also be worth looking at our Pinecone integration also. Docs available here https://apipie.ai/docs/Features/Pinecone
Author
Owner

@timothycarambat commented on GitHub (Nov 8, 2024):

We currently have a pinecone integration available for the user to use as their vectordb if they have an account, something like 97% of people never change from the default lancedb!

@timothycarambat commented on GitHub (Nov 8, 2024): We currently have a pinecone integration available for the user to use as their vectordb if they have an account, something like 97% of people never change from the default lancedb!
yindo changed title from [FEAT]: APIPie provider improvements to [GH-ISSUE #2592] [FEAT]: APIPie provider improvements 2026-06-05 14:42:06 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1680