[GH-ISSUE #679] [FEAT]: HuggingFace LLM Inference Endpoint support #388

Closed
opened 2026-02-22 18:19:16 -05:00 by yindo · 0 comments
Owner

Originally created by @timothycarambat on GitHub (Feb 6, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/679

Originally assigned to: @timothycarambat on GitHub.

What would you like to see?

Add support for the 150,000 models found on HuggingFace that are available for inferencing and text/conversation generation.

https://huggingface.co/docs/text-generation-inference/messages_api#streaming

Originally created by @timothycarambat on GitHub (Feb 6, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/679 Originally assigned to: @timothycarambat on GitHub. ### What would you like to see? Add support for the 150,000 models found on HuggingFace that are available for inferencing and text/conversation generation. https://huggingface.co/docs/text-generation-inference/messages_api#streaming
yindo added the enhancementfeature request labels 2026-02-22 18:19:16 -05:00
yindo closed this issue 2026-02-22 18:19:16 -05:00
yindo changed title from [FEAT]: HuggingFace LLM Inference Endpoint support to [GH-ISSUE #679] [FEAT]: HuggingFace LLM Inference Endpoint support 2026-06-05 14:35:03 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#388