[GH-ISSUE #486] Support Mlflow as LLM-Provider #277

Open
opened 2026-02-22 18:18:41 -05:00 by yindo · 3 comments
Owner

Originally created by @essamabas on GitHub (Dec 21, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/486

is it planned to support MlFlow as LLM-Provider ?

Originally created by @essamabas on GitHub (Dec 21, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/486 is it planned to support MlFlow as LLM-Provider ?
yindo added the Integration Requestfeature request labels 2026-02-22 18:18:41 -05:00
Author
Owner

@timothycarambat commented on GitHub (Dec 21, 2023):

At this time, no.

MLFlow is for training models as I understood. Do they provide a normalized API for running inferencing as well? You are the first request for MLFlow we have gotten, more support would prioritize this addition 👍

@timothycarambat commented on GitHub (Dec 21, 2023): At this time, no. MLFlow is for training models as I understood. Do they provide a normalized API for running inferencing as well? You are the first request for MLFlow we have gotten, more support would prioritize this addition 👍
Author
Owner

@essamabas commented on GitHub (Dec 21, 2023):

Yes, MLFlow is used or training/ evaluationg as well as serving Models.
It has unified APIs to return Models with their End-Points https://mlflow.org/docs/latest/llms/deployments/api.html#/

I can work on an extension and provide with pull request.

@essamabas commented on GitHub (Dec 21, 2023): Yes, MLFlow is used or training/ evaluationg as well as serving Models. It has unified APIs to return Models with their End-Points https://mlflow.org/docs/latest/llms/deployments/api.html#/ I can work on an extension and provide with pull request.
Author
Owner

@Jayasankar-kk commented on GitHub (May 13, 2024):

are there plans to add mlflow as an llm provider now

@Jayasankar-kk commented on GitHub (May 13, 2024): are there plans to add mlflow as an llm provider now
yindo changed title from Support Mlflow as LLM-Provider to [GH-ISSUE #486] Support Mlflow as LLM-Provider 2026-06-05 14:34:26 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#277