[PR #5553] feat: add FuturMix as LLM provider #5482

Open
opened 2026-06-05 15:21:29 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/5553
Author: @FuturMix
Created: 4/28/2026
Status: 🔄 Open

Base: masterHead: feat/add-futurmix-provider


📝 Commits (1)

  • 6fd113a feat: add FuturMix AI Gateway as LLM provider

📊 Changes

15 files changed (+661 additions, -0 deletions)

View changed files

frontend/src/components/LLMSelection/FuturMixOptions/index.jsx (+99 -0)
📝 frontend/src/components/ProviderPrivacy/constants.js (+6 -0)
📝 frontend/src/hooks/useGetProvidersModels.js (+1 -0)
frontend/src/media/llmprovider/futurmix.png (+0 -0)
📝 frontend/src/pages/GeneralSettings/LLMPreference/index.jsx (+11 -0)
📝 frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx (+10 -0)
📝 server/endpoints/utils.js (+3 -0)
📝 server/models/systemSettings.js (+4 -0)
server/utils/AiProviders/futurmix/index.js (+380 -0)
📝 server/utils/agents/aibitat/providers/ai-provider.js (+8 -0)
server/utils/agents/aibitat/providers/futurmix.js (+100 -0)
📝 server/utils/agents/aibitat/providers/index.js (+2 -0)
📝 server/utils/helpers/customModels.js (+18 -0)
📝 server/utils/helpers/index.js (+8 -0)
📝 server/utils/helpers/updateENV.js (+11 -0)

📄 Description

Summary

Adds FuturMix as an OpenAI-compatible LLM provider option. FuturMix is a multi-model AI API hub providing access to 22+ AI models (Claude, GPT, Gemini, etc.) at (see futurmix.ai).

  • Server LLM class (server/utils/AiProviders/futurmix/) — OpenAI SDK with (see futurmix.ai), model caching, streaming support
  • Agent provider (server/utils/agents/aibitat/providers/futurmix.js) — Tool calling support via Provider + UnTooled
  • Frontend UI (frontend/src/components/LLMSelection/FuturMixOptions/) — API key input + dynamic model selector grouped by organization
  • Registration — All provider hooks (helpers, customModels, updateENV, systemSettings, endpoints, UI preferences, privacy constants, agent providers)

Environment Variables

  • FUTURMIX_API_KEY — API key from futurmix.ai
  • FUTURMIX_MODEL_PREF — Model preference (default: claude-sonnet-4-20250514)

Closes #5536

Test Plan

  • Provider appears in LLM provider selection (settings + onboarding)
  • API key input and validation works
  • Model list fetches dynamically from /v1/models
  • Chat completions work with streaming
  • Agent mode works with tool calling

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/5553 **Author:** [@FuturMix](https://github.com/FuturMix) **Created:** 4/28/2026 **Status:** 🔄 Open **Base:** `master` ← **Head:** `feat/add-futurmix-provider` --- ### 📝 Commits (1) - [`6fd113a`](https://github.com/Mintplex-Labs/anything-llm/commit/6fd113a023b6e5934c009bf371ba24c144266006) feat: add FuturMix AI Gateway as LLM provider ### 📊 Changes **15 files changed** (+661 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `frontend/src/components/LLMSelection/FuturMixOptions/index.jsx` (+99 -0) 📝 `frontend/src/components/ProviderPrivacy/constants.js` (+6 -0) 📝 `frontend/src/hooks/useGetProvidersModels.js` (+1 -0) ➕ `frontend/src/media/llmprovider/futurmix.png` (+0 -0) 📝 `frontend/src/pages/GeneralSettings/LLMPreference/index.jsx` (+11 -0) 📝 `frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx` (+10 -0) 📝 `server/endpoints/utils.js` (+3 -0) 📝 `server/models/systemSettings.js` (+4 -0) ➕ `server/utils/AiProviders/futurmix/index.js` (+380 -0) 📝 `server/utils/agents/aibitat/providers/ai-provider.js` (+8 -0) ➕ `server/utils/agents/aibitat/providers/futurmix.js` (+100 -0) 📝 `server/utils/agents/aibitat/providers/index.js` (+2 -0) 📝 `server/utils/helpers/customModels.js` (+18 -0) 📝 `server/utils/helpers/index.js` (+8 -0) 📝 `server/utils/helpers/updateENV.js` (+11 -0) </details> ### 📄 Description ## Summary Adds **FuturMix** as an OpenAI-compatible LLM provider option. FuturMix is a multi-model AI API hub providing access to 22+ AI models (Claude, GPT, Gemini, etc.) at (see [futurmix.ai](https://futurmix.ai)). - **Server LLM class** (`server/utils/AiProviders/futurmix/`) — OpenAI SDK with (see [futurmix.ai](https://futurmix.ai)), model caching, streaming support - **Agent provider** (`server/utils/agents/aibitat/providers/futurmix.js`) — Tool calling support via Provider + UnTooled - **Frontend UI** (`frontend/src/components/LLMSelection/FuturMixOptions/`) — API key input + dynamic model selector grouped by organization - **Registration** — All provider hooks (helpers, customModels, updateENV, systemSettings, endpoints, UI preferences, privacy constants, agent providers) ## Environment Variables - `FUTURMIX_API_KEY` — API key from [futurmix.ai](https://futurmix.ai) - `FUTURMIX_MODEL_PREF` — Model preference (default: `claude-sonnet-4-20250514`) Closes #5536 ## Test Plan - [ ] Provider appears in LLM provider selection (settings + onboarding) - [ ] API key input and validation works - [ ] Model list fetches dynamically from `/v1/models` - [ ] Chat completions work with streaming - [ ] Agent mode works with tool calling --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 15:21:29 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5482