[PR #4384] [CLOSED] Microsoft Foundry Local LLM provider & agent provider #4602

Closed
opened 2026-02-22 18:36:09 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4384
Author: @shatfield4
Created: 9/15/2025
Status: Closed

Base: masterHead: microsoft-foundry-provider


📝 Commits (10+)

  • 723510e wip foundry local llm provider
  • 807a0ce wip foundry llm provider, dynamic model info
  • 5b436e9 fix get foundry models/simplify implementation
  • 62a0f0a simplify model parsing + update frontend fo smoother ux
  • 1a6d264 implement aibitat agent provider for foundry local
  • caae102 update docs, example env, onboarding + privacy for foundry provider
  • 655a465 make util for normalizing base path
  • ed964f1 Merge branch 'master' into microsoft-foundry-provider
  • e3ca68a Merge branch 'master' into microsoft-foundry-provider
  • 902e11a Merge branch 'master' into microsoft-foundry-provider

📊 Changes

22 files changed (+655 additions, -1 deletions)

View changed files

📝 README.md (+1 -0)
📝 docker/.env.example (+4 -0)
frontend/src/components/LLMSelection/FoundryOptions/index.jsx (+114 -0)
frontend/src/media/llmprovider/foundry-local.png (+0 -0)
📝 frontend/src/models/system.js (+17 -0)
📝 frontend/src/pages/GeneralSettings/LLMPreference/index.jsx (+10 -0)
📝 frontend/src/pages/OnboardingFlow/Steps/DataHandling/index.jsx (+8 -0)
📝 frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx (+9 -0)
📝 server/.env.example (+4 -0)
📝 server/models/systemSettings.js (+4 -0)
📝 server/package.json (+2 -1)
server/utils/AiProviders/foundry/index.js (+245 -0)
📝 server/utils/agents/aibitat/index.js (+2 -0)
📝 server/utils/agents/aibitat/providers/ai-provider.js (+11 -0)
server/utils/agents/aibitat/providers/foundry.js (+137 -0)
📝 server/utils/agents/aibitat/providers/index.js (+2 -0)
📝 server/utils/agents/index.js (+6 -0)
📝 server/utils/helpers/customModels.js (+45 -0)
📝 server/utils/helpers/index.js (+3 -0)
📝 server/utils/helpers/updateENV.js (+11 -0)

...and 2 more files

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #4383

What is in this change?

  • Adds support for Microsoft Foundry Local LLM provider and agent provider
  • Lists models by their aliases since Foundry automatically picks correct one under the hood
  • Sorts models by downloaded/not downloaded
  • Starts downloading model if is not downloaded and user tries chatting
  • Streams download progress to console for models being downloaded

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4384 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 9/15/2025 **Status:** ❌ Closed **Base:** `master` ← **Head:** `microsoft-foundry-provider` --- ### 📝 Commits (10+) - [`723510e`](https://github.com/Mintplex-Labs/anything-llm/commit/723510e7653b0aa6f8b50d6ee51ee12e8734a64a) wip foundry local llm provider - [`807a0ce`](https://github.com/Mintplex-Labs/anything-llm/commit/807a0ce78e85935d56980789b647b246b1a2892e) wip foundry llm provider, dynamic model info - [`5b436e9`](https://github.com/Mintplex-Labs/anything-llm/commit/5b436e924b7dde520911891dd49e1814d911b4b8) fix get foundry models/simplify implementation - [`62a0f0a`](https://github.com/Mintplex-Labs/anything-llm/commit/62a0f0a4feea5d011e401893391c22db76380c6b) simplify model parsing + update frontend fo smoother ux - [`1a6d264`](https://github.com/Mintplex-Labs/anything-llm/commit/1a6d26434f33afb90b8b9870886b8aecef38cc0f) implement aibitat agent provider for foundry local - [`caae102`](https://github.com/Mintplex-Labs/anything-llm/commit/caae102eb786858d719a837b7bd0da2d6f24c566) update docs, example env, onboarding + privacy for foundry provider - [`655a465`](https://github.com/Mintplex-Labs/anything-llm/commit/655a46591521e6a592c7684489a1bacd74a1b0da) make util for normalizing base path - [`ed964f1`](https://github.com/Mintplex-Labs/anything-llm/commit/ed964f1d21645735e23390c071e34c8cbdd2ce00) Merge branch 'master' into microsoft-foundry-provider - [`e3ca68a`](https://github.com/Mintplex-Labs/anything-llm/commit/e3ca68a3fe4f79e1eb8e95f93582af82ebb49910) Merge branch 'master' into microsoft-foundry-provider - [`902e11a`](https://github.com/Mintplex-Labs/anything-llm/commit/902e11a69a80be7b3362cf03f8fad9a173576f2e) Merge branch 'master' into microsoft-foundry-provider ### 📊 Changes **22 files changed** (+655 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -0) 📝 `docker/.env.example` (+4 -0) ➕ `frontend/src/components/LLMSelection/FoundryOptions/index.jsx` (+114 -0) ➕ `frontend/src/media/llmprovider/foundry-local.png` (+0 -0) 📝 `frontend/src/models/system.js` (+17 -0) 📝 `frontend/src/pages/GeneralSettings/LLMPreference/index.jsx` (+10 -0) 📝 `frontend/src/pages/OnboardingFlow/Steps/DataHandling/index.jsx` (+8 -0) 📝 `frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx` (+9 -0) 📝 `server/.env.example` (+4 -0) 📝 `server/models/systemSettings.js` (+4 -0) 📝 `server/package.json` (+2 -1) ➕ `server/utils/AiProviders/foundry/index.js` (+245 -0) 📝 `server/utils/agents/aibitat/index.js` (+2 -0) 📝 `server/utils/agents/aibitat/providers/ai-provider.js` (+11 -0) ➕ `server/utils/agents/aibitat/providers/foundry.js` (+137 -0) 📝 `server/utils/agents/aibitat/providers/index.js` (+2 -0) 📝 `server/utils/agents/index.js` (+6 -0) 📝 `server/utils/helpers/customModels.js` (+45 -0) 📝 `server/utils/helpers/index.js` (+3 -0) 📝 `server/utils/helpers/updateENV.js` (+11 -0) _...and 2 more files_ </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #4383 ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Adds support for Microsoft Foundry Local LLM provider and agent provider - Lists models by their aliases since Foundry automatically picks correct one under the hood - Sorts models by downloaded/not downloaded - Starts downloading model if is not downloaded and user tries chatting - Streams download progress to console for models being downloaded ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:09 -05:00
yindo closed this issue 2026-02-22 18:36:09 -05:00
yindo changed title from [PR #4384] Microsoft Foundry Local LLM provider & agent provider to [PR #4384] [CLOSED] Microsoft Foundry Local LLM provider & agent provider 2026-06-05 15:19:24 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4602