Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[PR #4477] [CLOSED] Docker Model Runner LLM/Agent Provider #4639

New Issue
Closed
opened 2026-02-22 18:36:14 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:36:14 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/4477
Author: @shatfield4
Created: 10/2/2025
Status: ❌ Closed

Base: master ← Head: 4391-feat-integrate-docker-model-runner-as-a-local-inferencing-provide

📝 Commits (5)

  • e3949c7 docker model runner llm provider done/agent provider wip
  • 8e4bfe1 patch docker model runner agent provider + lint
  • 3b34f1a Merge branch 'master' into 4391-feat-integrate-docker-model-runner-as-a-local-inferencing-provide
  • 5c4dcda add docker model runner to onboarding llm selection
  • 4ac070c improve model picker options and endpoint parsing

📊 Changes

19 files changed (+613 additions, -0 deletions)

View changed files

📝 README.md (+1 -0)
📝 docker/.env.example (+5 -0)
➕ frontend/src/components/LLMSelection/DockerModelRunnerOptions/index.jsx (+152 -0)
➕ frontend/src/media/llmprovider/docker-model-runner.png (+0 -0)
📝 frontend/src/pages/GeneralSettings/LLMPreference/index.jsx (+14 -0)
📝 frontend/src/pages/OnboardingFlow/Steps/DataHandling/index.jsx (+8 -0)
📝 frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx (+9 -0)
📝 frontend/src/utils/constants.js (+8 -0)
📝 server/.env.example (+5 -0)
📝 server/models/systemSettings.js (+6 -0)
➕ server/utils/AiProviders/dockerModelRunner/index.js (+220 -0)
📝 server/utils/agents/aibitat/index.js (+2 -0)
📝 server/utils/agents/aibitat/providers/ai-provider.js (+8 -0)
➕ server/utils/agents/aibitat/providers/dockerModelRunner.js (+91 -0)
📝 server/utils/agents/aibitat/providers/index.js (+2 -0)
📝 server/utils/agents/index.js (+8 -0)
📝 server/utils/helpers/customModels.js (+47 -0)
📝 server/utils/helpers/index.js (+12 -0)
📝 server/utils/helpers/updateENV.js (+15 -0)

📄 Description

Pull Request Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #4391

What is in this change?

  • Add support for Docker Model Runner LLM provider
  • Auto URL detection for DMR LLM provider
  • Add support for Docker Model Runner agent provider (including agent streaming)

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/4477 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 10/2/2025 **Status:** ❌ Closed **Base:** `master` ← **Head:** `4391-feat-integrate-docker-model-runner-as-a-local-inferencing-provide` --- ### 📝 Commits (5) - [`e3949c7`](https://github.com/Mintplex-Labs/anything-llm/commit/e3949c7f5374c5e18f943e419740d7785d2b0e3e) docker model runner llm provider done/agent provider wip - [`8e4bfe1`](https://github.com/Mintplex-Labs/anything-llm/commit/8e4bfe1275764addfc9278ff46080f15c20431d2) patch docker model runner agent provider + lint - [`3b34f1a`](https://github.com/Mintplex-Labs/anything-llm/commit/3b34f1afa2252ac317c121f92e06a5bb9f29a197) Merge branch 'master' into 4391-feat-integrate-docker-model-runner-as-a-local-inferencing-provide - [`5c4dcda`](https://github.com/Mintplex-Labs/anything-llm/commit/5c4dcdaa2a9ffbeb70d0b689a8b7acd30de2dc6c) add docker model runner to onboarding llm selection - [`4ac070c`](https://github.com/Mintplex-Labs/anything-llm/commit/4ac070cbcf15e1cbf4d0658efbd701ca14b01c63) improve model picker options and endpoint parsing ### 📊 Changes **19 files changed** (+613 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -0) 📝 `docker/.env.example` (+5 -0) ➕ `frontend/src/components/LLMSelection/DockerModelRunnerOptions/index.jsx` (+152 -0) ➕ `frontend/src/media/llmprovider/docker-model-runner.png` (+0 -0) 📝 `frontend/src/pages/GeneralSettings/LLMPreference/index.jsx` (+14 -0) 📝 `frontend/src/pages/OnboardingFlow/Steps/DataHandling/index.jsx` (+8 -0) 📝 `frontend/src/pages/OnboardingFlow/Steps/LLMPreference/index.jsx` (+9 -0) 📝 `frontend/src/utils/constants.js` (+8 -0) 📝 `server/.env.example` (+5 -0) 📝 `server/models/systemSettings.js` (+6 -0) ➕ `server/utils/AiProviders/dockerModelRunner/index.js` (+220 -0) 📝 `server/utils/agents/aibitat/index.js` (+2 -0) 📝 `server/utils/agents/aibitat/providers/ai-provider.js` (+8 -0) ➕ `server/utils/agents/aibitat/providers/dockerModelRunner.js` (+91 -0) 📝 `server/utils/agents/aibitat/providers/index.js` (+2 -0) 📝 `server/utils/agents/index.js` (+8 -0) 📝 `server/utils/helpers/customModels.js` (+47 -0) 📝 `server/utils/helpers/index.js` (+12 -0) 📝 `server/utils/helpers/updateENV.js` (+15 -0) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #4391 ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Add support for Docker Model Runner LLM provider - Auto URL detection for DMR LLM provider - Add support for Docker Model Runner agent provider (including agent streaming) ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:36:14 -05:00
yindo closed this issue 2026-02-22 18:36:14 -05:00
yindo changed title from [PR #4477] Docker Model Runner LLM/Agent Provider to [PR #4477] [CLOSED] Docker Model Runner LLM/Agent Provider 2026-06-05 15:19:35 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4639
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?