[PR #1295] [MERGED] Agent support for LLMs with no function calling #3642

Closed
opened 2026-02-22 18:34:12 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/1295
Author: @shatfield4
Created: 5/6/2024
Status: Merged
Merged: 5/8/2024
Merged by: @timothycarambat

Base: masterHead: all-llm-agent-support


📝 Commits (10+)

  • bd8043c add LMStudio agent support (generic) support
  • 0976266 add comments
  • 6dfe161 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into 1241-lm-studio-agents
  • 7238f1b enable few-shot prompting per function for OSS models
  • 9e97cb3 Add Agent support for Ollama models
  • 2189d20 azure, groq, koboldcpp agent support complete + WIP togetherai
  • f4c58a1 WIP gemini agent support
  • e6638e4 WIP gemini blocked and will not fix for now
  • 6164e5b merge with master
  • 711b2c3 azure fix

📊 Changes

14 files changed (+645 additions, -8 deletions)

View changed files

📝 .vscode/settings.json (+1 -0)
📝 frontend/src/pages/WorkspaceSettings/AgentConfig/AgentLLMSelection/index.jsx (+19 -2)
📝 server/utils/agents/aibitat/index.js (+12 -2)
📝 server/utils/agents/aibitat/providers/ai-provider.js (+3 -0)
server/utils/agents/aibitat/providers/azure.js (+105 -0)
server/utils/agents/aibitat/providers/groq.js (+110 -0)
📝 server/utils/agents/aibitat/providers/helpers/untooled.js (+1 -2)
📝 server/utils/agents/aibitat/providers/index.js (+10 -0)
server/utils/agents/aibitat/providers/koboldcpp.js (+113 -0)
📝 server/utils/agents/aibitat/providers/lmstudio.js (+1 -1)
server/utils/agents/aibitat/providers/localai.js (+114 -0)
server/utils/agents/aibitat/providers/togetherai.js (+113 -0)
📝 server/utils/agents/index.js (+42 -0)
📝 server/utils/helpers/customModels.js (+1 -1)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

What is in this change?

  • Support for Azure OpenAI, Groq, KoboldCPP, and LocalAI agent support
  • getKoboldCPPModels function typo fix

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/1295 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 5/6/2024 **Status:** ✅ Merged **Merged:** 5/8/2024 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `all-llm-agent-support` --- ### 📝 Commits (10+) - [`bd8043c`](https://github.com/Mintplex-Labs/anything-llm/commit/bd8043cf827c76f015881035d85098eae41738ff) add LMStudio agent support (generic) support - [`0976266`](https://github.com/Mintplex-Labs/anything-llm/commit/0976266b428889e03eff9af83619a287180563b3) add comments - [`6dfe161`](https://github.com/Mintplex-Labs/anything-llm/commit/6dfe1616c947b2a433bd20790c495cf01f60594a) Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into 1241-lm-studio-agents - [`7238f1b`](https://github.com/Mintplex-Labs/anything-llm/commit/7238f1b07f5ca1ace3aca155ca0eac0298257857) enable few-shot prompting per function for OSS models - [`9e97cb3`](https://github.com/Mintplex-Labs/anything-llm/commit/9e97cb320d0f2e205335d68c2825fc5f91d32ccf) Add Agent support for Ollama models - [`2189d20`](https://github.com/Mintplex-Labs/anything-llm/commit/2189d20c40e44ed5d2798fd300c204898ae6015e) azure, groq, koboldcpp agent support complete + WIP togetherai - [`f4c58a1`](https://github.com/Mintplex-Labs/anything-llm/commit/f4c58a19e6a3e965468a7219460cacbffa525c88) WIP gemini agent support - [`e6638e4`](https://github.com/Mintplex-Labs/anything-llm/commit/e6638e4664e92cda64eea1cb617886d1f2cee8ae) WIP gemini blocked and will not fix for now - [`6164e5b`](https://github.com/Mintplex-Labs/anything-llm/commit/6164e5b5e76d6c8696e691eabcf6b693523c7bf8) merge with master - [`711b2c3`](https://github.com/Mintplex-Labs/anything-llm/commit/711b2c3f1afb462bf73f05851e98840102f4e776) azure fix ### 📊 Changes **14 files changed** (+645 additions, -8 deletions) <details> <summary>View changed files</summary> 📝 `.vscode/settings.json` (+1 -0) 📝 `frontend/src/pages/WorkspaceSettings/AgentConfig/AgentLLMSelection/index.jsx` (+19 -2) 📝 `server/utils/agents/aibitat/index.js` (+12 -2) 📝 `server/utils/agents/aibitat/providers/ai-provider.js` (+3 -0) ➕ `server/utils/agents/aibitat/providers/azure.js` (+105 -0) ➕ `server/utils/agents/aibitat/providers/groq.js` (+110 -0) 📝 `server/utils/agents/aibitat/providers/helpers/untooled.js` (+1 -2) 📝 `server/utils/agents/aibitat/providers/index.js` (+10 -0) ➕ `server/utils/agents/aibitat/providers/koboldcpp.js` (+113 -0) 📝 `server/utils/agents/aibitat/providers/lmstudio.js` (+1 -1) ➕ `server/utils/agents/aibitat/providers/localai.js` (+114 -0) ➕ `server/utils/agents/aibitat/providers/togetherai.js` (+113 -0) 📝 `server/utils/agents/index.js` (+42 -0) 📝 `server/utils/helpers/customModels.js` (+1 -1) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - Support for Azure OpenAI, Groq, KoboldCPP, and LocalAI agent support - getKoboldCPPModels function typo fix ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:34:12 -05:00
yindo closed this issue 2026-02-22 18:34:12 -05:00
yindo changed title from [PR #1295] Agent support for LLMs with no function calling to [PR #1295] [MERGED] Agent support for LLMs with no function calling 2026-06-05 15:14:28 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3642