[PR #1888] [CLOSED] New Feature: Adding watsonx.ai LLM Platform support #3813

Closed
opened 2026-02-22 18:34:33 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/1888
Author: @ticlazau
Created: 7/18/2024
Status: Closed

Base: masterHead: master


📝 Commits (10+)

  • d77a098 Add files via upload
  • 817056c Create README.md
  • 8d4e748 Add files via upload
  • 445a543 Delete frontend/src/components/LLMSelection/WatsonXOptions/README.md
  • c3d65b5 Update index.jsx
  • fb9784d Create README.md
  • 1f442ae Add files via upload
  • e90aef0 Delete frontend/src/components/LLMSelection/WatsonXOptions directory
  • 53a5c6c Create README.md
  • 04ccf4a Add files via upload

📊 Changes

15 files changed (+976 additions, -14 deletions)

View changed files

📝 README.md (+2 -0)
📝 docker/.env.example (+11 -0)
📝 docker/Dockerfile (+1 -1)
frontend/src/components/LLMSelection/WatsonxOptions/index.jsx (+148 -0)
frontend/src/media/llmprovider/watsonx.png (+0 -0)
📝 frontend/src/pages/GeneralSettings/LLMPreference/index.jsx (+18 -0)
📝 package.json (+5 -2)
📝 server/.env.example (+9 -0)
📝 server/models/systemSettings.js (+9 -0)
📝 server/package.json (+1 -0)
server/utils/AiProviders/watsonx/README.md (+1 -0)
server/utils/AiProviders/watsonx/index.js (+352 -0)
📝 server/utils/helpers/index.js (+3 -0)
📝 server/utils/helpers/updateENV.js (+53 -0)
📝 server/yarn.lock (+363 -11)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

What is in this change?

Adding watsonx.ai support as LLM Platform

Additional Information

New LLM backend supporing various LLMs is added. Running watsonx.ai will require:

  • WATSONX_AI_ENDPOINT
  • WATSONX_AI_APIKEY
  • WATSONX_AI_PROJECT_ID
  • WATSONX_AI_MODEL (i.e meta-llama/llama-2-70b-chat)
  • WATSONX_EMBEDDING_MODEL_PREF (i.e. baai/bge-large-en-v1)
    In addition, we are intorducing AI Guardrails for input and LLM output

Developer Validations

  • [ x] I ran yarn lint from the root of the repo & committed changes
  • [ x] Relevant documentation has been updated
  • [ x] I have tested my code functionality
  • [x ] Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/1888 **Author:** [@ticlazau](https://github.com/ticlazau) **Created:** 7/18/2024 **Status:** ❌ Closed **Base:** `master` ← **Head:** `master` --- ### 📝 Commits (10+) - [`d77a098`](https://github.com/Mintplex-Labs/anything-llm/commit/d77a0983bf320b4e74e51fd462a8a22ebd6c3a1f) Add files via upload - [`817056c`](https://github.com/Mintplex-Labs/anything-llm/commit/817056c2da08bb321df34ffb6c607a271d88e7ed) Create README.md - [`8d4e748`](https://github.com/Mintplex-Labs/anything-llm/commit/8d4e748c4122b2637560559db90f3479b00db95c) Add files via upload - [`445a543`](https://github.com/Mintplex-Labs/anything-llm/commit/445a543ff6d8188d8edc5086247452de4db02f83) Delete frontend/src/components/LLMSelection/WatsonXOptions/README.md - [`c3d65b5`](https://github.com/Mintplex-Labs/anything-llm/commit/c3d65b5eb9a02317f11cb94dfacccfeebf552b4d) Update index.jsx - [`fb9784d`](https://github.com/Mintplex-Labs/anything-llm/commit/fb9784dac23425d57b7242ae9eb56817cf798003) Create README.md - [`1f442ae`](https://github.com/Mintplex-Labs/anything-llm/commit/1f442ae0d015cbb1b86a217ca5f404e4b27916d2) Add files via upload - [`e90aef0`](https://github.com/Mintplex-Labs/anything-llm/commit/e90aef087ec4822c1a910e5254d18127a52dc3b0) Delete frontend/src/components/LLMSelection/WatsonXOptions directory - [`53a5c6c`](https://github.com/Mintplex-Labs/anything-llm/commit/53a5c6c3347dbbaae1d944d028629fbc4575bd9b) Create README.md - [`04ccf4a`](https://github.com/Mintplex-Labs/anything-llm/commit/04ccf4a238b0bacacf089c096ee96deb7da54699) Add files via upload ### 📊 Changes **15 files changed** (+976 additions, -14 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+2 -0) 📝 `docker/.env.example` (+11 -0) 📝 `docker/Dockerfile` (+1 -1) ➕ `frontend/src/components/LLMSelection/WatsonxOptions/index.jsx` (+148 -0) ➕ `frontend/src/media/llmprovider/watsonx.png` (+0 -0) 📝 `frontend/src/pages/GeneralSettings/LLMPreference/index.jsx` (+18 -0) 📝 `package.json` (+5 -2) 📝 `server/.env.example` (+9 -0) 📝 `server/models/systemSettings.js` (+9 -0) 📝 `server/package.json` (+1 -0) ➕ `server/utils/AiProviders/watsonx/README.md` (+1 -0) ➕ `server/utils/AiProviders/watsonx/index.js` (+352 -0) 📝 `server/utils/helpers/index.js` (+3 -0) 📝 `server/utils/helpers/updateENV.js` (+53 -0) 📝 `server/yarn.lock` (+363 -11) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### What is in this change? Adding watsonx.ai support as LLM Platform ### Additional Information New LLM backend supporing various LLMs is added. Running watsonx.ai will require: - WATSONX_AI_ENDPOINT - WATSONX_AI_APIKEY - WATSONX_AI_PROJECT_ID - WATSONX_AI_MODEL (i.e meta-llama/llama-2-70b-chat) - WATSONX_EMBEDDING_MODEL_PREF (i.e. baai/bge-large-en-v1) In addition, we are intorducing AI Guardrails for input and LLM output ### Developer Validations <!-- All of the applicable items should be checked. --> - [ x] I ran `yarn lint` from the root of the repo & committed changes - [ x] Relevant documentation has been updated - [ x] I have tested my code functionality - [x ] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:34:33 -05:00
yindo closed this issue 2026-02-22 18:34:33 -05:00
yindo changed title from [PR #1888] New Feature: Adding watsonx.ai LLM Platform support to [PR #1888] [CLOSED] New Feature: Adding watsonx.ai LLM Platform support 2026-06-05 15:15:21 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3813