Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[PR #3017] [MERGED] Dynamic fetching of TogetherAI models #4198

New Issue
Closed
opened 2026-02-22 18:35:20 -05:00 by yindo · 0 comments
yindo commented 2026-02-22 18:35:20 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/3017
Author: @shatfield4
Created: 1/23/2025
Status: ✅ Merged
Merged: 1/24/2025
Merged by: @timothycarambat

Base: master ← Head: implement-together-ai-dynamic-models

📝 Commits (10+)

  • 7338f33 implement dynamic fetching of togetherai models
  • 41f1746 implement caching for togetherai models
  • 085cad9 update gitignore for togetherai model caching
  • 6321c7f Remove models.json from git tracking
  • 9c6973d Remove .cached_at from git tracking
  • da8f318 Merge branch 'master' into implement-together-ai-dynamic-models
  • 2f4e655 lint
  • 0cb9247 Merge branch 'master' into implement-together-ai-dynamic-models
  • 2df21ff revert unneeded change
  • 2b5c203 Merge branch 'implement-together-ai-dynamic-models' of github.com:Mintplex-Labs/anything-llm into implement-together-ai-dynamic-models

📊 Changes

8 files changed (+133 additions, -818 deletions)

View changed files

📝 frontend/src/components/LLMSelection/TogetherAiOptions/index.jsx (+29 -14)
📝 server/storage/models/.gitignore (+2 -1)
📝 server/utils/AiProviders/togetherAi/index.js (+86 -15)
➖ server/utils/AiProviders/togetherAi/models.js (+0 -622)
➖ server/utils/AiProviders/togetherAi/scripts/.gitignore (+0 -1)
➖ server/utils/AiProviders/togetherAi/scripts/chat_models.txt (+0 -108)
➖ server/utils/AiProviders/togetherAi/scripts/parse.mjs (+0 -43)
📝 server/utils/helpers/customModels.js (+16 -14)

📄 Description

Pull Request Type

  • ✨ feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #3016

What is in this change?

  • TogetherAI added the /models endpoint that we can now use to fetch models dynamically and no longer have to update them manually
  • Caches models to ensure that we do not fetch from the /models endpoint every time we send a chat

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/3017 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 1/23/2025 **Status:** ✅ Merged **Merged:** 1/24/2025 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `implement-together-ai-dynamic-models` --- ### 📝 Commits (10+) - [`7338f33`](https://github.com/Mintplex-Labs/anything-llm/commit/7338f33a9164b180bab1ae836f5fabca03b4c88a) implement dynamic fetching of togetherai models - [`41f1746`](https://github.com/Mintplex-Labs/anything-llm/commit/41f17468f2bd761161796220b3663a19b214df16) implement caching for togetherai models - [`085cad9`](https://github.com/Mintplex-Labs/anything-llm/commit/085cad9c682ab052882375c851403b5c7a2cb2d0) update gitignore for togetherai model caching - [`6321c7f`](https://github.com/Mintplex-Labs/anything-llm/commit/6321c7f127b08565dce702dff3521d73ecbc8bf3) Remove models.json from git tracking - [`9c6973d`](https://github.com/Mintplex-Labs/anything-llm/commit/9c6973d888d3deedd36a2494c982719bd51a6d31) Remove .cached_at from git tracking - [`da8f318`](https://github.com/Mintplex-Labs/anything-llm/commit/da8f31872a22721ed0a619911b7e3126f33383a5) Merge branch 'master' into implement-together-ai-dynamic-models - [`2f4e655`](https://github.com/Mintplex-Labs/anything-llm/commit/2f4e655e8110498f63486606167146664b03dfa4) lint - [`0cb9247`](https://github.com/Mintplex-Labs/anything-llm/commit/0cb9247079ea2dc8cd77e69328264587b6079f7b) Merge branch 'master' into implement-together-ai-dynamic-models - [`2df21ff`](https://github.com/Mintplex-Labs/anything-llm/commit/2df21ff30bf1be149fdc99b667b2617ad90058d0) revert unneeded change - [`2b5c203`](https://github.com/Mintplex-Labs/anything-llm/commit/2b5c20351893c4f248990dadc402854a7df30d3a) Merge branch 'implement-together-ai-dynamic-models' of github.com:Mintplex-Labs/anything-llm into implement-together-ai-dynamic-models ### 📊 Changes **8 files changed** (+133 additions, -818 deletions) <details> <summary>View changed files</summary> 📝 `frontend/src/components/LLMSelection/TogetherAiOptions/index.jsx` (+29 -14) 📝 `server/storage/models/.gitignore` (+2 -1) 📝 `server/utils/AiProviders/togetherAi/index.js` (+86 -15) ➖ `server/utils/AiProviders/togetherAi/models.js` (+0 -622) ➖ `server/utils/AiProviders/togetherAi/scripts/.gitignore` (+0 -1) ➖ `server/utils/AiProviders/togetherAi/scripts/chat_models.txt` (+0 -108) ➖ `server/utils/AiProviders/togetherAi/scripts/parse.mjs` (+0 -43) 📝 `server/utils/helpers/customModels.js` (+16 -14) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #3016 ### What is in this change? <!-- Describe the changes in this PR that are impactful to the repo. --> - TogetherAI added the `/models` endpoint that we can now use to fetch models dynamically and no longer have to update them manually - Caches models to ensure that we do not fetch from the `/models` endpoint every time we send a chat ### Additional Information <!-- Add any other context about the Pull Request here that was not captured above. --> ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:35:20 -05:00
yindo closed this issue 2026-02-22 18:35:20 -05:00
yindo changed title from [PR #3017] Dynamic fetching of TogetherAI models to [PR #3017] [MERGED] Dynamic fetching of TogetherAI models 2026-06-05 15:17:20 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4198
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?