[GH-ISSUE #2017] [BUG]: together.ai integration won't show Llama 3.1 and Gemma 2 series #1314

Closed
opened 2026-02-22 18:24:13 -05:00 by yindo · 1 comment
Owner

Originally created by @huydhoang on GitHub (Aug 1, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2017

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I'm on the AnythingLLM desktop app on Windows. Had my together.ai API key in place.
But somehow Llama 3.1 and Gemma 2 models won't show up in the list as stated in AnythingLLM docs.

Is there a quick fix in some local config files?

Screenshot 2024-08-01 191606

Are there known steps to reproduce?

  1. Install AnythingLLM
  2. Turn on together.ai integration
  3. Click on dropdown menu of available models
Originally created by @huydhoang on GitHub (Aug 1, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2017 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I'm on the AnythingLLM desktop app on Windows. Had my together.ai API key in place. But somehow Llama 3.1 and Gemma 2 models won't show up in the list as stated in AnythingLLM docs. Is there a quick fix in some local config files? ![Screenshot 2024-08-01 191606](https://github.com/user-attachments/assets/2b522b7d-9c6d-4476-8c6b-ccd44871724c) ### Are there known steps to reproduce? 1. Install AnythingLLM 2. Turn on together.ai integration 3. Click on dropdown menu of available models
yindo added the possible bug label 2026-02-22 18:24:13 -05:00
yindo closed this issue 2026-02-22 18:24:13 -05:00
Author
Owner

@timothycarambat commented on GitHub (Aug 1, 2024):

Already patched in master https://github.com/Mintplex-Labs/anything-llm/commit/466bf7dc9c3ffc0502cf3f63a53655d024cb2a9c

Will be in the next desktop app (v.1.6.0 live now). They do not support a /models endpoint so we have to statically grab the list and refresh is manually

@timothycarambat commented on GitHub (Aug 1, 2024): Already patched in `master` https://github.com/Mintplex-Labs/anything-llm/commit/466bf7dc9c3ffc0502cf3f63a53655d024cb2a9c Will be in the next desktop app (v.1.6.0 live now). They do not support a `/models` endpoint so we have to statically grab the list and refresh is manually
yindo changed title from [BUG]: together.ai integration won't show Llama 3.1 and Gemma 2 series to [GH-ISSUE #2017] [BUG]: together.ai integration won't show Llama 3.1 and Gemma 2 series 2026-06-05 14:40:05 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1314