[GH-ISSUE #425] Cant use togetherAI api? #239

Closed
opened 2026-02-22 18:18:28 -05:00 by yindo · 7 comments
Owner

Originally created by @dillfrescott on GitHub (Dec 12, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/425

I tried setting it up but it refuses to inference with the model

https://docs.together.ai/reference/completions

Originally created by @dillfrescott on GitHub (Dec 12, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/425 I tried setting it up but it refuses to inference with the model https://docs.together.ai/reference/completions
yindo added the enhancementfeature request labels 2026-02-22 18:18:28 -05:00
yindo closed this issue 2026-02-22 18:18:29 -05:00
Author
Owner

@timothycarambat commented on GitHub (Dec 12, 2023):

We dont have a TogetherAI integration. How are you doing this in AnythingLLM?

@timothycarambat commented on GitHub (Dec 12, 2023): We dont have a TogetherAI integration. How are you doing this in AnythingLLM?
Author
Owner

@dillfrescott commented on GitHub (Dec 12, 2023):

Oh, just via a localai endpoint. I got it working with fireworks.ai and I think its an issue with togetherai. I joined their discord server and a team member is looking into it. He set up anythingLLM himself and is running some tests

@dillfrescott commented on GitHub (Dec 12, 2023): Oh, just via a localai endpoint. I got it working with fireworks.ai and I think its an issue with togetherai. I joined their discord server and a team member is looking into it. He set up anythingLLM himself and is running some tests
Author
Owner

@timothycarambat commented on GitHub (Dec 12, 2023):

Oh okay, well please let me know if you would like us to just integrate Together directly (the team member can also just contact us at team@mintplexlabs.com).

Could be done by EOW

@timothycarambat commented on GitHub (Dec 12, 2023): Oh okay, well please let me know if you would like us to just integrate Together directly (the team member can also just contact us at team@mintplexlabs.com). Could be done by EOW
Author
Owner

@dillfrescott commented on GitHub (Dec 12, 2023):

Oh thank you. You can add it if you think it would be beneficial but Its not exactly in high demand for me at the moment. I appreciate it though!

@dillfrescott commented on GitHub (Dec 12, 2023): Oh thank you. You can add it if you think it would be beneficial but Its not exactly in high demand for me at the moment. I appreciate it though!
Author
Owner

@timothycarambat commented on GitHub (Dec 14, 2023):

@dillfrescott checking in, did their team help you out or do we need to get this live for you? Happy to do it if it means you can use AnythingLLM with your Together AI models

@timothycarambat commented on GitHub (Dec 14, 2023): @dillfrescott checking in, did their team help you out or do we need to get this live for you? Happy to do it if it means you can use AnythingLLM with your Together AI models
Author
Owner

@dillfrescott commented on GitHub (Dec 15, 2023):

They actually added a model list that should help. I havent checked to see if it actually works though

@dillfrescott commented on GitHub (Dec 15, 2023): They actually added a model list that should help. I havent checked to see if it actually works though
Author
Owner

@timothycarambat commented on GitHub (Jan 4, 2024):

Moved to #531

@timothycarambat commented on GitHub (Jan 4, 2024): Moved to #531
yindo changed title from Cant use togetherAI api? to [GH-ISSUE #425] Cant use togetherAI api? 2026-06-05 14:34:13 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#239