[GH-ISSUE #2155] [FEAT]: AWS Bedrock temperature adjustment #1406

Closed
opened 2026-02-22 18:24:38 -05:00 by yindo · 2 comments
Owner

Originally created by @ytjhai on GitHub (Aug 20, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2155

What would you like to see?

I'm currently using the AWS Bedrock feature and it looks like bedrock supports adjusting the temperature through their API. It'd be helpful to have this in the settings since some models operate at different optimum temperatures than others (ex: Mistral large has a different "optimum" temperature than Llama 3.1)

Originally created by @ytjhai on GitHub (Aug 20, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2155 ### What would you like to see? I'm currently using the AWS Bedrock feature and it looks like bedrock supports adjusting the temperature through their API. It'd be helpful to have this in the settings since some models operate at different optimum temperatures than others (ex: Mistral large has a different "optimum" temperature than Llama 3.1)
yindo added the enhancementfeature request labels 2026-02-22 18:24:38 -05:00
yindo closed this issue 2026-02-22 18:24:38 -05:00
Author
Owner

@timothycarambat commented on GitHub (Aug 20, 2024):

We do support temperature!
https://github.com/Mintplex-Labs/anything-llm/blob/f7756d475812989ff3b78cd36b40250ed4539b3c/server/utils/AiProviders/bedrock/index.js#L179

You can set it per-workspace in the workspaces Chat Settings (scroll to bottom)
Screenshot 2024-08-20 at 2 08 33 PM

@timothycarambat commented on GitHub (Aug 20, 2024): We do support temperature! https://github.com/Mintplex-Labs/anything-llm/blob/f7756d475812989ff3b78cd36b40250ed4539b3c/server/utils/AiProviders/bedrock/index.js#L179 You can set it per-workspace in the workspaces `Chat Settings` (scroll to bottom) <img width="842" alt="Screenshot 2024-08-20 at 2 08 33 PM" src="https://github.com/user-attachments/assets/bb39289e-cac4-4f13-b261-973c02e93a14">
Author
Owner

@ytjhai commented on GitHub (Aug 20, 2024):

Ah I see it! Thanks for the quick response!

@ytjhai commented on GitHub (Aug 20, 2024): Ah I see it! Thanks for the quick response!
yindo changed title from [FEAT]: AWS Bedrock temperature adjustment to [GH-ISSUE #2155] [FEAT]: AWS Bedrock temperature adjustment 2026-06-05 14:40:35 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1406