[GH-ISSUE #3659] [FEAT]: Update Token Limit Options for latest OpenAI models #2361

Closed
opened 2026-02-22 18:29:21 -05:00 by yindo · 0 comments
Owner

Originally created by @suzuki-shm on GitHub (Apr 16, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3659

What would you like to see?

Background

When configuring Azure OpenAI Service models, the model's Token Limit is intended to be selected from a predefined list of options.

Problem

Options corresponding to newer models, such as Reasoning models or GPT-4 Turbo, are missing from the selection list.
This prevents models with large context windows from utilizing their full capabilities.

Proposed Solution

  • Add the missing options to the list defined in anything-llm/frontend/src/components/LLMSelection/AzureAiOptions/index.jsx.
  • It may also be necessary to update the model context sizes defined in /anything-llm/server/utils/AiProviders/modelMap.js.

I plan to submit a Pull Request to address this issue later.

Originally created by @suzuki-shm on GitHub (Apr 16, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3659 ### What would you like to see? # Background When configuring Azure OpenAI Service models, the model's Token Limit is intended to be selected from a predefined list of options. # Problem Options corresponding to newer models, such as Reasoning models or GPT-4 Turbo, are missing from the selection list. This prevents models with large context windows from utilizing their full capabilities. # Proposed Solution - Add the missing options to the list defined in `anything-llm/frontend/src/components/LLMSelection/AzureAiOptions/index.jsx`. - It may also be necessary to update the model context sizes defined in `/anything-llm/server/utils/AiProviders/modelMap.js`. I plan to submit a Pull Request to address this issue later.
yindo added the enhancementfeature request labels 2026-02-22 18:29:21 -05:00
yindo closed this issue 2026-02-22 18:29:21 -05:00
yindo changed title from [FEAT]: Update Token Limit Options for latest OpenAI models to [GH-ISSUE #3659] [FEAT]: Update Token Limit Options for latest OpenAI models 2026-06-05 14:46:07 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2361