Set the max output token limit to 16384 for gpt-4o-mini #4692

Closed
opened 2026-02-21 18:07:35 -05:00 by yindo · 0 comments
Owner

Originally created by @gijigae on GitHub (Jul 19, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

gpt-4o-mini can support upto 16384 tokens for its output. The current max_tokens, however, is set to 4096. To fully utilize gpt-4o-mini's potential, we should increase it to 16384.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @gijigae on GitHub (Jul 19, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. gpt-4o-mini can support upto 16384 tokens for its output. The current max_tokens, however, is set to 4096. To fully utilize gpt-4o-mini's potential, we should increase it to 16384. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:07:35 -05:00
yindo closed this issue 2026-02-21 18:07:35 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#4692