anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 02:05:26 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

I can not configure the limit for litellm #1831

New Issue
Closed
opened 2026-02-16 17:32:51 -05:00 by yindo · 4 comments
yindo commented 2026-02-16 17:32:51 -05:00
Owner
Copy Link
Copy Source

Originally created by @m-da-costa on GitHub (Sep 25, 2025).

Originally assigned to: @rekram1-node on GitHub.

Sorry if my question is a basic one but I cannot configure the context window (limits) for my litellm instance. Se examples:
config.json

    "litellm": {
      "npm": "@ai-sdk/openai-compatible",
      "options": {
        "baseURL": "https://my.domain.com/v1"
      },
      "models": {
        "cerebras/qwen-3-coder-480b": {
          "tools": true,
          "reasoning": true,
          "context_window": 120000,
          "limit": {
            "context": 120000,
            "output": 64000
          }
        },
      }
    }
Image
Originally created by @m-da-costa on GitHub (Sep 25, 2025). Originally assigned to: @rekram1-node on GitHub. Sorry if my question is a basic one but I cannot configure the context window (limits) for my litellm instance. Se examples: `config.json` ``` "litellm": { "npm": "@ai-sdk/openai-compatible", "options": { "baseURL": "https://my.domain.com/v1" }, "models": { "cerebras/qwen-3-coder-480b": { "tools": true, "reasoning": true, "context_window": 120000, "limit": { "context": 120000, "output": 64000 } }, } } ``` <img width="1048" height="912" alt="Image" src="https://github.com/user-attachments/assets/dc8d9283-621c-4618-9b5d-d5de1b04bf90" />
yindo closed this issue 2026-02-16 17:32:51 -05:00
yindo commented 2026-02-16 17:32:51 -05:00
Author
Owner
Copy Link
Copy Source

@github-actions[bot] commented on GitHub (Sep 25, 2025):

This issue might be a duplicate of existing issues. Please check:

  • #1551: Similar issue with Qwen 3 Coder 480b where context limits are not properly respected, causing "Please reduce the length of the messages or completion" errors
  • #1735: Reports that max_tokens defaults to 32000 when using custom providers with openai-compatible, and discusses how limit configuration in config.json should work as a workaround
  • #971: Model options are not forwarded for openai-compatible providers unless provider.name option is given, which may affect limit configurations

Feel free to ignore if none of these address your specific case.

@github-actions[bot] commented on GitHub (Sep 25, 2025): This issue might be a duplicate of existing issues. Please check: - #1551: Similar issue with Qwen 3 Coder 480b where context limits are not properly respected, causing "Please reduce the length of the messages or completion" errors - #1735: Reports that max_tokens defaults to 32000 when using custom providers with openai-compatible, and discusses how limit configuration in config.json should work as a workaround - #971: Model options are not forwarded for openai-compatible providers unless provider.name option is given, which may affect limit configurations Feel free to ignore if none of these address your specific case.
yindo commented 2026-02-16 17:32:51 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Sep 25, 2025):

@m-da-costa put:

includeUsage: true

in the provider options

ex:

 "litellm": {
      "npm": "@ai-sdk/openai-compatible",
      "options": {
        "baseURL": "https://my.domain.com/v1",
        "includeUsage": true
      },
      "models": {
        "cerebras/qwen-3-coder-480b": {
          "tools": true,
          "reasoning": true,
          "context_window": 120000,
          "limit": {
            "context": 120000,
            "output": 64000
          }
        },
      }
    }
@rekram1-node commented on GitHub (Sep 25, 2025): @m-da-costa put: includeUsage: true in the provider options ex: ``` "litellm": { "npm": "@ai-sdk/openai-compatible", "options": { "baseURL": "https://my.domain.com/v1", "includeUsage": true }, "models": { "cerebras/qwen-3-coder-480b": { "tools": true, "reasoning": true, "context_window": 120000, "limit": { "context": 120000, "output": 64000 } }, } } ```
yindo commented 2026-02-16 17:32:51 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Sep 25, 2025):

going forward we will set this automatically but until next release you should be able to follow waht I mentioned above^^

@rekram1-node commented on GitHub (Sep 25, 2025): going forward we will set this automatically but until next release you should be able to follow waht I mentioned above^^
yindo commented 2026-02-16 17:32:51 -05:00
Author
Owner
Copy Link
Copy Source

@m-da-costa commented on GitHub (Sep 26, 2025):

Ty so much @rekram1-node

@m-da-costa commented on GitHub (Sep 26, 2025): Ty so much @rekram1-node
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#1831
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?