langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-21 17:45:23 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

adding rate limits for emeddings models on github models when using openai API compatible plugin #631

New Issue
Closed
opened 2026-02-16 10:19:59 -05:00 by yindo · 4 comments
yindo commented 2026-02-16 10:19:59 -05:00
Owner
Copy Link
Copy Source

Originally created by @remisharrock on GitHub (Sep 9, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

When I add a knowledge using github models as an openai api compatible , I hit the limits of the embeddings and get this error:
[models] Bad Request Error, 429 Client Error: Too Many Requests for url: https://models.github.ai/inference/embeddings

as explained here https://docs.github.com/en/github-models/use-github-models/prototyping-with-ai-models#rate-limits , these are the actual limits (I have the copilot enterprise):

Embedding Requests per minute 20
Requests per day 450
Tokens per request 64000
Concurrent requests 8

How can I deal with those limits ? Any way to configure the plugin or the model so that I don't hit the limits ?

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @remisharrock on GitHub (Sep 9, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. When I add a knowledge using github models as an openai api compatible , I hit the limits of the embeddings and get this error: [models] Bad Request Error, 429 Client Error: Too Many Requests for url: https://models.github.ai/inference/embeddings as explained here https://docs.github.com/en/github-models/use-github-models/prototyping-with-ai-models#rate-limits , these are the actual limits (I have the copilot enterprise): Embedding Requests per minute 20 Requests per day 450 Tokens per request 64000 Concurrent requests 8 How can I deal with those limits ? Any way to configure the plugin or the model so that I don't hit the limits ? ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [x] I am interested in contributing to this feature.
yindo added the enhancementquestion labels 2026-02-16 10:19:59 -05:00
yindo closed this issue 2026-02-16 10:19:59 -05:00
yindo commented 2026-02-16 10:19:59 -05:00
Author
Owner
Copy Link
Copy Source

@remisharrock commented on GitHub (Sep 9, 2025):

could it be related to https://github.com/langgenius/dify-official-plugins/pull/433 ?

@remisharrock commented on GitHub (Sep 9, 2025): could it be related to https://github.com/langgenius/dify-official-plugins/pull/433 ?
yindo commented 2026-02-16 10:19:59 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Sep 25, 2025):

Hi, @remisharrock. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported encountering 429 rate limit errors when using GitHub models for embeddings via the OpenAI API compatible plugin.
  • The issue appears related to strict request limits and you inquired about possible configurations to handle or avoid these limits.
  • You also mentioned a potential connection to a recent pull request (#433) in the repository.
  • No further updates or maintainer responses have been provided since your last comment.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I don’t hear back from you within 5 days, this issue will be automatically closed.

Thanks for your understanding and contribution!

@dosubot[bot] commented on GitHub (Sep 25, 2025): Hi, @remisharrock. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported encountering 429 rate limit errors when using GitHub models for embeddings via the OpenAI API compatible plugin. - The issue appears related to strict request limits and you inquired about possible configurations to handle or avoid these limits. - You also mentioned a potential connection to a recent pull request (#433) in the repository. - No further updates or maintainer responses have been provided since your last comment. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I don’t hear back from you within 5 days, this issue will be automatically closed. Thanks for your understanding and contribution!
yindo commented 2026-02-16 10:19:59 -05:00
Author
Owner
Copy Link
Copy Source

@remisharrock commented on GitHub (Sep 25, 2025):

Yes still relevant

@remisharrock commented on GitHub (Sep 25, 2025): Yes still relevant
yindo commented 2026-02-16 10:19:59 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Sep 25, 2025):

@crazywoola The user has confirmed that the issue with 429 rate limit errors when using GitHub models for embeddings via the OpenAI API compatible plugin is still relevant. Could you please assist with this?

@dosubot[bot] commented on GitHub (Sep 25, 2025): @crazywoola The user has confirmed that the issue with 429 rate limit errors when using GitHub models for embeddings via the OpenAI API compatible plugin is still relevant. Could you please assist with this?
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label enhancement question
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#631
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?