Allow modifying the base url of Groq #7434

Closed
opened 2026-02-21 18:20:33 -05:00 by yindo · 2 comments
Owner

Originally created by @sideef5ect on GitHub (Dec 28, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

  • Dify allows users to add a Groq API token to use Groq-provided models.
  • The current implementation only allows setting the API token.
  • Some server environments hosting the Dify backend may have restrictions preventing direct access to the Groq API service.

Proposed Enhancement:

  1. Modify the Groq model provider configuration page to include an option for setting a custom API base URL, similar to the OpenAI configuration form.
  2. This addition will enable users to specify a proxy server for accessing Groq services when direct access is not possible due to network restrictions.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @sideef5ect on GitHub (Dec 28, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. - Dify allows users to add a Groq API token to use Groq-provided models. - The current implementation only allows setting the API token. - Some server environments hosting the Dify backend may have restrictions preventing direct access to the Groq API service. Proposed Enhancement: 1. Modify the Groq model provider configuration page to include an option for setting a custom API base URL, similar to the OpenAI configuration form. 2. This addition will enable users to specify a proxy server for accessing Groq services when direct access is not possible due to network restrictions. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:20:33 -05:00
yindo closed this issue 2026-02-21 18:20:33 -05:00
Author
Owner

@vilisper commented on GitHub (Jan 2, 2025):

Agreed, that would indeed make it more user-friendly. However, there are also workaround options, such as using the OpenAI API-compatible approach, which Groq also supports.

@vilisper commented on GitHub (Jan 2, 2025): Agreed, that would indeed make it more user-friendly. However, there are also workaround options, such as using the OpenAI API-compatible approach, which Groq also supports.
Author
Owner

@sideef5ect commented on GitHub (Jan 15, 2025):

Other model provider might also need this option
like google gemini, they also have region restriction
image

@sideef5ect commented on GitHub (Jan 15, 2025): Other model provider might also need this option like google gemini, they also have region restriction <img width="731" alt="image" src="https://github.com/user-attachments/assets/e2eadafb-a78e-4edf-ae96-e620f1740a0e" />
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#7434