langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-21 20:15:31 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Add Support for DeepInfra and gemma-2-27b-it Model #4673

New Issue
Closed
opened 2026-02-21 18:07:30 -05:00 by yindo · 4 comments
yindo commented 2026-02-21 18:07:30 -05:00
Owner
Copy Link
Copy Source

Originally created by @sevenjay on GitHub (Jul 18, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra.
All models return empty.
image

I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model.

Reasoning:
Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages.

Technical Details:
Model: gemma-2-27b-it
Platform: DeepInfra (https://deepinfra.com/google/gemma-2-27b-it/api)

I'd be happy to provide any additional information or assistance to help with this integration.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @sevenjay on GitHub (Jul 18, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra. All models return empty. ![image](https://github.com/user-attachments/assets/1bab09bc-700a-498c-9528-9209ca0f32a9) I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model. Reasoning: Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages. Technical Details: Model: gemma-2-27b-it Platform: DeepInfra (https://deepinfra.com/google/gemma-2-27b-it/api) I'd be happy to provide any additional information or assistance to help with this integration. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:07:30 -05:00
yindo closed this issue 2026-02-21 18:07:30 -05:00
yindo commented 2026-02-21 18:07:31 -05:00
Author
Owner
Copy Link
Copy Source

@sevenjay commented on GitHub (Jul 24, 2024):

DeepInfra supports Llama 3.1 70B in a good price.
please support DeepInfra, too.

@sevenjay commented on GitHub (Jul 24, 2024): DeepInfra supports Llama 3.1 70B in a good price. please support DeepInfra, too.
yindo commented 2026-02-21 18:07:31 -05:00
Author
Owner
Copy Link
Copy Source

@shinebarbhuiya commented on GitHub (Jul 30, 2024):

Please add support for DeepInfra

@shinebarbhuiya commented on GitHub (Jul 30, 2024): Please add support for DeepInfra
yindo commented 2026-02-21 18:07:31 -05:00
Author
Owner
Copy Link
Copy Source

@decentropy commented on GitHub (Dec 17, 2024):

Ditto... please add DeepInfra

Replicate costs more than DeepInfra and is 10x slower, with way fewer models.

@decentropy commented on GitHub (Dec 17, 2024): Ditto... please add DeepInfra Replicate costs more than DeepInfra and is 10x slower, with way fewer models.
yindo commented 2026-02-21 18:07:31 -05:00
Author
Owner
Copy Link
Copy Source

@srvo commented on GitHub (Feb 4, 2025):

ditto -- we <3 DeepInfra

@srvo commented on GitHub (Feb 4, 2025): ditto -- we <3 DeepInfra
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#4673
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?