langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 12:36:14 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

AWS sagemaker LLM support #931

New Issue
Closed
opened 2026-02-21 17:29:06 -05:00 by yindo · 4 comments
yindo commented 2026-02-21 17:29:06 -05:00
Owner
Copy Link
Copy Source

Originally created by @benjamin-code on GitHub (Jan 19, 2024).

Self Checks

1. Is this request related to a challenge you're experiencing?

We have some open source llm and embedded model running in AWS sagemaker.How can I access these models in dify?

2. Describe the feature you'd like to see

Access models running in AWS sagemaker

3. How will this feature improve your workflow or experience?

Sagemaker is enterprise LLM platform in our global company

4. Additional context or comments

No response

5. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @benjamin-code on GitHub (Jan 19, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to file this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). ### 1. Is this request related to a challenge you're experiencing? We have some open source llm and embedded model running in AWS sagemaker.How can I access these models in dify? ### 2. Describe the feature you'd like to see Access models running in AWS sagemaker ### 3. How will this feature improve your workflow or experience? Sagemaker is enterprise LLM platform in our global company ### 4. Additional context or comments _No response_ ### 5. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 17:29:06 -05:00
yindo closed this issue 2026-02-21 17:29:06 -05:00
yindo commented 2026-02-21 17:29:06 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Jan 19, 2024):

🤖

Hello again, @benjamin-code! It's great to have you back contributing your ideas. Hope you're doing well!

Based on the information available in the dify repository, it appears that dify does have the capability to integrate with external LLM platforms. This is evidenced by the existing integrations with OpenAI's GPT-3.5, GPT-4, and text-davinci-003 models, as seen in the api/core/model_runtime/model_providers/openai/llm/_position.yaml file.

However, there is no explicit mention or evidence of support for AWS Sagemaker in the current version (v0.4.8) of dify. This doesn't necessarily mean that it's not possible, but it may require additional work or customization on your part.

Since you've expressed interest in contributing to this feature, I would recommend starting by examining the existing integrations with OpenAI in the aforementioned YAML file. This could provide a useful starting point for understanding how dify interacts with external LLM platforms.

If you need further assistance or have more specific questions about how to implement this, please provide more details and I'll do my best to help.

Sources

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

@dosubot[bot] commented on GitHub (Jan 19, 2024): _🤖_ <!-- Greeting --> Hello again, @benjamin-code! It's great to have you back contributing your ideas. Hope you're doing well! <!-- Answer --> Based on the information available in the dify repository, it appears that dify does have the capability to integrate with external LLM platforms. This is evidenced by the existing integrations with OpenAI's GPT-3.5, GPT-4, and text-davinci-003 models, as seen in the [api/core/model_runtime/model_providers/openai/llm/_position.yaml](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/openai/llm/_position.yaml) file. However, there is no explicit mention or evidence of support for AWS Sagemaker in the current version (v0.4.8) of dify. This doesn't necessarily mean that it's not possible, but it may require additional work or customization on your part. Since you've expressed interest in contributing to this feature, I would recommend starting by examining the existing integrations with OpenAI in the aforementioned YAML file. This could provide a useful starting point for understanding how dify interacts with external LLM platforms. If you need further assistance or have more specific questions about how to implement this, please provide more details and I'll do my best to help. ## Sources - [api/core/model_runtime/model_providers/openai/llm/_position.yaml](https://github.com/langgenius/dify/blob/main/api/core/model_runtime/model_providers/openai/llm/_position.yaml) --- This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant. If you want to continue the conversation, start your reply with @dosu-bot.
yindo commented 2026-02-21 17:29:06 -05:00
Author
Owner
Copy Link
Copy Source

@takatost commented on GitHub (Jan 20, 2024):

Thx a lot for your interest in contributing to Dify! 😁👍 You can check out the following docs on how to integrate a new model provider:
https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md
https://github.com/langgenius/dify/blob/main/api/core/model_runtime/README.md

@takatost commented on GitHub (Jan 20, 2024): Thx a lot for your interest in contributing to Dify! 😁👍 You can check out the following docs on how to integrate a new model provider: https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md https://github.com/langgenius/dify/blob/main/api/core/model_runtime/README.md
yindo commented 2026-02-21 17:29:06 -05:00
Author
Owner
Copy Link
Copy Source

@canny[bot] commented on GitHub (Jan 28, 2024):

This issue has been linked to a Canny post: AWS Sagemaker 🎉

@canny[bot] commented on GitHub (Jan 28, 2024): This issue has been linked to a Canny post: [AWS Sagemaker](https://dify.canny.io/admin/board/model-additions/p/aws-sagemaker) :tada:
yindo commented 2026-02-21 17:29:06 -05:00
Author
Owner
Copy Link
Copy Source

@github-actions[bot] commented on GitHub (Feb 12, 2024):

Close due to it's no longer active, if you have any questions, you can reopen it.

@github-actions[bot] commented on GitHub (Feb 12, 2024): Close due to it's no longer active, if you have any questions, you can reopen it.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#931
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?