langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-08-27 21:10:04 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Add option for custom API inference in embeddings model provider option . #6469

New Issue
Closed
opened 2026-02-21 18:15:53 -05:00 by yindo · 3 comments
yindo commented 2026-02-21 18:15:53 -05:00
Owner
Copy Link
Copy Source

Originally created by @ahsan123322 on GitHub (Oct 31, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Yes . I'm finding challenges , I want to use Arabic embedding model but all embedding model provider are either paid or not supporting sentence transformer architecture .

2. Additional context or comments

I wanted to host the model on my PC and use that API option in the embedding provider option as "Custom embedding model" . add server url there and model name and can easily hit then .

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @ahsan123322 on GitHub (Oct 31, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [ ] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [ ] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Yes . I'm finding challenges , I want to use Arabic embedding model but all embedding model provider are either paid or not supporting sentence transformer architecture . ### 2. Additional context or comments I wanted to host the model on my PC and use that API option in the embedding provider option as "Custom embedding model" . add server url there and model name and can easily hit then . ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:15:53 -05:00
yindo closed this issue 2026-02-21 18:15:53 -05:00
yindo commented 2026-02-21 18:15:53 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Oct 31, 2024):

Have you tried Ollama or Xinference?

@crazywoola commented on GitHub (Oct 31, 2024): Have you tried Ollama or Xinference?
yindo commented 2026-02-21 18:15:53 -05:00
Author
Owner
Copy Link
Copy Source

@ahsan123322 commented on GitHub (Oct 31, 2024):

Ollama have limited embedding models in their registry . and not supporting all sentence transformers architecture models yet (I'm trying to use arabic one which is not in their registry ) . didn't tried Xinference because no integration in Dify yet in model providers section .

@ahsan123322 commented on GitHub (Oct 31, 2024): Ollama have limited embedding models in their registry . and not supporting all sentence transformers architecture models yet (I'm trying to use arabic one which is not in their registry ) . didn't tried Xinference because no integration in Dify yet in model providers section .
yindo commented 2026-02-21 18:15:53 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Dec 1, 2024):

Hi, @ahsan123322. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • You requested a feature to use custom APIs for embedding models, focusing on Arabic models.
  • Suggested hosting the model locally with a custom option for server details.
  • @crazywoola recommended Ollama or Xinference; you noted limitations with both.
  • You expressed interest in contributing to the feature's development.

Next Steps

  • Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open.
  • Otherwise, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Dec 1, 2024): Hi, @ahsan123322. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary** - You requested a feature to use custom APIs for embedding models, focusing on Arabic models. - Suggested hosting the model locally with a custom option for server details. - @crazywoola recommended Ollama or Xinference; you noted limitations with both. - You expressed interest in contributing to the feature's development. **Next Steps** - Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open. - Otherwise, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6469
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?