ollama module extension model type request #6572

Closed
opened 2026-02-21 18:16:22 -05:00 by yindo · 2 comments
Owner

Originally created by @E218PQ on GitHub (Nov 5, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Yes, I hope I can fully localize the deployment of all models, including dify and related LLM/TTS/RAG/embedding models. Previously, it was quite complicated with ollama+xinference, but now it seems that ollama supports one click deployment of all gguf format models in huggingface, which will greatly reduce the threshold for model deployment and simplify the model deployment environment. I hope dify can expand the supported model types in the ollama module, such as TTS, RAG, etc

2. Additional context or comments

Request to extend the model types of the ollama module in dify, such as TTS, RAG, multimodal, etc

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @E218PQ on GitHub (Nov 5, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Yes, I hope I can fully localize the deployment of all models, including dify and related LLM/TTS/RAG/embedding models. Previously, it was quite complicated with ollama+xinference, but now it seems that ollama supports one click deployment of all gguf format models in huggingface, which will greatly reduce the threshold for model deployment and simplify the model deployment environment. I hope dify can expand the supported model types in the ollama module, such as TTS, RAG, etc ### 2. Additional context or comments Request to extend the model types of the ollama module in dify, such as TTS, RAG, multimodal, etc ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:16:22 -05:00
yindo closed this issue 2026-02-21 18:16:22 -05:00
Author
Owner

@liberalchang commented on GitHub (Nov 14, 2024):

+1

@liberalchang commented on GitHub (Nov 14, 2024): +1
Author
Owner

@dosubot[bot] commented on GitHub (Dec 15, 2024):

Hi, @E218PQ. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You requested the expansion of model types in the ollama module to include TTS, RAG, and multimodal models.
  • You mentioned the ease of deployment with gguf format models on Hugging Face.
  • User liberalchang supported this request with a "+1" comment.
  • The issue remains unresolved.

Next Steps:

  • Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Dec 15, 2024): Hi, @E218PQ. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You requested the expansion of model types in the ollama module to include TTS, RAG, and multimodal models. - You mentioned the ease of deployment with gguf format models on Hugging Face. - User liberalchang supported this request with a "+1" comment. - The issue remains unresolved. **Next Steps:** - Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here. - If there is no further activity, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6572