Failed to add embedding models in LocalAI to dify #2966

Closed
opened 2026-02-21 17:52:09 -05:00 by yindo · 0 comments
Owner

Originally created by @banianzr on GitHub (May 6, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a quesion, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • Pleas do not modify this template :) and fill in all the required fields.

Dify version

0.6.5

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

  1. I downloaded models and configure as Doc: Deploying LocalAI mentioned. However, when I tried to configure the embedding models in dify, I encounter problems as below:
  2. when I used curl, I can get response from the LocalAI docker (I did not run store.py provided by localAI example, so there is no embedding vector)
    image
  3. when I tried to add the model in dify, I get ``Internal server error''
    image
    so I can add LLM models but not embedding models
    image

I believe this is a bug because 2. and 3. are different...

✔️ Expected Behavior

correctly add embedding models in LocalAI to dify

Actual Behavior

embedding models in LocalAI could not be added to dify

Originally created by @banianzr on GitHub (May 6, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a quesion, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] Pleas do not modify this template :) and fill in all the required fields. ### Dify version 0.6.5 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 1. I downloaded models and configure as [Doc: Deploying LocalAI](https://docs.dify.ai/tutorials/model-configuration/localai) mentioned. However, when I tried to configure the embedding models in dify, I encounter problems as below: 2. when I used `curl`, I can get response from the LocalAI docker (I did not run store.py provided by localAI example, so there is no embedding vector) ![image](https://github.com/langgenius/dify/assets/5343481/62e89ada-ab69-4bb4-9068-a50d7576bd77) 3. when I tried to add the model in dify, I get ``Internal server error'' ![image](https://github.com/langgenius/dify/assets/5343481/a2449755-6dc3-4406-ab08-6d4d68be67a2) so I can add LLM models but not embedding models ![image](https://github.com/langgenius/dify/assets/5343481/12ab9ba2-1b61-4b6a-a55c-8a455f624351) I believe this is a bug because 2. and 3. are different... ### ✔️ Expected Behavior correctly add embedding models in LocalAI to dify ### ❌ Actual Behavior embedding models in LocalAI could not be added to dify
yindo added the 🐞 bug label 2026-02-21 17:52:09 -05:00
yindo closed this issue 2026-02-21 17:52:09 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#2966