offline deployment Issue #11926

Closed
opened 2026-02-21 19:04:47 -05:00 by yindo · 2 comments
Owner

Originally created by @volongoto on GitHub (Mar 21, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Currently, my offline deployment environment consists of Dify 1.0.1 and plugin-daemon-0.0.6. I'm using the LocalAI method to configure the DeepSeek R1 version 72B model deployed with offline vLLM. After restarting the service, there was an error message when connecting to the model. Subsequently, when trying to connect again, there was no information at all, and the request didn't receive a response. Below is the error message from the dify-api-1 service:
Image

✔️ Expected Behavior

No response

Actual Behavior

No response

Originally created by @volongoto on GitHub (Mar 21, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.0.1 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce Currently, my offline deployment environment consists of Dify 1.0.1 and plugin-daemon-0.0.6. I'm using the LocalAI method to configure the DeepSeek R1 version 72B model deployed with offline vLLM. After restarting the service, there was an error message when connecting to the model. Subsequently, when trying to connect again, there was no information at all, and the request didn't receive a response. Below is the error message from the dify-api-1 service: ![Image](https://github.com/user-attachments/assets/dafe5a22-88de-43c8-9714-e1d7a6e9816c) ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior _No response_
yindo closed this issue 2026-02-21 19:04:47 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Mar 21, 2025):

I found a similar open issue related to plugin errors after upgrading to version v1.0.1. The suggested solution involves several steps:

  1. Clear Plugin Data: Execute SQL commands in the dify_plugin database to clear existing plugin data.
  2. Clear Plugin Directories: Remove contents of specific directories related to plugins.
  3. Restart the Plugin Daemon Service: Reinitialize the plugin system.
  4. Reinstall the Plugins: After clearing data and directories, reinstall necessary plugins.

If these steps do not resolve the issue, consider downgrading the dify-api and dify-web services to version 0.15.3 as a temporary workaround [1].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@dosubot[bot] commented on GitHub (Mar 21, 2025): <!-- Answer --> I found a similar open issue related to plugin errors after upgrading to version v1.0.1. The suggested solution involves several steps: 1. **Clear Plugin Data**: Execute SQL commands in the `dify_plugin` database to clear existing plugin data. 2. **Clear Plugin Directories**: Remove contents of specific directories related to plugins. 3. **Restart the Plugin Daemon Service**: Reinitialize the plugin system. 4. **Reinstall the Plugins**: After clearing data and directories, reinstall necessary plugins. If these steps do not resolve the issue, consider downgrading the `dify-api` and `dify-web` services to version 0.15.3 as a temporary workaround <sup>[[1]](https://github.com/langgenius/dify/issues/15843)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=hallucination) | [Bug Report](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/e7a0f7bd-1a85-4caa-be8f-bc3abcb276cc?feedback_type=other)</sup>
Author
Owner

@crazywoola commented on GitHub (Mar 21, 2025):

From the logs you provided, You are trying to access deepseek through the official deepseek plugin. You can not use it in this way.
And since you are deploying it with LocalAI, you should use this LocalAI instead.

You didn't provide enough information in this thread. And we can not help you with that.

Please also follow this doc for reporting bugs.

@crazywoola commented on GitHub (Mar 21, 2025): From the logs you provided, You are trying to access deepseek through the official [deepseek](https://marketplace.dify.ai/plugins/langgenius/deepseek) plugin. You can not use it in this way. And since you are deploying it with LocalAI, you should use this [LocalAI](https://marketplace.dify.ai/plugins/langgenius/localai) instead. You didn't provide enough information in this [thread](https://github.com/langgenius/dify/issues/16424). And we can not help you with that. Please also follow this [doc](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md#bug-reports) for reporting bugs.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#11926