mirror of
https://github.com/langgenius/dify-official-plugins.git
synced 2026-07-22 01:55:27 -04:00
Using OpenAI-API-compatible to connect to the privately deployed full-version DeepSeek model, saving failed with an error.” #573
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @JiesenSun on GitHub (Aug 21, 2025).
Self Checks
Dify version
1.7.1
Plugin version
0.2.0-local
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
When using OpenAI-API-compatible to connect to the privately deployed full-version DeepSeek model, saving results in an error as shown in the screenshot: [ERROR] PluginDaemonInternalServerError: killed by timeout. However, when using the following curl request, the model works normally.
✔️ Error log
No response
@dosubot[bot] commented on GitHub (Aug 21, 2025):
This timeout error is a common issue when connecting Dify (self-hosted Docker) to OpenAI-API-compatible models like DeepSeek. Even if curl works, the plugin may hit a timeout due to differences in how requests are handled and how timeouts are enforced in the plugin daemon.
Key things to check and try:
Docker network config: Make sure your plugin daemon and Dify containers can reach the DeepSeek endpoint. If you use
localhostor127.0.0.1in your endpoint, switch tohost.docker.internalor your host's LAN IP. SetSANDBOX_ENABLE_NETWORK=trueand ensurePLUGIN_DAEMON_URLis correct in your environment variables. This is a frequent cause of plugin timeouts in Docker setups [ref].Timeout settings: In Dify v1.7.1, plugin timeout is not user-configurable. If your DeepSeek model is slow to respond, the plugin may be killed by the default timeout. Newer Dify versions (after 1.7.1) add timeout controls for MCP tools, but these are not available in your version [ref].
Plugin/SDK bugs: Some plugin errors are caused by code issues (like passing multiple values for
completion_params), or by the plugin expecting a specific response format (e.g., a space afterdata:in streaming responses). If your DeepSeek API returns a slightly different format, you may need to patch the plugin code (see this workaround).Credential validation: Double-check your model name, endpoint, and API key. Even small mismatches can cause validation to fail or time out [ref].
Logs: Check both Docker and plugin daemon logs for more details on the timeout or connection error.
Workarounds:
If you need more specific help, share your plugin config (endpoint, model name, etc.) and any relevant logs from the plugin daemon.
To reply, just mention @dosu.
How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other

@JiesenSun commented on GitHub (Aug 21, 2025):
Confirmed that accessing via curl inside the container works fine, and the model’s streaming output is very fast.
@JiesenSun commented on GitHub (Aug 21, 2025):
After verification, downgrading to 0.15.3 allows saving successfully. But Why?🤔
@dosubot[bot] commented on GitHub (Aug 21, 2025):
This happens because Dify versions after 0.15.3 introduced stricter timeout handling, more rigorous credential validation, and new parameters (like the model name in the API endpoint) for OpenAI-compatible models. These changes can cause timeouts or validation failures with some endpoints that worked fine in 0.15.3, which had simpler and more permissive logic. In particular, the newer versions enforce fixed timeouts and may attempt extra credential checks or refreshes, leading to PluginDaemonInternalServerError: timeout—even if curl works and the model responds quickly. Many users have found that downgrading to 0.15.3 resolves these issues because it does not enforce the same strict checks or timeouts during model saving and validation [source 1] [source 2].
To reply, just mention @dosu.
How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other

@JiesenSun commented on GitHub (Aug 22, 2025):
Will there be any improvements or optimizations in the future? Because of this issue, it is impossible to connect to the privately deployed large model and therefore unable to use Dify.
@crazywoola commented on GitHub (Aug 24, 2025):
https://github.com/langgenius/dify/blob/75199442c16fb2ad1758d1f813b0c9249fc150e9/docker/docker-compose.yaml#L521
https://github.com/langgenius/dify/blob/75199442c16fb2ad1758d1f813b0c9249fc150e9/docker/docker-compose.yaml#L757
@JiesenSun commented on GitHub (Aug 25, 2025):
You mean that adding the following two configurations to the docker-compose.yaml file can solve this issue, right? And both of these are supported in version 1.7.X, correct?
@JiesenSun commented on GitHub (Aug 25, 2025):
After checking carefully, I found that the docker-compose.yaml in the Dify 1.7.1 version of the project does include these two configurations. However, when connecting to the privately deployed DeepSeek-671B model, it still cannot be saved. What should I do?