langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-21 17:45:23 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

Using the OpenAI-API-compatible connection model's API, the model is unable to output #67

New Issue
Closed
opened 2026-02-16 10:17:58 -05:00 by yindo · 6 comments
yindo commented 2026-02-16 10:17:58 -05:00
Owner
Copy Link
Copy Source

Originally created by @chongliujia on GitHub (Mar 12, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.1

Plugin version

OpenAI-API-compatible 0.0.7

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

When I use the openai-api-compatible to connect to China Telecom's DeepSeek API via Dify, the connection appears to be established. However, during the test conversation, I noticed that the model is unable to generate any dialogue output.

Image

✔️ Error log

No response

Originally created by @chongliujia on GitHub (Mar 12, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.0.1 ### Plugin version OpenAI-API-compatible 0.0.7 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce When I use the openai-api-compatible to connect to China Telecom's DeepSeek API via Dify, the connection appears to be established. However, during the test conversation, I noticed that the model is unable to generate any dialogue output. <img width="1006" alt="Image" src="https://github.com/user-attachments/assets/efd0c697-1a02-4659-b20d-259d6011d63b" /> ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:17:58 -05:00
yindo closed this issue 2026-02-16 10:17:58 -05:00
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@QiQi-OvO commented on GitHub (Mar 12, 2025):

I had the same problem because there was no way to get the vocab.bpe file.
2025-03-13 01:40:53.103 ERROR [Dummy-44] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"ConnectTimeout","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by ConnectTimeoutError(\u003curllib3.connection.HTTPSConnection object at 0x7f585b772120\u003e, 'Connection to openaipublic.blob.core.windows.net timed out. (connect timeout=None)'))"}

@QiQi-OvO commented on GitHub (Mar 12, 2025): I had the same problem because there was no way to get the vocab.bpe file. `2025-03-13 01:40:53.103 ERROR [Dummy-44] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"ConnectTimeout","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by ConnectTimeoutError(\u003curllib3.connection.HTTPSConnection object at 0x7f585b772120\u003e, 'Connection to openaipublic.blob.core.windows.net timed out. (connect timeout=None)'))"}`
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@caolicaoli commented on GitHub (Mar 13, 2025):

also error:
org.springframework.ai.retry.TransientAiException: 500 - {"code":-500,"message":"{"message":"{\"args\":{},\"error_type\":\"TypeError\",\"message\":\"dify_plugin.entities.model.llm.LLMModelConfig() got multiple values for keyword argument 'completion_params'\"}","error_type":"PluginDaemonInternalServerError","args":null}","data":null}

改一下代码就行了：
把
model_config=LLMModelConfig(
completion_params=llm.get("completion_params", {}), **llm
)
改成
model_config=LLMModelConfig(**llm)

@caolicaoli commented on GitHub (Mar 13, 2025): also error: org.springframework.ai.retry.TransientAiException: 500 - {"code":-500,"message":"{\"message\":\"{\\\"args\\\":{},\\\"error_type\\\":\\\"TypeError\\\",\\\"message\\\":\\\"dify_plugin.entities.model.llm.LLMModelConfig() got multiple values for keyword argument 'completion_params'\\\"}\",\"error_type\":\"PluginDaemonInternalServerError\",\"args\":null}","data":null} 改一下代码就行了： 把 model_config=LLMModelConfig( completion_params=llm.get("completion_params", {}), **llm ) 改成 model_config=LLMModelConfig(**llm)
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@chongliujia commented on GitHub (Mar 13, 2025):

also error: org.springframework.ai.retry.TransientAiException: 500 - {"code":-500,"message":"{"message":"{"args":{},"error_type":"TypeError","message":"dify_plugin.entities.model.llm.LLMModelConfig() got multiple values for keyword argument 'completion_params'"}","error_type":"PluginDaemonInternalServerError","args":null}","data":null}

改一下代码就行了： 把 model_config=LLMModelConfig( completion_params=llm.get("completion_params", {}), **llm ) 改成 model_config=LLMModelConfig(**llm)

Thank you, but I checked the source code of Dify but couldn't find the relevant code snippet. Additionally, I have already installed the plugin.

@chongliujia commented on GitHub (Mar 13, 2025): > also error: org.springframework.ai.retry.TransientAiException: 500 - {"code":-500,"message":"{"message":"{\"args\":{},\"error_type\":\"TypeError\",\"message\":\"dify_plugin.entities.model.llm.LLMModelConfig() got multiple values for keyword argument 'completion_params'\"}","error_type":"PluginDaemonInternalServerError","args":null}","data":null} > > 改一下代码就行了： 把 model_config=LLMModelConfig( completion_params=llm.get("completion_params", {}), **llm ) 改成 model_config=LLMModelConfig(**llm) Thank you, but I checked the source code of Dify but couldn't find the relevant code snippet. Additionally, I have already installed the plugin.
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@QiQi-OvO commented on GitHub (Mar 14, 2025):

我遇到了同样的问题，因为无法获取 vocab.bpe 文件。 2025-03-13 01:40:53.103 ERROR [Dummy-44] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"ConnectTimeout","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by ConnectTimeoutError(\u003curllib3.connection.HTTPSConnection object at 0x7f585b772120\u003e, 'Connection to openaipublic.blob.core.windows.net timed out. (connect timeout=None)'))"}

Check this issue Issue14887 i has solved the problem :)

@QiQi-OvO commented on GitHub (Mar 14, 2025): > 我遇到了同样的问题，因为无法获取 vocab.bpe 文件。 `2025-03-13 01:40:53.103 ERROR [Dummy-44] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"ConnectTimeout","message":"HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /gpt-2/encodings/main/vocab.bpe (Caused by ConnectTimeoutError(\u003curllib3.connection.HTTPSConnection object at 0x7f585b772120\u003e, 'Connection to openaipublic.blob.core.windows.net timed out. (connect timeout=None)'))"}` Check this issue [Issue14887](https://github.com/langgenius/dify/issues/14887 ) i has solved the problem :)
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@zzb181 commented on GitHub (Mar 18, 2025):

Image

Image
@zzb181 commented on GitHub (Mar 18, 2025): ![Image](https://github.com/user-attachments/assets/c1f2070f-7e18-4fcf-8b8a-4bdcef1518c7) <img width="1051" alt="Image" src="https://github.com/user-attachments/assets/82ec15d0-9ec9-472f-9c28-ebc682a522fa" />
yindo commented 2026-02-16 10:17:59 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Aug 20, 2025):

Hi, @chongliujia. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that using the OpenAI-API-compatible plugin (v0.0.7) with Dify (v1.0.1) in a self-hosted Docker environment connects to China Telecom's DeepSeek API but produces no model output or error logs.
  • Other users shared related problems: QiQi-OvO experienced a vocab.bpe file download timeout due to connection issues, and caolicaoli encountered a TypeError caused by duplicate keyword arguments in LLMModelConfig, suggesting a code fix.
  • You acknowledged these comments but had difficulty locating the relevant code in Dify and confirmed the plugin is installed.
  • Additional screenshots were provided by zzb181 without further details.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here to keep the discussion open.
  • Otherwise, I will automatically close this issue in 5 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 20, 2025): Hi, @chongliujia. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported that using the OpenAI-API-compatible plugin (v0.0.7) with Dify (v1.0.1) in a self-hosted Docker environment connects to China Telecom's DeepSeek API but produces no model output or error logs. - Other users shared related problems: QiQi-OvO experienced a vocab.bpe file download timeout due to connection issues, and caolicaoli encountered a TypeError caused by duplicate keyword arguments in LLMModelConfig, suggesting a code fix. - You acknowledged these comments but had difficulty locating the relevant code in Dify and confirmed the plugin is installed. - Additional screenshots were provided by zzb181 without further details. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here to keep the discussion open. - Otherwise, I will automatically close this issue in 5 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#67
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?