OpenAI compatible plugin error #16900

Closed
opened 2026-02-21 19:28:52 -05:00 by yindo · 0 comments
Owner

Originally created by @hangshao009 on GitHub (Sep 8, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.3.3+

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I am using Ascend servers for local deployment of large models, and the interface is compatible with OpenAI. I am able to configure it correctly on version 1.3.3 of Dify. However, versions above 1.3.3 report an error: Internal Server Error. I suspect that this bug was fixed in version 1.8.0, but it wasn't. I suspect this may be due to the OpenAI compatibility plugin. I hope this can be addressed, as currently, local deployment users account for approximately 40%.

Image Image

✔️ Expected Behavior

Image

Actual Behavior

Image
Originally created by @hangshao009 on GitHub (Sep 8, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.3.3+ ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce I am using Ascend servers for local deployment of large models, and the interface is compatible with OpenAI. I am able to configure it correctly on version 1.3.3 of Dify. However, versions above 1.3.3 report an error: Internal Server Error. I suspect that this bug was fixed in version 1.8.0, but it wasn't. I suspect this may be due to the OpenAI compatibility plugin. I hope this can be addressed, as currently, local deployment users account for approximately 40%. <img width="1514" height="940" alt="Image" src="https://github.com/user-attachments/assets/cfd0abde-6f7c-4bfa-804f-4b9442fadb56" /> <img width="1259" height="927" alt="Image" src="https://github.com/user-attachments/assets/98f921e1-a62f-4899-8859-05aa50dadaf9" /> ### ✔️ Expected Behavior <img width="1259" height="927" alt="Image" src="https://github.com/user-attachments/assets/0f4df096-71ac-4769-98d7-de988b044e57" /> ### ❌ Actual Behavior <img width="1514" height="940" alt="Image" src="https://github.com/user-attachments/assets/a0983bbe-7bba-412b-98d3-c6098d00ef5e" />
yindo added the 🐞 bug label 2026-02-21 19:28:52 -05:00
yindo closed this issue 2026-02-21 19:28:52 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#16900