Credentials validation fails with 404 error when adding DeepSeek model via GPUStack Plugin in Completion mode #664

Closed
opened 2026-02-16 10:20:07 -05:00 by yindo · 1 comment
Owner

Originally created by @somethingwentwell on GitHub (Sep 22, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.7.1

Plugin version

0.0.8

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Image

Steps to Reproduce

In Dify, go to Plugins > Install from Marketplace > Search "GPUStack" > Install.
Configure the GPUStack Plugin with self-hosted server (as shown in screenshot):

Model: DeepSeek-R1-INT8
Server: http://10.16.11.95:8000
API Key: [valid key]

Chat mode: Toggle off → Validates and works fine.
Completion mode: Toggle on → Click Save → "Credentials validation failed with status code 404".

✔️ Error log

No response

Originally created by @somethingwentwell on GitHub (Sep 22, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.7.1 ### Plugin version 0.0.8 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce <img width="1885" height="890" alt="Image" src="https://github.com/user-attachments/assets/1caab2c9-610b-4e48-bd58-25c43d5fb7dc" /> Steps to Reproduce In Dify, go to Plugins > Install from Marketplace > Search "GPUStack" > Install. Configure the GPUStack Plugin with self-hosted server (as shown in screenshot): Model: DeepSeek-R1-INT8 Server: http://10.16.11.95:8000 API Key: [valid key] Chat mode: Toggle off → Validates and works fine. Completion mode: Toggle on → Click Save → "Credentials validation failed with status code 404". ### ✔️ Error log _No response_
yindo added the bug label 2026-02-16 10:20:07 -05:00
yindo closed this issue 2026-02-16 10:20:07 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Sep 22, 2025):

The 404 error in Completion mode happens because the GPUStack Plugin sends a POST request to the /v1/completions endpoint for credential validation, while Chat mode uses /v1/chat/completions. Your DeepSeek server likely only implements /v1/chat/completions and not /v1/completions, which is why Chat mode works but Completion mode fails with a 404. This is confirmed by the plugin code and matches similar reports with other models and plugins [source].

Unless your DeepSeek server adds support for the /v1/completions endpoint, you’ll need to use Chat mode. If you require Completion mode, consider patching your server to support the missing endpoint or using a different backend that implements both endpoints. Checking your server logs can confirm the missing endpoint. For more context on similar issues and workarounds, see this discussion.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Sep 22, 2025): <!-- Answer --> The 404 error in Completion mode happens because the GPUStack Plugin sends a POST request to the /v1/completions endpoint for credential validation, while Chat mode uses /v1/chat/completions. Your DeepSeek server likely only implements /v1/chat/completions and not /v1/completions, which is why Chat mode works but Completion mode fails with a 404. This is confirmed by the plugin code and matches similar reports with other models and plugins [[source]](https://github.com/langgenius/dify-official-plugins/blob/11efb6b57ce0b08f963f057e34206abcd87d009e/models/gpustack/models/llm/llm.py). Unless your DeepSeek server adds support for the /v1/completions endpoint, you’ll need to use Chat mode. If you require Completion mode, consider patching your server to support the missing endpoint or using a different backend that implements both endpoints. Checking your server logs can confirm the missing endpoint. For more context on similar issues and workarounds, see [this discussion](https://github.com/langgenius/dify-official-plugins/issues/1542). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/407fa476-2e25-45b9-a013-edee97cb8ef0?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1749)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#664