langgenius/dify-official-plugins
1
0
Fork 0
mirror of https://github.com/langgenius/dify-official-plugins.git synced 2026-07-21 17:45:23 -04:00
Code Issues 54 Packages Projects Releases Wiki Activity

Unable to install "Triton Inference Server" llm provider plugin #693

New Issue
Closed
opened 2026-02-16 10:20:12 -05:00 by yindo · 7 comments
yindo commented 2026-02-16 10:20:12 -05:00
Owner
Copy Link
Copy Source

Originally created by @cocoropcportal-lang on GitHub (Oct 8, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.7.2

Plugin version

0.0.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Install "Triton Inference Server" llm provider plugin

✔️ Error log

Failed to parse response from plugin daemon to PluginDaemonBasicResponse [PluginDecodeResponse], url: plugin/55368b16-2484-4f2b-bfaf-d3be7b1fb74c/management/install/upload/package

Originally created by @cocoropcportal-lang on GitHub (Oct 8, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.7.2 ### Plugin version 0.0.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce Install "Triton Inference Server" llm provider plugin ### ✔️ Error log Failed to parse response from plugin daemon to PluginDaemonBasicResponse [PluginDecodeResponse], url: plugin/55368b16-2484-4f2b-bfaf-d3be7b1fb74c/management/install/upload/package
yindo added the bug label 2026-02-16 10:20:12 -05:00
yindo closed this issue 2026-02-16 10:20:12 -05:00
yindo commented 2026-02-16 10:20:12 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 8, 2025):

Hi @cocoropcportal-lang! I'm Dosu and I’m helping the dify-official-plugins team.

The error means the plugin daemon's response doesn't match the format Dify expects for plugin installation—specifically, it must be a JSON object with code, message, and data, where data contains a valid plugin manifest and identifier. This usually happens if the plugin package is missing required fields, the daemon crashes, or a dependency is missing.

A recent fix added the missing dify_plugin dependency to plugin requirements, resolving installation failures for several plugins. The fix is included in plugin version 0.1.6 and newer—your version (0.0.2) is outdated and likely missing this dependency, which can cause the exact error you're seeing. Please upgrade the Triton Inference Server plugin to at least version 0.1.6 and try again. If the problem persists, check both the main app and plugin daemon logs for more details and verify the plugin package structure matches Dify's requirements.
See details about the dependency fix and version update

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Oct 8, 2025): <!-- Greeting --> Hi @cocoropcportal-lang! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the dify-official-plugins team. <!-- Answer --> The error means the plugin daemon's response doesn't match the format Dify expects for plugin installation—specifically, it must be a JSON object with `code`, `message`, and `data`, where `data` contains a valid plugin manifest and identifier. This usually happens if the plugin package is missing required fields, the daemon crashes, or a dependency is missing. A recent fix added the missing `dify_plugin` dependency to plugin requirements, resolving installation failures for several plugins. The fix is included in plugin version 0.1.6 and newer—your version (0.0.2) is outdated and likely missing this dependency, which can cause the exact error you're seeing. Please upgrade the Triton Inference Server plugin to at least version 0.1.6 and try again. If the problem persists, check both the main app and plugin daemon logs for more details and verify the plugin package structure matches Dify's requirements. [See details about the dependency fix and version update](https://github.com/langgenius/dify-official-plugins/pull/1748) <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/77813c4b-4e9f-4be8-b1fe-0c0e7da119d5?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1811)
yindo commented 2026-02-16 10:20:12 -05:00
Author
Owner
Copy Link
Copy Source

@cocoropcportal-lang commented on GitHub (Oct 9, 2025):

@dosu, version 0.1.6 of Triton Server does not exist.

@cocoropcportal-lang commented on GitHub (Oct 9, 2025): @dosu, version 0.1.6 of Triton Server does not exist.
yindo commented 2026-02-16 10:20:12 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 9, 2025):

You're right—version 0.1.6 of the Triton Inference Server plugin does not exist. The latest available version is 0.0.2, and there are no newer releases or tags for this plugin as of now. The previous advice about upgrading to 0.1.6 was incorrect and referred to a fix applied to a different plugin, not Triton.

If you're seeing installation errors like "Failed to parse response from plugin daemon to PluginDaemonBasicResponse," it's likely due to a packaging or schema issue, or possibly a missing or incompatible dependency. The Triton plugin's requirements already include the necessary dify_plugin dependency, so the issue may be with the plugin's response format or another compatibility problem.

There are no official fixes or updates for this installation issue yet. Some users have reported needing to manually adjust the plugin code for related problems (such as changing API endpoints from /generate to /infer for Triton compatibility), but for installation failures, collecting logs from both the main Dify app and the plugin daemon during the install attempt is the best next step for troubleshooting or escalation.

If you need help with manual code adjustments or log collection, let me know!

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Oct 9, 2025): <!-- Answer --> You're right—version 0.1.6 of the Triton Inference Server plugin does not exist. The latest available version is 0.0.2, and there are no newer releases or tags for this plugin as of now. The previous advice about upgrading to 0.1.6 was incorrect and referred to a fix applied to a different plugin, not Triton. If you're seeing installation errors like "Failed to parse response from plugin daemon to PluginDaemonBasicResponse," it's likely due to a packaging or schema issue, or possibly a missing or incompatible dependency. The Triton plugin's requirements already include the necessary dify_plugin dependency, so the issue may be with the plugin's response format or another compatibility problem. There are no official fixes or updates for this installation issue yet. Some users have reported needing to manually adjust the plugin code for related problems (such as changing API endpoints from /generate to /infer for Triton compatibility), but for installation failures, collecting logs from both the main Dify app and the plugin daemon during the install attempt is the best next step for troubleshooting or escalation. If you need help with manual code adjustments or log collection, let me know! <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/de94f7c8-221d-4b95-bbfe-8fb7369b504f?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1811)
yindo commented 2026-02-16 10:20:13 -05:00
Author
Owner
Copy Link
Copy Source

@cocoropcportal-lang commented on GitHub (Oct 9, 2025):

@dosu I need help with manual code adjustments and log collection

@cocoropcportal-lang commented on GitHub (Oct 9, 2025): @dosu I need help with manual code adjustments and log collection
yindo commented 2026-02-16 10:20:13 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 9, 2025):

Here’s how you can collect logs and try manual code adjustments for the Triton Inference Server plugin install issue:

Log collection (Docker):

  • For the main Dify app, logs are typically at /app/logs/server.log inside the api container. You can access them with: 
    docker compose logs api
    or, if you want to check the file directly: 
    docker compose exec api cat /app/logs/server.log
  • For the plugin daemon, logs are usually in the mounted volume (./volumes/plugin_daemon on your host) or you can use: 
    docker compose logs plugin_daemon
    If you want to check files directly, look inside ./volumes/plugin_daemon for log files or error traces.

Manual code adjustments:

  • The install error means the plugin daemon’s response doesn’t match what Dify expects: a JSON object with code (int), message (str), and data (object). For plugin install, data must include unique_identifier (str) and manifest (object) fields. Any missing or misnamed field will cause this error.
  • The Triton plugin’s manifest and packaging are auto-generated by the dify_plugin dependency. If you suspect a packaging or schema issue, check manifest.yaml for required fields and valid values.
  • If you want to add debug logging, you can edit main.py in the plugin directory to print or log more details during startup or manifest generation. For example, add: 
    import logging
logging.basicConfig(level=logging.DEBUG)
logging.debug("Starting plugin, manifest: %s", manifest)
  • For runtime issues (not install), some users have needed to change the endpoint in models/llm/llm.py from /generate to /infer to match their Triton server’s API.

If you capture logs during a failed install, look for Python tracebacks or JSON decode errors—they’ll point to what’s missing or malformed in the plugin’s response. If you want help interpreting a specific log or traceback, paste it here!

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Oct 9, 2025): <!-- Answer --> Here’s how you can collect logs and try manual code adjustments for the Triton Inference Server plugin install issue: **Log collection (Docker):** - For the main Dify app, logs are typically at `/app/logs/server.log` inside the `api` container. You can access them with: ``` docker compose logs api ``` or, if you want to check the file directly: ``` docker compose exec api cat /app/logs/server.log ``` - For the plugin daemon, logs are usually in the mounted volume (`./volumes/plugin_daemon` on your host) or you can use: ``` docker compose logs plugin_daemon ``` If you want to check files directly, look inside `./volumes/plugin_daemon` for log files or error traces. **Manual code adjustments:** - The install error means the plugin daemon’s response doesn’t match what Dify expects: a JSON object with `code` (int), `message` (str), and `data` (object). For plugin install, `data` must include `unique_identifier` (str) and `manifest` (object) fields. Any missing or misnamed field will cause this error. - The Triton plugin’s manifest and packaging are auto-generated by the `dify_plugin` dependency. If you suspect a packaging or schema issue, check `manifest.yaml` for required fields and valid values. - If you want to add debug logging, you can edit `main.py` in the plugin directory to print or log more details during startup or manifest generation. For example, add: ```python import logging logging.basicConfig(level=logging.DEBUG) logging.debug("Starting plugin, manifest: %s", manifest) ``` - For runtime issues (not install), some users have needed to change the endpoint in `models/llm/llm.py` from `/generate` to `/infer` to match their Triton server’s API. If you capture logs during a failed install, look for Python tracebacks or JSON decode errors—they’ll point to what’s missing or malformed in the plugin’s response. If you want help interpreting a specific log or traceback, paste it here! <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/2bd441e9-bd6d-4967-97f7-dc3f548d11d0?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify-official-plugins/issues/1811)
yindo commented 2026-02-16 10:20:13 -05:00
Author
Owner
Copy Link
Copy Source

@cocoropcportal-lang commented on GitHub (Oct 10, 2025):

I have tried all the methods still it the same error is raised, unable to install the Triton inference server plugin. Please someone help me fix if you faced the same error.

@cocoropcportal-lang commented on GitHub (Oct 10, 2025): I have tried all the methods still it the same error is raised, unable to install the Triton inference server plugin. Please someone help me fix if you faced the same error.
yindo commented 2026-02-16 10:20:13 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Oct 26, 2025):

Hi, @cocoropcportal-lang. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported an installation failure of the Triton Inference Server plugin on Dify v1.7.2 due to errors parsing the plugin daemon's response.
  • It was clarified that no plugin versions newer than 0.0.2 exist, and the issue likely relates to packaging or schema mismatches.
  • I provided detailed guidance on collecting Docker logs and manually adjusting code to debug the problem.
  • Despite these efforts, you continue to experience the same error and have requested further assistance.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I do not hear back within 5 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Oct 26, 2025): Hi, @cocoropcportal-lang. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary:** - You reported an installation failure of the Triton Inference Server plugin on Dify v1.7.2 due to errors parsing the plugin daemon's response. - It was clarified that no plugin versions newer than 0.0.2 exist, and the issue likely relates to packaging or schema mismatches. - I provided detailed guidance on collecting Docker logs and manually adjusting code to debug the problem. - Despite these efforts, you continue to experience the same error and have requested further assistance. **Next Steps:** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I do not hear back within 5 days, this issue will be automatically closed. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
bug
dependencies
documentation
enhancement
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
stale
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#693
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?