Anthropic error 404 occurs #58

Closed
opened 2026-02-16 10:17:56 -05:00 by yindo · 1 comment
Owner

Originally created by @auxpd on GitHub (Mar 10, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues Dify issues & Dify Official Plugins, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.0

Plugin version

0.0.3-local

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

All models associated with Anthropic are invoked with an error

✔️ Error log

2025-03-11 00:09:30.660 ERROR [Thread-515 (_generate_worker)] [app_generator.py:257] - Unknown Error when generating
Traceback (most recent call last):
File "/app/api/core/app/apps/agent_chat/app_generator.py", line 237, in _generate_worker
runner.run(
File "/app/api/core/app/apps/agent_chat/app_runner.py", line 61, in run
self.get_pre_calculate_rest_tokens(
File "/app/api/core/app/apps/base_app_runner.py", line 86, in get_pre_calculate_rest_tokens
prompt_tokens = model_instance.get_llm_num_tokens(prompt_messages)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/core/model_manager.py", line 195, in get_llm_num_tokens
self._round_robin_invoke(
File "/app/api/core/model_manager.py", line 370, in _round_robin_invoke
return function(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/core/model_runtime/model_providers/__base/large_language_model.py", line 299, in get_num_tokens
return plugin_model_manager.get_llm_num_tokens(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/api/core/plugin/manager/model.py", line 231, in get_llm_num_tokens
for resp in response:
^^^^^^^^
File "/app/api/core/plugin/manager/base.py", line 189, in _request_with_plugin_daemon_response_stream
self._handle_plugin_daemon_error(error.error_type, error.message)
File "/app/api/core/plugin/manager/base.py", line 221, in _handle_plugin_daemon_error
raise PluginInvokeError(description=message)
core.plugin.manager.exc.PluginInvokeError: PluginInvokeError: {"args":{},"error_type":"NotFoundError","message":"404 page not found"}
2025-03-11 00:09:30.660 DEBUG [Dummy-514] [based_generate_task_pipeline.py:45] - error: PluginInvokeError: {"args":{},"error_type":"NotFoundError","message":"404 page not found"}
2025-03-11 00:09:30.672 ERROR [Dummy-514] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"NotFoundError","message":"404 page not found"}

Originally created by @auxpd on GitHub (Mar 10, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [Dify issues](https://github.com/langgenius/dify/issues) & [Dify Official Plugins](https://github.com/langgenius/dify-official-plugins/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.0.0 ### Plugin version 0.0.3-local ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce All models associated with Anthropic are invoked with an error ### ✔️ Error log 2025-03-11 00:09:30.660 ERROR [Thread-515 (_generate_worker)] [app_generator.py:257] - Unknown Error when generating Traceback (most recent call last): File "/app/api/core/app/apps/agent_chat/app_generator.py", line 237, in _generate_worker runner.run( File "/app/api/core/app/apps/agent_chat/app_runner.py", line 61, in run self.get_pre_calculate_rest_tokens( File "/app/api/core/app/apps/base_app_runner.py", line 86, in get_pre_calculate_rest_tokens prompt_tokens = model_instance.get_llm_num_tokens(prompt_messages) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/core/model_manager.py", line 195, in get_llm_num_tokens self._round_robin_invoke( File "/app/api/core/model_manager.py", line 370, in _round_robin_invoke return function(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/core/model_runtime/model_providers/__base/large_language_model.py", line 299, in get_num_tokens return plugin_model_manager.get_llm_num_tokens( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/core/plugin/manager/model.py", line 231, in get_llm_num_tokens for resp in response: ^^^^^^^^ File "/app/api/core/plugin/manager/base.py", line 189, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "/app/api/core/plugin/manager/base.py", line 221, in _handle_plugin_daemon_error raise PluginInvokeError(description=message) core.plugin.manager.exc.PluginInvokeError: PluginInvokeError: {"args":{},"error_type":"NotFoundError","message":"404 page not found"} 2025-03-11 00:09:30.660 DEBUG [Dummy-514] [based_generate_task_pipeline.py:45] - error: PluginInvokeError: {"args":{},"error_type":"NotFoundError","message":"404 page not found"} 2025-03-11 00:09:30.672 ERROR [Dummy-514] [base_app_generate_response_converter.py:123] - {"args":{},"error_type":"NotFoundError","message":"404 page not found"}
yindo added the bug label 2026-02-16 10:17:56 -05:00
yindo closed this issue 2026-02-16 10:17:57 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Aug 16, 2025):

Hi, @auxpd. I'm Dosu, and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale.

Issue Summary

  • You reported a 404 error when using Anthropic models on a self-hosted Dify setup (v1.0.0, plugin 0.0.3-local).
  • The error occurs during token calculation in the model runtime, causing generation failures.
  • The traceback points to issues in the model manager and plugin model manager components.
  • No further updates or responses have been provided since the initial report.

Next Steps

  • Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here.
  • If I don’t hear back within 5 days, I will automatically close this issue.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Aug 16, 2025): Hi, @auxpd. I'm [Dosu](https://dosu.dev), and I'm helping the dify-official-plugins team manage their backlog and am marking this issue as stale. **Issue Summary** - You reported a 404 error when using Anthropic models on a self-hosted Dify setup (v1.0.0, plugin 0.0.3-local). - The error occurs during token calculation in the model runtime, causing generation failures. - The traceback points to issues in the model manager and plugin model manager components. - No further updates or responses have been provided since the initial report. **Next Steps** - Please let me know if this issue is still relevant with the latest version of the dify-official-plugins repository by commenting here. - If I don’t hear back within 5 days, I will automatically close this issue. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#58