‌‌‌‌‌OpenRouter, o1-mini and o1-preview error #6544

Closed
opened 2026-02-21 18:16:14 -05:00 by yindo · 3 comments
Owner

Originally created by @KienVu2368 on GitHub (Nov 4, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.10.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

  1. Add openrouter API
    image

  2. Choose o1-mini on agent chat

  3. Chat
    image

Errors only happen with o1-mini and o1-preview

✔️ Expected Behavior

‌‌‌‌No error, Agent can run normally

Actual Behavior

[openrouter] Error: 'choices'

Originally created by @KienVu2368 on GitHub (Nov 4, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.10.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce 1. Add openrouter API ![image](https://github.com/user-attachments/assets/617a81e4-db4f-4c48-b763-971a50addc78) 3. Choose o1-mini on agent chat 4. Chat ![image](https://github.com/user-attachments/assets/5d782c25-c6bf-48ed-9b64-c6f250009054) Errors only happen with o1-mini and o1-preview ### ✔️ Expected Behavior ‌‌‌‌No error, Agent can run normally ### ❌ Actual Behavior [openrouter] Error: 'choices'
yindo added the 🐞 bug label 2026-02-21 18:16:14 -05:00
yindo closed this issue 2026-02-21 18:16:14 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Nov 4, 2024):

Hey there, @KienVu2368! I'm here to help you with any bugs, questions, or contributions you may have regarding Dify. I'll do my best to assist you while we wait for a human maintainer to jump in. Let's tackle this together!

I couldn't find specific information about the 'choices' error in the Dify codebase when using the o1-mini and o1-preview models. However, there are some related discussions and issues that might be helpful:

  1. A similar issue was discussed regarding a 404 error when using the o1-preview model in a self-hosted Docker setup. The solution involved ensuring that the Ollama service is accessible from the Docker container by using host.docker.internal instead of localhost in the service URL [1].

  2. There is also a related unsolved discussion about a connection error with status code 503, which might provide some insights into network-related issues [2].

For the 'choices' error, it might be beneficial to check the network configurations and ensure that all services are correctly exposed and accessible within your Docker setup. Additionally, reviewing the logs for any specific error messages related to the 'choices' error could provide more clues.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Nov 4, 2024): <!-- Greeting --> Hey there, @KienVu2368! I'm here to help you with any bugs, questions, or contributions you may have regarding Dify. I'll do my best to assist you while we wait for a human maintainer to jump in. Let's tackle this together! <!-- Answer --> I couldn't find specific information about the 'choices' error in the Dify codebase when using the o1-mini and o1-preview models. However, there are some related discussions and issues that might be helpful: 1. A similar issue was discussed regarding a 404 error when using the o1-preview model in a self-hosted Docker setup. The solution involved ensuring that the Ollama service is accessible from the Docker container by using `host.docker.internal` instead of `localhost` in the service URL <sup>[[1]](https://github.com/langgenius/dify/discussions/8335)</sup>. 2. There is also a related unsolved discussion about a connection error with status code 503, which might provide some insights into network-related issues <sup>[[2]](https://github.com/langgenius/dify/discussions/6181)</sup>. For the 'choices' error, it might be beneficial to check the network configurations and ensure that all services are correctly exposed and accessible within your Docker setup. Additionally, reviewing the logs for any specific error messages related to the 'choices' error could provide more clues. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@fdb02983rhy commented on GitHub (Dec 4, 2024):

image Im encountering the same error when using anthropic api via litellm
@fdb02983rhy commented on GitHub (Dec 4, 2024): <img width="316" alt="image" src="https://github.com/user-attachments/assets/c25803ff-2c8c-4b90-abf5-1c57eaa07aa2"> Im encountering the same error when using anthropic api via litellm
Author
Owner

@dosubot[bot] commented on GitHub (Jan 5, 2025):

Hi, @KienVu2368. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You reported errors with the o1-mini and o1-preview options in a self-hosted Dify setup using Docker.
  • The error message encountered was '[openrouter] Error: 'choices''.
  • I suggested checking network configurations and service accessibility within Docker.
  • Another user, fdb02983rhy, reported a similar error using the anthropic API via litellm, suggesting a broader issue.

Next Steps:

  • Please confirm if this issue is still relevant with the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Jan 5, 2025): Hi, @KienVu2368. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You reported errors with the `o1-mini` and `o1-preview` options in a self-hosted Dify setup using Docker. - The error message encountered was '[openrouter] Error: 'choices''. - I suggested checking network configurations and service accessibility within Docker. - Another user, fdb02983rhy, reported a similar error using the anthropic API via litellm, suggesting a broader issue. **Next Steps:** - Please confirm if this issue is still relevant with the latest version of the Dify repository by commenting here. - If there is no further activity, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6544