hallucinating "workflow doesn't have access to a GitHub token" despite successfully creating PRs #3623

Open
opened 2026-02-16 17:40:54 -05:00 by yindo · 5 comments
Owner

Originally created by @elithrar on GitHub (Dec 17, 2025).

Originally assigned to: @rekram1-node on GitHub.

When using the GitHub Action to create a PR, the model includes text claiming "The workflow doesn't have access to a GitHub token for creating PRs via API" — but this statement appeared inside a PR that was successfully created via the API.

The PR creation works — opencode/the model seem to be hallucinating. This is using anthropic/claude-opus-4-5

  • PR was created successfully with author opencode-agent, proper timestamps, etc.
  • workflow has correct permissions (pull-requests: write, id-token: write, etc.)
  • the github workflow is unmodified from the default opencode version
  • generates stale/template text that doesn't match reality

Screenshots below from the failure mode + asking /oc to analyze.

I understand the github CLI + action well enough at this point from my other (unrelated) PRs and don’t see anything in opencode that would directly cause this.

Image Image Image Image Image
Originally created by @elithrar on GitHub (Dec 17, 2025). Originally assigned to: @rekram1-node on GitHub. When using the GitHub Action to create a PR, the model includes text claiming "The workflow doesn't have access to a GitHub token for creating PRs via API" — but this statement appeared inside a PR that was successfully created via the API. The PR creation works — opencode/the model seem to be hallucinating. This is using `anthropic/claude-opus-4-5` * PR was created successfully with author opencode-agent, proper timestamps, etc. * workflow has correct permissions (pull-requests: write, id-token: write, etc.) * the github workflow is unmodified from the default opencode version * generates stale/template text that doesn't match reality Screenshots below from the failure mode + asking `/oc` to analyze. I understand the github CLI + action well enough at this point from my other (unrelated) PRs and don’t see anything in opencode that would directly cause this. <img width="603" height="1311" alt="Image" src="https://github.com/user-attachments/assets/e302b794-7580-4981-baba-be047ce46632" /> <img width="603" height="1311" alt="Image" src="https://github.com/user-attachments/assets/98a6729c-56e1-4185-9399-dec711c1ff94" /> <img width="603" height="1311" alt="Image" src="https://github.com/user-attachments/assets/6b04fe5b-88ca-4a20-80e6-1b6ee85598d8" /> <img width="603" height="1311" alt="Image" src="https://github.com/user-attachments/assets/10481058-ff4a-442b-849a-0e4ac4ebb278" /> <img width="603" height="1311" alt="Image" src="https://github.com/user-attachments/assets/ede2f53d-81cd-4fa5-ad0c-48578697319b" />
yindo added the bug label 2026-02-16 17:40:54 -05:00
Author
Owner

@github-actions[bot] commented on GitHub (Dec 17, 2025):

This issue might be a duplicate of existing issues. Please check:

  • #4098: Opencode Github Integration says it's created a PR, but it hasn't - also relates to GitHub action PR creation issues where the model's perception doesn't match actual results

Feel free to ignore if this doesn't address your specific case.

@github-actions[bot] commented on GitHub (Dec 17, 2025): This issue might be a duplicate of existing issues. Please check: - #4098: Opencode Github Integration says it's created a PR, but it hasn't - also relates to GitHub action PR creation issues where the model's perception doesn't match actual results Feel free to ignore if this doesn't address your specific case.
Author
Owner

@rekram1-node commented on GitHub (Dec 17, 2025):

ill look into it

@rekram1-node commented on GitHub (Dec 17, 2025): ill look into it
Author
Owner

@rekram1-node commented on GitHub (Dec 18, 2025):

merged pr that should help discourage this behavior (will be in next release)

@rekram1-node commented on GitHub (Dec 18, 2025): merged pr that should help discourage this behavior (will be in next release)
Author
Owner

@elithrar commented on GitHub (Dec 18, 2025):

winner, thanks Aiden!

@elithrar commented on GitHub (Dec 18, 2025): winner, thanks Aiden!
Author
Owner

@rekram1-node commented on GitHub (Dec 18, 2025):

no problem! Ill keep open for now, we will see if it fixed it

@rekram1-node commented on GitHub (Dec 18, 2025): no problem! Ill keep open for now, we will see if it fixed it
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#3623