anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 10:15:31 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

[PR #3204] fix: use ai-sdk openai chat language model instead of completion language model #10568

New Issue
Closed
opened 2026-02-16 18:15:15 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 18:15:15 -05:00
Owner
Copy Link
Copy Source

Original Pull Request: https://github.com/anomalyco/opencode/pull/3204

State: closed
Merged: Yes

the fix is super small but the reason is kind of interesting.

IIUC, the intention of #2528 was to allow Azure users to hit a chat completions endpoint
(%baseURL%/deployments/%Model%/chat/completions?api-version=%apiVersion%) instead of a responses endpoint.

i work somewhere that currently only has access to a chat completions endpoint, but when i tried this out, the appropriate configuration still errored. i was connecting to the expected endpoint, but AI SDK was complaining that the prompt was invalid.

turns out, both sdk.completion and sdk.chat ultimately hit a /chat/completions endpoint when called here by opencode. however, i'm pretty sure sdk.completion is supposed to hit /completions instead of /chat/completions; i haven't tracked down why, but that's what happens AFAICT.

anyway, the code paths for a chat language model differ a bit from a completion language model. most notably, a completion language model complains if the prompt has more than one system message while a chat language model does not care.

since opencode may include more than one system message, the completions model would complain.

swapping to a chat language model solves this problem. also, i think it's just more accurate with respect to what functionality is supposed to be exposed.

related: #2528 , #1508 , #3150

**Original Pull Request:** https://github.com/anomalyco/opencode/pull/3204 **State:** closed **Merged:** Yes --- the fix is super small but the reason is kind of interesting. IIUC, the intention of #2528 was to allow Azure users to hit a chat completions endpoint (`%baseURL%/deployments/%Model%/chat/completions?api-version=%apiVersion%`) instead of a responses endpoint. i work somewhere that currently only has access to a chat completions endpoint, but when i tried this out, the appropriate configuration still errored. i was connecting to the expected endpoint, but AI SDK was complaining that the prompt was invalid. turns out, both `sdk.completion` and `sdk.chat` ultimately hit a `/chat/completions` endpoint when called here by opencode. however, i'm pretty sure `sdk.completion` is *supposed to* hit `/completions` instead of `/chat/completions`; i haven't tracked down why, but that's what happens AFAICT. anyway, the code paths for a chat language model differ a bit from a completion language model. most notably, a completion language model [complains if the prompt has more than one system message](https://github.com/vercel/ai/blob/34407b23b8c276359ac8dbeb42cc06f9db301b99/packages/openai/src/completion/convert-to-openai-completion-prompt.ts#L31) while a chat language model does not care. since opencode [may include more than one system message](https://github.com/sst/opencode/blob/1c59530115d05e0f18f381023f639accc851825c/packages/opencode/src/session/prompt.ts#L413), the completions model would complain. swapping to a chat language model solves this problem. also, i think it's just more accurate with respect to what functionality is supposed to be exposed. related: #2528 , #1508 , #3150
yindo added the pull-request label 2026-02-16 18:15:15 -05:00
yindo closed this issue 2026-02-16 18:15:15 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#10568
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?