anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-23 02:36:57 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

[FEATURE]: Support endpoint /v1/responses for xAI Providers #2576

New Issue
Open
opened 2026-02-16 17:36:17 -05:00 by yindo · 10 comments
yindo commented 2026-02-16 17:36:17 -05:00
Owner
Copy Link
Copy Source

Originally created by @H0llyW00dzZ on GitHub (Nov 4, 2025).

Feature hasn't been suggested before.

  • I have verified this feature I'm about to request hasn't been suggested before.

Describe the enhancement you want to request

I'd like to request the addition of a new API endpoint /v1/responses specifically tailored for xAI providers (e.g., integrating with Grok or other xAI models). This endpoint would allow developers to generate and retrieve responses from xAI models in a standardized way, similar to existing endpoints like /v1/chat/completions but optimized for xAI's unique capabilities.

What do I want to change or add?
Currently, xAI integrations might rely on custom wrappers or indirect calls to existing OpenAI-compatible endpoints, which can lead to inconsistencies or limitations when leveraging xAI-specific features. Adding /v1/responses would provide a dedicated, provider-specific path that supports:

  • Request Format: JSON payload similar to chat completions, e.g.:
{
  "input": [
    {
      "role": "system",
      "content": "You are a helpful assistant that can answer questions and help with tasks."
    },
    {
      "role": "user",
      "content": "What is 101*3?"
    }
  ],
  "model": "grok-4-0709"
}
  • Response Format: Standardized JSON with fields like id, object ("response"), created, model, choices (array with message containing role and content), and usage (prompt/completion tokens). For streaming, it would use Server-Sent Events (SSE).
  • Authentication: API key-based, with rate limiting aligned to xAI tiers (e.g., 10k RPM for free tier).

Benefits of implementing this:

  1. Easier Integration: Developers building multi-provider apps (e.g., using LangChain or Vercel AI SDK) could seamlessly switch to xAI without refactoring code, promoting xAI adoption.
Originally created by @H0llyW00dzZ on GitHub (Nov 4, 2025). ### Feature hasn't been suggested before. - [x] I have verified this feature I'm about to request hasn't been suggested before. ### Describe the enhancement you want to request I'd like to request the addition of a new API endpoint `/v1/responses` specifically tailored for xAI providers (e.g., integrating with Grok or other xAI models). This endpoint would allow developers to generate and retrieve responses from xAI models in a standardized way, similar to existing endpoints like `/v1/chat/completions` but optimized for xAI's unique capabilities. **What do I want to change or add?** Currently, xAI integrations might rely on custom wrappers or indirect calls to existing OpenAI-compatible endpoints, which can lead to inconsistencies or limitations when leveraging xAI-specific features. Adding `/v1/responses` would provide a dedicated, provider-specific path that supports: - **Request Format**: JSON payload similar to chat completions, e.g.: ```json { "input": [ { "role": "system", "content": "You are a helpful assistant that can answer questions and help with tasks." }, { "role": "user", "content": "What is 101*3?" } ], "model": "grok-4-0709" } ``` - **Response Format**: Standardized JSON with fields like `id`, `object` ("response"), `created`, `model`, `choices` (array with `message` containing `role` and `content`), and `usage` (prompt/completion tokens). For streaming, it would use Server-Sent Events (SSE). - **Authentication**: API key-based, with rate limiting aligned to xAI tiers (e.g., 10k RPM for free tier). **Benefits of implementing this:** 1. **Easier Integration**: Developers building multi-provider apps (e.g., using LangChain or Vercel AI SDK) could seamlessly switch to xAI without refactoring code, promoting xAI adoption.
yindo added the discussion label 2026-02-16 17:36:17 -05:00
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@mirbasit01 commented on GitHub (Nov 4, 2025):

That’s a great suggestion!
Adding /v1/responses specifically for xAI models would make integrations cleaner and consistent across providers.
It could also simplify migration from OpenAI-compatible APIs — I’d love to see token usage tracking included in the response format.

@mirbasit01 commented on GitHub (Nov 4, 2025): That’s a great suggestion! Adding `/v1/responses` specifically for xAI models would make integrations cleaner and consistent across providers. It could also simplify migration from OpenAI-compatible APIs — I’d love to see token usage tracking included in the response format.
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 4, 2025):

I think this is already possible you just need to specify the settings in your opencode.json (like baseurl / api) and hook it up to the openai vercel ai sdk provider

@rekram1-node commented on GitHub (Nov 4, 2025): I think this is already possible you just need to specify the settings in your opencode.json (like baseurl / api) and hook it up to the openai vercel ai sdk provider
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@junmediatek commented on GitHub (Nov 10, 2025):

I think this is already possible you just need to specify the settings in your opencode.json (like baseurl / api) and hook it up to the openai vercel ai sdk provider

@rekram1-node how do config in the opencode.json file?

@junmediatek commented on GitHub (Nov 10, 2025): > I think this is already possible you just need to specify the settings in your opencode.json (like baseurl / api) and hook it up to the openai vercel ai sdk provider @rekram1-node how do config in the opencode.json file?
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 10, 2025):

@junmediatek this goes over it: https://opencode.ai/docs/providers/#custom-provider

And you'd need to use an ai sdk package that supports responses api, rn I think that is only @ai-sdk/openai

@rekram1-node commented on GitHub (Nov 10, 2025): @junmediatek this goes over it: https://opencode.ai/docs/providers/#custom-provider And you'd need to use an ai sdk package that supports responses api, rn I think that is only `@ai-sdk/openai`
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@junmediatek commented on GitHub (Nov 10, 2025):

https://opencode.ai/docs/providers/#custom-provider

@rekram1-node I have config the opencode.json with "npm": "@ai-sdk/openai", however, it does not work, how to config it for /v1/responses flow in the opencode?

@junmediatek commented on GitHub (Nov 10, 2025): > https://opencode.ai/docs/providers/#custom-provider @rekram1-node I have config the opencode.json with "npm": "@ai-sdk/openai", however, it does not work, how to config it for /v1/responses flow in the opencode?
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 10, 2025):

@junmediatek you're gonna have to show me your config for me to help more I think

@rekram1-node commented on GitHub (Nov 10, 2025): @junmediatek you're gonna have to show me your config for me to help more I think
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@junmediatek commented on GitHub (Nov 10, 2025):

{
"$schema": "https://opencode.ai/config.json",
"provider": {
"gaisf": {
"npm": "@ai-sdk/openai-compatible",
"name": "gaisf openai",
"options": {
"baseURL": "https://xxx.xxxx.inc/v1"
},
"models": {
"azure/gpt-5": {
"name": "gpt-5"
},
"azure/aide-gpt-4.1": {
"name": "gpt-4.1"
}
}
}
}
}

@rekram1-node could you help me?

@junmediatek commented on GitHub (Nov 10, 2025): { "$schema": "https://opencode.ai/config.json", "provider": { "gaisf": { "npm": "@ai-sdk/openai-compatible", "name": "gaisf openai", "options": { "baseURL": "https://xxx.xxxx.inc/v1" }, "models": { "azure/gpt-5": { "name": "gpt-5" }, "azure/aide-gpt-4.1": { "name": "gpt-4.1" } } } } } @rekram1-node could you help me?
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@rekram1-node commented on GitHub (Nov 10, 2025):

@junmediatek what error / issue are u seeing waht is this provider? Ive never seen it

@rekram1-node commented on GitHub (Nov 10, 2025): @junmediatek what error / issue are u seeing waht is this provider? Ive never seen it
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@junmediatek commented on GitHub (Nov 10, 2025):

2025-11-10T060322.log

@rekram1-node error log

@junmediatek commented on GitHub (Nov 10, 2025): [2025-11-10T060322.log](https://github.com/user-attachments/files/23446861/2025-11-10T060322.log) @rekram1-node error log
yindo commented 2026-02-16 17:36:18 -05:00
Author
Owner
Copy Link
Copy Source

@junmediatek commented on GitHub (Nov 10, 2025):

@rekram1-node I have find the root cause, the model name is wrong, change the model to the gpt-5, it work fine

@junmediatek commented on GitHub (Nov 10, 2025): @rekram1-node I have find the root cause, the model name is wrong, change the model to the gpt-5, it work fine
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label discussion
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#2576
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?