anomalyco/opencode
1
0
Fork 0
mirror of https://github.com/anomalyco/opencode.git synced 2026-07-22 18:25:32 -04:00
Code Issues 5.9k Packages Projects Releases 19 Wiki Activity

[PR #10742] feat(provider): add google-vertex-openai for Vertex AI partner models #13546

New Issue
Closed
opened 2026-02-16 18:18:23 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 18:18:23 -05:00
Owner
Copy Link
Copy Source

Original Pull Request: https://github.com/anomalyco/opencode/pull/10742

State: closed
Merged: No

Summary

Adds custom loader for google-vertex-openai provider to enable Vertex AI partner models (GLM, Llama, Qwen, DeepSeek) via the OpenAI-compatible Chat Completions API endpoint.

Problem

The @ai-sdk/google-vertex SDK only supports Google's Gemini models because it:

  • Hardcodes publishers/google in URL construction
  • Uses v1beta1 API version
  • Expects Gemini-specific API format

Partner models like GLM-4.7, Llama 4, Qwen3, and DeepSeek use a different endpoint:

https://{location}-aiplatform.googleapis.com/v1/projects/{project}/locations/{location}/endpoints/openapi/chat/completions

Solution

Created custom loader for google-vertex-openai provider that:

  • Uses @ai-sdk/openai-compatible (already bundled in OpenCode)
  • Injects Google OAuth tokens via custom fetch wrapper
  • Uses google-auth-library for auto-refreshing tokens (transitive dep of @ai-sdk/google-vertex)
  • Supports both global and regional endpoints
  • Auto-loads when GOOGLE_CLOUD_PROJECT env var is set and credentials are available

Technical Details

Auth Method: Google Application Default Credentials (ADC)

  • Uses GoogleAuth from google-auth-library
  • Scope: https://www.googleapis.com/auth/cloud-platform
  • Tokens auto-refresh 5 minutes before expiry

Endpoint Construction:

  • Global: https://aiplatform.googleapis.com/v1/projects/{project}/locations/global/endpoints/openapi
  • Regional: https://{location}-aiplatform.googleapis.com/v1/projects/{project}/locations/{location}/endpoints/openapi

Implementation Pattern:
Follows the same pattern as google-vertex-anthropic loader - custom SDK with OAuth injection.

Models Supported

Models are defined in companion PR: anomalyco/models.dev#716

  • GLM-4.7 (zai-org)
  • Llama 4 Maverick 17B-128E (meta)
  • Llama 3.3 70B (meta)
  • Qwen3 235B Instruct (qwen)
  • DeepSeek V3.1 (deepseek-ai)

Testing

Requires:

  • GOOGLE_CLOUD_PROJECT environment variable
  • Google Application Default Credentials: gcloud auth application-default login
  • Models enabled in Google Cloud Console (Model Garden)

Test command:

export GOOGLE_CLOUD_PROJECT=your-project-id
export GOOGLE_CLOUD_LOCATION=global  # or regional like us-central1
opencode
# Select: google-vertex-openai/glm-4.7-maas

Related PRs

References

**Original Pull Request:** https://github.com/anomalyco/opencode/pull/10742 **State:** closed **Merged:** No --- ## Summary Adds custom loader for `google-vertex-openai` provider to enable Vertex AI partner models (GLM, Llama, Qwen, DeepSeek) via the OpenAI-compatible Chat Completions API endpoint. ## Problem The `@ai-sdk/google-vertex` SDK only supports Google's Gemini models because it: - Hardcodes `publishers/google` in URL construction - Uses `v1beta1` API version - Expects Gemini-specific API format Partner models like GLM-4.7, Llama 4, Qwen3, and DeepSeek use a different endpoint: ``` https://{location}-aiplatform.googleapis.com/v1/projects/{project}/locations/{location}/endpoints/openapi/chat/completions ``` ## Solution Created custom loader for `google-vertex-openai` provider that: - Uses `@ai-sdk/openai-compatible` (already bundled in OpenCode) - Injects Google OAuth tokens via custom fetch wrapper - Uses `google-auth-library` for auto-refreshing tokens (transitive dep of `@ai-sdk/google-vertex`) - Supports both global and regional endpoints - Auto-loads when `GOOGLE_CLOUD_PROJECT` env var is set and credentials are available ## Technical Details **Auth Method**: Google Application Default Credentials (ADC) - Uses `GoogleAuth` from `google-auth-library` - Scope: `https://www.googleapis.com/auth/cloud-platform` - Tokens auto-refresh 5 minutes before expiry **Endpoint Construction**: - Global: `https://aiplatform.googleapis.com/v1/projects/{project}/locations/global/endpoints/openapi` - Regional: `https://{location}-aiplatform.googleapis.com/v1/projects/{project}/locations/{location}/endpoints/openapi` **Implementation Pattern**: Follows the same pattern as `google-vertex-anthropic` loader - custom SDK with OAuth injection. ## Models Supported Models are defined in companion PR: anomalyco/models.dev#716 - GLM-4.7 (zai-org) - Llama 4 Maverick 17B-128E (meta) - Llama 3.3 70B (meta) - Qwen3 235B Instruct (qwen) - DeepSeek V3.1 (deepseek-ai) ## Testing Requires: - `GOOGLE_CLOUD_PROJECT` environment variable - Google Application Default Credentials: `gcloud auth application-default login` - Models enabled in Google Cloud Console (Model Garden) Test command: ```bash export GOOGLE_CLOUD_PROJECT=your-project-id export GOOGLE_CLOUD_LOCATION=global # or regional like us-central1 opencode # Select: google-vertex-openai/glm-4.7-maas ``` ## Related PRs - anomalyco/models.dev#716 - Model definitions for google-vertex-openai provider ## References - [Google Cloud: Call MaaS APIs for open models](https://cloud.google.com/vertex-ai/generative-ai/docs/maas/call-open-model-apis) - [Google Cloud: OpenAI compatibility](https://cloud.google.com/vertex-ai/generative-ai/docs/start/openai)
yindo added the pull-request label 2026-02-16 18:18:23 -05:00
yindo closed this issue 2026-02-16 18:18:23 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acp
bad
bug
discussion
docs
documentation
enhancement
extension
good first issue
growth
help-wanted
mcp
model-problem
needs:compliance
nix
opentui
perf
pull-request
Mirrored from GitHub Pull Request
 tui
web
windows
zen
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#13546
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?