[Feature]: Allow for custom llm proxies #18

New Issue

2026-02-16T09:17:48-05:00

yindo commented

2026-02-16 09:17:48 -05:00

Originally created by @0xthc on GitHub (Jan 24, 2026).

Problem Statement

I would like to be able to go through a proxy instead of direct providers APIs

Proposed Solution

export interface ModelConfig {
  id: string
  name: string
  provider: ProviderId
  model: string
  description?: string
  available: boolean
  base_url?: string  // Add this
  custom?: boolean    // Add this to identify custom models
}

function getModelInstance(
  modelId?: string,
  customConfig?: { base_url?: string }
): ChatAnthropic | ChatOpenAI | ChatGoogleGenerativeAI | string {
  const model = modelId || getDefaultModel()
  
  if (model.startsWith("claude")) {
    const apiKey = getApiKey("anthropic") || "dummy-not-used"
    
    const config: any = {
      model,
      anthropicApiKey: apiKey
    }
    
    // Add base URL if provided
    if (customConfig?.base_url) {
      config.clientOptions = {
        baseURL: customConfig.base_url
      }
    }
    
    return new ChatAnthropic(config)
  }
  // ... rest of the function
}

Use Case

I have proxies already setup for internal gateways

Originally created by @0xthc on GitHub (Jan 24, 2026). ## Problem Statement I would like to be able to go through a proxy instead of direct providers APIs ## Proposed Solution ```typescript export interface ModelConfig { id: string name: string provider: ProviderId model: string description?: string available: boolean base_url?: string // Add this custom?: boolean // Add this to identify custom models } function getModelInstance( modelId?: string, customConfig?: { base_url?: string } ): ChatAnthropic | ChatOpenAI | ChatGoogleGenerativeAI | string { const model = modelId || getDefaultModel() if (model.startsWith("claude")) { const apiKey = getApiKey("anthropic") || "dummy-not-used" const config: any = { model, anthropicApiKey: apiKey } // Add base URL if provided if (customConfig?.base_url) { config.clientOptions = { baseURL: customConfig.base_url } } return new ChatAnthropic(config) } // ... rest of the function } ``` ## Use Case I have proxies already setup for internal gateways

yindo added the enhancement label 2026-02-16 09:17:48 -05:00

yindo referenced this issue

2026-02-16 09:17:51 -05:00

[PR #18] [CLOSED] Fix linter errors in backend & main process #31

yindo referenced this issue

2026-02-16 09:17:51 -05:00

[PR #19] [CLOSED] Fix linter errors in shadcn/ui components #32

yindo referenced this issue

2026-02-16 09:17:51 -05:00

[PR #20] [CLOSED] Fix linter errors in feature components #33

yindo referenced this issue

2026-02-16 09:17:51 -05:00