how to use my own local deployed model by vllm or ollama #7179

Closed
opened 2026-02-16 18:06:24 -05:00 by yindo · 2 comments
Owner

Originally created by @ioou on GitHub (Jan 22, 2026).

Originally assigned to: @thdxr on GitHub.

Question

how to use my own local deployed model by vllm or ollama

Originally created by @ioou on GitHub (Jan 22, 2026). Originally assigned to: @thdxr on GitHub. ### Question how to use my own local deployed model by vllm or ollama
yindo added the docs label 2026-02-16 18:06:24 -05:00
yindo closed this issue 2026-02-16 18:06:24 -05:00
Author
Owner

@github-actions[bot] commented on GitHub (Jan 22, 2026):

This issue might be a duplicate of existing issues. Please check:

  • #7185: When use gpt-oss-120B by vLLM locally, opencode doesn't call the tools
  • #7083: Using local Ollama models doesnt return any results.
  • #7078: Use local LLM via Ollama on desktop
  • #4428: Why is opencode not working with local llms via Ollama?
  • #7444: Does "OpenCode Desktop" currently support connecting to local ollama models?
  • #7488: Mistral models fail with "Unexpected role 'user' after role 'tool'" error on custom hosted vLLM endpoint.
  • #7486: Only return tool_call parameters but can not run the tool with local LLM

Feel free to ignore if none of these address your specific case.

@github-actions[bot] commented on GitHub (Jan 22, 2026): This issue might be a duplicate of existing issues. Please check: - #7185: When use gpt-oss-120B by vLLM locally, opencode doesn't call the tools - #7083: Using local Ollama models doesnt return any results. - #7078: Use local LLM via Ollama on desktop - #4428: Why is opencode not working with local llms via Ollama? - #7444: Does "OpenCode Desktop" currently support connecting to local ollama models? - #7488: Mistral models fail with "Unexpected role 'user' after role 'tool'" error on custom hosted vLLM endpoint. - #7486: Only return tool_call parameters but can not run the tool with local LLM Feel free to ignore if none of these address your specific case.
Author
Owner

@justfortheloveof commented on GitHub (Jan 22, 2026):

Check the docs
https://opencode.ai/docs/providers/#custom-provider
https://opencode.ai/docs/providers/#ollama

@justfortheloveof commented on GitHub (Jan 22, 2026): Check the docs https://opencode.ai/docs/providers/#custom-provider https://opencode.ai/docs/providers/#ollama
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: anomalyco/opencode#7179