mirror of
https://github.com/ollama/ollama-python.git
synced 2026-07-21 09:05:23 -04:00
Is there a command that just serves the REST api , similar to ollama run on the cli #6
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @gregnwosu on GitHub (Jan 24, 2024).
I want to serve the API from python in a similar way as
maybe that returns a server reference that can be used to shutdown the model once done.
Happy to contribute if there is a need
@furqanalishah commented on GitHub (Jan 25, 2024):
@gregnwosu thanks.
Could please tell us about a use case when you would need it?
@mxyng commented on GitHub (Jan 25, 2024):
This project is intended to be a thin client library for the Ollama API. A running ollama instance is required. You can change which instance the library uses by manually creating a client
ollama.Client(host='')or by settingOLLAMA_HOST