Add Client.close() and context manager #277

New Issue

2026-02-15T16:29:30-05:00

yindo commented

2026-02-15 16:29:30 -05:00

Originally created by @roskakori on GitHub (Jun 11, 2025).

Currently, a client to interact with the Ollama API can be created using

from ollama import Client
client = Client(host='http://localhost:11434', ...)

However, there is no way to close the client and give back the resources it acquired. Eventually, Python's garbage collector will, but it would be nice to be able to do that as early as possible.

From my understanding, adding the following methods to ollama._client.Client would address this:

class Client(BaseClient):
    ...
    def close(self):
        self._client.close()

    def __enter__(self):
        return self

    def __exit__(self, exc_type, exc_value, traceback):
        self.close()
        return False

And then something similar for the AsyncClient.

That way, the client could be used like:

with Client(host='http://localhost:11434', ...) as client:
    client.chat(...)

If you want, I can look into this and prepare a PR.

Update: This should also fix warnings when using ollama-python with pytest:

.../.venv/lib/python3.12/site-packages/_pytest/unraisableexception.py:31: ResourceWarning: unclosed <socket.socket fd=15, family=2, type=1, proto=6, laddr=('127.0.0.1', 64484), raddr=('127.0.0.1', 11434)>
gc.collect()

Originally created by @roskakori on GitHub (Jun 11, 2025). Currently, a client to interact with the Ollama API can be created using ```python from ollama import Client client = Client(host='http://localhost:11434', ...) ``` However, there is no way to close the client and give back the resources it acquired. Eventually, Python's garbage collector will, but it would be nice to be able to do that as early as possible. From my understanding, adding the following methods to `ollama._client.Client` would address this: ```python class Client(BaseClient): ... def close(self): self._client.close() def __enter__(self): return self def __exit__(self, exc_type, exc_value, traceback): self.close() return False ``` And then something similar for the `AsyncClient`. That way, the client could be used like: ```python with Client(host='http://localhost:11434', ...) as client: client.chat(...) ``` If you want, I can look into this and prepare a PR. **Update**: This should also fix warnings when using ollama-python with pytest: > .../.venv/lib/python3.12/site-packages/_pytest/unraisableexception.py:31: ResourceWarning: unclosed <socket.socket fd=15, family=2, type=1, proto=6, laddr=('127.0.0.1', 64484), raddr=('127.0.0.1', 11434)> > gc.collect()

yindo referenced this issue

2026-02-15 16:30:26 -05:00

[PR #277] [MERGED] no head request for create blob #448

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: ollama/ollama-python#277

Add Client.close() and context manager #277

Add `Client.close()` and context manager #277