ollama/ollama-python
1
0
Fork 0
mirror of https://github.com/ollama/ollama-python.git synced 2026-07-21 09:05:23 -04:00
Code Issues 101 Packages Projects Releases 10 Wiki Activity

Unable to set environment variables - OLLAMA_NUM_PARALLEL, OLLAMA_NUM_GPU, and OLLAMA_NUM_THREAD #195

New Issue
Open
opened 2026-02-15 16:28:38 -05:00 by yindo · 3 comments
yindo commented 2026-02-15 16:28:38 -05:00
Owner
Copy Link
Copy Source

Originally created by @harshachopra507 on GitHub (Dec 31, 2024).

I have set os.environ["OLLAMA_NUM_PARALLEL"] = "4" through python script, but it is not running parallely 4 LLM requests.

Please help me with this issue.

Originally created by @harshachopra507 on GitHub (Dec 31, 2024). I have set os.environ["OLLAMA_NUM_PARALLEL"] = "4" through python script, but it is not running parallely 4 LLM requests. Please help me with this issue.
yindo commented 2026-02-15 16:28:39 -05:00
Author
Owner
Copy Link
Copy Source

@ParthSareen commented on GitHub (Jan 21, 2025):

Could you show the snippet of code you're making requests with?

@ParthSareen commented on GitHub (Jan 21, 2025): Could you show the snippet of code you're making requests with?
yindo commented 2026-02-15 16:28:39 -05:00
Author
Owner
Copy Link
Copy Source

@ckuethe commented on GitHub (Apr 12, 2025):

@harshachopra507 those OLLAMA_ environment variables are for the server and are not passed from the python client. Set them the appropriate technique for the way you start ollama serve - in the dockerfile, docker run command, or systemd unit.

@ckuethe commented on GitHub (Apr 12, 2025): @harshachopra507 those `OLLAMA_` environment variables are for the server and are not passed from the python client. Set them the appropriate technique for the way you start `ollama serve` - in the dockerfile, docker run command, or systemd unit.
yindo commented 2026-02-15 16:28:39 -05:00
Author
Owner
Copy Link
Copy Source

@pataquets commented on GitHub (Jun 25, 2025):

Issue gardening.
@harshachopra507: did it work? Can the issue be closed? (let's keep the issue list tidy to help maintainers)

@pataquets commented on GitHub (Jun 25, 2025): Issue gardening. @harshachopra507: did it work? Can the issue be closed? (let's keep the issue list tidy to help maintainers)
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
enhancement
pull-request
Mirrored from GitHub Pull Request
 thinking
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#195
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?