Setting which GPU to use with PyTorch #29

Open
opened 2026-02-15 16:27:34 -05:00 by yindo · 1 comment
Owner

Originally created by @merlinlikethewizard on GitHub (Feb 13, 2024).

Is there a way (or could there be) to select which GPU to run on when generating chat responses?

Originally created by @merlinlikethewizard on GitHub (Feb 13, 2024). Is there a way (or could there be) to select which GPU to run on when generating chat responses?
Author
Owner

@mxyng commented on GitHub (Mar 4, 2024):

This library doesn't use pytorch so I'm not sure what you're asking

@mxyng commented on GitHub (Mar 4, 2024): This library doesn't use pytorch so I'm not sure what you're asking
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#29