mirror of
https://github.com/Mintplex-Labs/anythingllm-docs.git
synced 2026-07-21 09:15:22 -04:00
[GH-ISSUE #66] Feedback for “v1.5.8” and multi GPU support #34
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @PepsiBlue14 on GitHub (Jul 22, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anythingllm-docs/issues/66
Hello! I'm working on getting multiple gpus going for my instance of anythingllm. I saw the update for automatic gpu support for NVIDIA, but I'm curious if that will utilize multiple GPUs?
@timothycarambat commented on GitHub (Jul 22, 2024):
Since we use Ollama internally for the built-in LLM - there should be nothing special required on your end to use the cluster/multi-gpu setup https://github.com/ollama/ollama/issues/2672
Feedback for “v1.5.8” and multi GPU supportto [GH-ISSUE #66] Feedback for “v1.5.8” and multi GPU support