[GH-ISSUE #2076] [BUG]: Can't download Llama3.1 8B #1352

Closed
opened 2026-02-22 18:24:23 -05:00 by yindo · 4 comments
Owner

Originally created by @greanleaf on GitHub (Aug 8, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2076

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

In the latest versions that have Llama 3.1 8B as an option for the AnythinLLM LLM provider, it gets stuck downloading and never progresses. I've tried this on two different Macbooks on two different networks and get the same result.

image

Are there known steps to reproduce?

  1. Go to settings
  2. Go to AI providers
  3. Go to LLM
  4. Select AnythingLLM as the LLM provider
  5. Select Llama3.1 8B
  6. Click Save Changes

After this, you get a popup that it has started downloading, and the top right of the window reflects this, however it never actually starts downloading (I check via a network monitor) and never progresses. Other models download and load just fine.

In also tried completely removing and installing AnythingLLM (including all of the stuff stored in ~/Library) so that it is a completely fresh install. It made no difference.

Originally created by @greanleaf on GitHub (Aug 8, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2076 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? In the latest versions that have Llama 3.1 8B as an option for the AnythinLLM LLM provider, it gets stuck downloading and never progresses. I've tried this on two different Macbooks on two different networks and get the same result. <img width="1440" alt="image" src="https://github.com/user-attachments/assets/e739ea2f-24f6-40b7-bc3b-17caacf7521a"> ### Are there known steps to reproduce? 1. Go to settings 2. Go to AI providers 3. Go to LLM 4. Select AnythingLLM as the LLM provider 5. Select Llama3.1 8B 6. Click Save Changes After this, you get a popup that it has started downloading, and the top right of the window reflects this, however it never actually starts downloading (I check via a network monitor) and never progresses. Other models download and load just fine. In also tried completely removing and installing AnythingLLM (including all of the stuff stored in ~/Library) so that it is a completely fresh install. It made no difference.
yindo added the possible bug label 2026-02-22 18:24:23 -05:00
yindo closed this issue 2026-02-22 18:24:23 -05:00
Author
Owner

@codemonkey2k5 commented on GitHub (Aug 8, 2024):

Having the same issue. A progress bar would be extremely helpful and save folks a lot of time waiting for nothing to happen.

@codemonkey2k5 commented on GitHub (Aug 8, 2024): Having the same issue. A progress bar would be extremely helpful and save folks a lot of time waiting for nothing to happen.
Author
Owner

@BHMSI commented on GitHub (Aug 9, 2024):

I am having this issue on M1 Mac and can't cancel the download of the model, so ALLM is completely stuck. I can't cancel the download, change models, etc. I tried restarting the app, reinstalling, etc. No joy. -- Update: Rebooting machine, and then cancelling worked on stopping the download, and let me select and download a different model.

@BHMSI commented on GitHub (Aug 9, 2024): I am having this issue on M1 Mac and can't cancel the download of the model, so ALLM is completely stuck. I can't cancel the download, change models, etc. I tried restarting the app, reinstalling, etc. No joy. -- Update: Rebooting machine, and then cancelling worked on stopping the download, and let me select and download a different model.
Author
Owner

@shatfield4 commented on GitHub (Aug 9, 2024):

We've just pushed a bug fix for this, please update to the latest version and this is patched.

@shatfield4 commented on GitHub (Aug 9, 2024): We've just pushed a bug fix for this, please update to the latest version and this is patched.
Author
Owner

@max38tech commented on GitHub (Jul 1, 2025):

Having the same issue. A progress bar would be extremely helpful and save folks a lot of time waiting for nothing to happen.

AMEN!! It's a no-brainer.

@max38tech commented on GitHub (Jul 1, 2025): > Having the same issue. A progress bar would be extremely helpful and save folks a lot of time waiting for nothing to happen. AMEN!! It's a no-brainer.
yindo changed title from [BUG]: Can't download Llama3.1 8B to [GH-ISSUE #2076] [BUG]: Can't download Llama3.1 8B 2026-06-05 14:40:17 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1352