[GH-ISSUE #4361] [BUG]: NVIDIA NIM - Error importing model #2780

Closed
opened 2026-02-22 18:31:13 -05:00 by yindo · 3 comments
Owner

Originally created by @dp-studio on GitHub (Sep 4, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4361

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Import NIM from NVIDIA does not work! The error message when press Pull Tag: Image

Are there known steps to reproduce?

No response

Originally created by @dp-studio on GitHub (Sep 4, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4361 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Import NIM from NVIDIA does not work! The error message when press Pull Tag: <img width="437" height="197" alt="Image" src="https://github.com/user-attachments/assets/3ac94bb4-b389-4198-b8ca-19177d0ba949" /> ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:31:13 -05:00
yindo closed this issue 2026-02-22 18:31:13 -05:00
Author
Owner

@blakdog64 commented on GitHub (Sep 4, 2025):

Image same issue

@blakdog64 commented on GitHub (Sep 4, 2025): <img width="849" height="952" alt="Image" src="https://github.com/user-attachments/assets/a92f02c9-7cd9-476b-bcdf-18a8c56f0db4" /> same issue
Author
Owner

@timothycarambat commented on GitHub (Sep 8, 2025):

This is an issue with NVIDIA, not our integration. I have pinged them before about this as it has to do with a PSK that is used. Honestly the thing that I have found fixing it was just retrying and then randomly it will pass.

I will bring this to their attention though again just incase maybe we are missing something, but it is indeed intermittent.

@timothycarambat commented on GitHub (Sep 8, 2025): This is an issue with NVIDIA, not our integration. I have pinged them before about this as it has to do with a PSK that is used. Honestly the thing that I have found fixing it was just retrying and then randomly it will pass. I will bring this to their attention though again just incase maybe we are missing something, but it is indeed intermittent.
Author
Owner

@dp-studio commented on GitHub (Sep 16, 2025):

Thank you for the update and for escalating this with NVIDIA. I appreciate you looking into this and sharing your findings. I’ve certainly tried the “retry” approach, and unfortunately, I haven’t had any success with it; it hasn’t worked for me even once.

@dp-studio commented on GitHub (Sep 16, 2025): Thank you for the update and for escalating this with NVIDIA. I appreciate you looking into this and sharing your findings. I’ve certainly tried the “retry” approach, and unfortunately, I haven’t had any success with it; it hasn’t worked for me even once.
yindo changed title from [BUG]: NVIDIA NIM - Error importing model to [GH-ISSUE #4361] [BUG]: NVIDIA NIM - Error importing model 2026-06-05 14:48:30 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2780