[GH-ISSUE #3438] [BUG]: Error at the time deploying locally in a Nvidia AGX Orin #2220

Closed
opened 2026-02-22 18:28:42 -05:00 by yindo · 2 comments
Owner

Originally created by @kalustian on GitHub (Mar 10, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3438

How are you running AnythingLLM?

Docker (local)

What happened?

I have a AGX Orin with Jetpack 6.2 ( cuda 12.8 / Ubuntu 22.04 / Docker version 28.0.1 ). I followed docker installation I think was sometime in 2024 and it used to work great ( I had ubuntu 20.04 instead ). Now I am deploying again and getting below error:

These are the local commands I ran:

  1. export STORAGE_LOCATION=$HOME/anythingllm && \

  2. mkdir -p $STORAGE_LOCATION && \

  3. touch "$STORAGE_LOCATION/.env" && \

  4. docker run -d -p 3001:3001
    --cap-add SYS_ADMIN
    -v ${STORAGE_LOCATION}:/app/server/storage
    -v ${STORAGE_LOCATION}/.env:/app/server/.env
    -e STORAGE_DIR="/app/server/storage"
    mintplexlabs/anythingllm

I am getting below error:

Image

Any suggestion to fix it ?

Are there known steps to reproduce?

No response

Originally created by @kalustian on GitHub (Mar 10, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3438 ### How are you running AnythingLLM? Docker (local) ### What happened? I have a AGX Orin with Jetpack 6.2 ( cuda 12.8 / Ubuntu 22.04 / Docker version 28.0.1 ). I followed docker installation I think was sometime in 2024 and it used to work great ( I had ubuntu 20.04 instead ). Now I am deploying again and getting below error: **These are the local commands I ran:** 1. export STORAGE_LOCATION=$HOME/anythingllm && \ 2. mkdir -p $STORAGE_LOCATION && \ 3. touch "$STORAGE_LOCATION/.env" && \ 4. docker run -d -p 3001:3001 \ --cap-add SYS_ADMIN \ -v ${STORAGE_LOCATION}:/app/server/storage \ -v ${STORAGE_LOCATION}/.env:/app/server/.env \ -e STORAGE_DIR="/app/server/storage" \ mintplexlabs/anythingllm **I am getting below error:** <img width="1133" alt="Image" src="https://github.com/user-attachments/assets/e2ea7ad1-b7f3-456c-b7a6-0d0cade4034d" /> Any suggestion to fix it ? ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:28:42 -05:00
yindo closed this issue 2026-02-22 18:28:42 -05:00
Author
Owner

@timothycarambat commented on GitHub (Mar 11, 2025):

This is not an issue with AnythingLLM. It has to do with your docker install on the Orin as that is an error coming from the -p 3001:3001 part of the docker runtime where it binds a host port to the container port. There is nothing for use to fix here, you will need to debug more about this issue yourself.

Here is a place to start: https://forums.developer.nvidia.com/t/problems-with-docker-version-28-0-1-on-jetson-orin-nx/325541/6

@timothycarambat commented on GitHub (Mar 11, 2025): This is not an issue with AnythingLLM. It has to do with your docker install on the Orin as that is an error coming from the ` -p 3001:3001` part of the docker runtime where it binds a host port to the container port. There is nothing for use to fix here, you will need to debug more about this issue yourself. Here is a place to start: https://forums.developer.nvidia.com/t/problems-with-docker-version-28-0-1-on-jetson-orin-nx/325541/6
Author
Owner

@kalustian commented on GitHub (Mar 11, 2025):

Hi Tim, thanks for pointing me a place to start with.

@kalustian commented on GitHub (Mar 11, 2025): Hi Tim, thanks for pointing me a place to start with.
yindo changed title from [BUG]: Error at the time deploying locally in a Nvidia AGX Orin to [GH-ISSUE #3438] [BUG]: Error at the time deploying locally in a Nvidia AGX Orin 2026-06-05 14:45:15 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2220