[GH-ISSUE #3048] [BUG]: llama runner process has terminated: error:unknown argument: runner #1952

Closed
opened 2026-02-22 18:27:23 -05:00 by yindo · 3 comments
Owner

Originally created by @onlineapps-cloud on GitHub (Jan 29, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3048

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

hi, insalled anythingllm on windows, download Llama3.2 3B 2.0GB, when i want to write prompt i get error:

Image

Are there known steps to reproduce?

install software
download needed LLM
try to chat

Originally created by @onlineapps-cloud on GitHub (Jan 29, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3048 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? hi, insalled anythingllm on windows, download Llama3.2 3B 2.0GB, when i want to write prompt i get error: ![Image](https://github.com/user-attachments/assets/0c4e72bb-8593-4c00-a312-d8b68a7572c1) ### Are there known steps to reproduce? install software download needed LLM try to chat
yindo added the possible bugneeds info / can't replicateOS: Windows labels 2026-02-22 18:27:23 -05:00
yindo closed this issue 2026-02-22 18:27:23 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jan 29, 2025):

I will need some more details about your machine:

  • OS (windows 7, 10,11, etc)
  • CPU
  • Does this machine have a GPU
  • RAM availability
  • Is this a VM and/or using Proxmox?

Possibly related: https://github.com/ollama/ollama/issues/845

@timothycarambat commented on GitHub (Jan 29, 2025): I will need some more details about your machine: - OS (windows 7, 10,11, etc) - CPU - Does this machine have a GPU - RAM availability - Is this a VM and/or using Proxmox? Possibly related: https://github.com/ollama/ollama/issues/845
Author
Owner

@onlineapps-cloud commented on GitHub (Jan 29, 2025):

hi

  • Windows 10.
  • CPU: 12 x AMD Ryzen 5 5500.
  • GPU: Nvidia geforce 1070 (8GB).
  • RAM availability: 16 GB.
  • VM is running in proxmox

i used additionally args for some games that don't want to run in virtual environment.

args: -cpu host,hypervisor=off,vmware-cpuid-freq=false,enforce=false,host-phys-bits=true -smbios type=0,vendor="American Megatrends International LLC.",version=H3.7G,date='02/21/2023',release=3.7 -smbios type=1,manufacturer="Maxsun",product="MS-Terminator B760M",version="VER:H3.7G(2022/11/29)",serial="Default string",sku="Default string",family="Default string" -smbios type=2,manufacturer="Maxsun",product="MS-Terminator B760M",version="VER:H3.7G(2022/11/29)",serial="Default string",asset="Default string",location="Default string" -smbios type=3,manufacturer="Default string",version="Default string",serial="Default string",asset="Default string",sku="Default string" -smbios type=17,loc_pfx="Controller0-ChannelA-DIMM",manufacturer="KINGSTON",speed=3200,serial=DF1EC466,part="SED3200U1888S",bank="BANK 0",asset="9876543210" -smbios type=4,sock_pfx="LGA1700",manufacturer="Intel(R) Corporation",version="12th Gen Intel(R) Core(TM) i7-12700",max-speed=4900,current-speed=3800,serial="To Be Filled By O.E.M.",asset="To Be Filled By O.E.M.",part="To Be Filled By O.E.M." -smbios type=8,internal_reference="CPU FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=8,internal_reference="J3C1 - GMCH FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=8,internal_reference="J2F1 - LAI FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=11,value="Default string" -smbios type=9
balloon: 0
boot: order=scsi0
cores: 12
cpu: host
hostpci0: 0000:01:00,pcie=1
kvm: 1
machine: pc-q35-9.0
memory: 16384
meta: creation-qemu=9.0.2,ctime=1724425168
name: Windows 10
net0: virtio=BC:24:11:DB:19:43,bridge=vmbr0,firewall=1
numa: 1
ostype: win10
scsi0: nvme:100/vm-100-disk-0.qcow2,aio=threads,iothread=1,size=100G
scsihw: virtio-scsi-single
smbios1: uuid=4ac666fb-73dd-4574-a782-32e02301177b
sockets: 1
usb0: host=152d:0583,usb3=1
usb1: host=0d8c:0014,usb3=1
vmgenid: efba5d7d-140a-4137-bbf6-ab93101a6522
@onlineapps-cloud commented on GitHub (Jan 29, 2025): hi - Windows 10. - CPU: 12 x AMD Ryzen 5 5500. - GPU: Nvidia geforce 1070 (8GB). - RAM availability: 16 GB. - VM is running in proxmox i used additionally args for some games that don't want to run in virtual environment. ``` args: -cpu host,hypervisor=off,vmware-cpuid-freq=false,enforce=false,host-phys-bits=true -smbios type=0,vendor="American Megatrends International LLC.",version=H3.7G,date='02/21/2023',release=3.7 -smbios type=1,manufacturer="Maxsun",product="MS-Terminator B760M",version="VER:H3.7G(2022/11/29)",serial="Default string",sku="Default string",family="Default string" -smbios type=2,manufacturer="Maxsun",product="MS-Terminator B760M",version="VER:H3.7G(2022/11/29)",serial="Default string",asset="Default string",location="Default string" -smbios type=3,manufacturer="Default string",version="Default string",serial="Default string",asset="Default string",sku="Default string" -smbios type=17,loc_pfx="Controller0-ChannelA-DIMM",manufacturer="KINGSTON",speed=3200,serial=DF1EC466,part="SED3200U1888S",bank="BANK 0",asset="9876543210" -smbios type=4,sock_pfx="LGA1700",manufacturer="Intel(R) Corporation",version="12th Gen Intel(R) Core(TM) i7-12700",max-speed=4900,current-speed=3800,serial="To Be Filled By O.E.M.",asset="To Be Filled By O.E.M.",part="To Be Filled By O.E.M." -smbios type=8,internal_reference="CPU FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=8,internal_reference="J3C1 - GMCH FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=8,internal_reference="J2F1 - LAI FAN",external_reference="Not Specified",connector_type=0xFF,port_type=0xFF -smbios type=11,value="Default string" -smbios type=9 balloon: 0 boot: order=scsi0 cores: 12 cpu: host hostpci0: 0000:01:00,pcie=1 kvm: 1 machine: pc-q35-9.0 memory: 16384 meta: creation-qemu=9.0.2,ctime=1724425168 name: Windows 10 net0: virtio=BC:24:11:DB:19:43,bridge=vmbr0,firewall=1 numa: 1 ostype: win10 scsi0: nvme:100/vm-100-disk-0.qcow2,aio=threads,iothread=1,size=100G scsihw: virtio-scsi-single smbios1: uuid=4ac666fb-73dd-4574-a782-32e02301177b sockets: 1 usb0: host=152d:0583,usb3=1 usb1: host=0d8c:0014,usb3=1 vmgenid: efba5d7d-140a-4137-bbf6-ab93101a6522 ```
Author
Owner

@timothycarambat commented on GitHub (Jan 29, 2025):

All looks good the only things that I would think possibly become an issue are:

GPU: Nvidia geforce 1070 (8GB).

This is quite low for VRAM, but Ollama does support this card so you should be okay. However models may be offloading to CPU/RAM depending on the model. 3B is smaller, so it might fit.

VM is running in proxmox

This is very likely the culprit. Proxmox for whatever reason is the source of many runtime issues with ollama and other software due to lacking AVX instructions

Basically, the CPU cannot run the software because it lacks the instruction set.

@timothycarambat commented on GitHub (Jan 29, 2025): All looks good the only things that I would think possibly become an issue are: > GPU: Nvidia geforce 1070 (8GB). This is quite low for VRAM, but [Ollama does support this card](https://github.com/ollama/ollama/blob/main/docs/gpu.md) so you should be okay. However models may be offloading to CPU/RAM depending on the model. 3B is smaller, so it _might_ fit. > VM is running in proxmox This is very likely the culprit. Proxmox for whatever reason is the source of many runtime issues with ollama and other software due to [lacking AVX instructions](https://github.com/ollama/ollama/issues/1503#issuecomment-1854384533) Basically, the CPU cannot run the software because it lacks the instruction set.
yindo changed title from [BUG]: llama runner process has terminated: error:unknown argument: runner to [GH-ISSUE #3048] [BUG]: llama runner process has terminated: error:unknown argument: runner 2026-06-05 14:43:38 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1952