Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1834] [BUG]: embedding error，but i dont know why #1193

New Issue
Closed
opened 2026-02-22 18:23:38 -05:00 by yindo · 8 comments
yindo commented 2026-02-22 18:23:38 -05:00
Owner
Copy Link
Copy Source

Originally created by @o85757o on GitHub (Jul 9, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1834

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

Error: 1 documents failed to add.
Could not embed document chunks! This document will not be recorded.

Failed to add batches to table list: lance error: LanceError(Arrow): Invalid argument error: Values length 768 is less than the length (3584) multiplied by the value size (3584) for FixedSizeList(Field { name: "item", data_type: Float32, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }, 3584), C:\Users\runneradmin.cargo\registry\src\index.crates.io-6f17d22bba15001f\lance-datafusion-0.12.1\src\utils.rs:41:28

Failed to add batches to table zhai: lance error: LanceError(Arrow): Invalid argument error: Values length 2570496 is less than the length (3584) multiplied by the value size (3584) for FixedSizeList(Field { name: "item", data_type: Float32, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }, 3584)

Are there known steps to reproduce?

No response

Originally created by @o85757o on GitHub (Jul 9, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1834 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? Error: 1 documents failed to add. Could not embed document chunks! This document will not be recorded. Failed to add batches to table list: lance error: LanceError(Arrow): Invalid argument error: Values length 768 is less than the length (3584) multiplied by the value size (3584) for FixedSizeList(Field { name: "item", data_type: Float32, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }, 3584), C:\Users\runneradmin\.cargo\registry\src\index.crates.io-6f17d22bba15001f\lance-datafusion-0.12.1\src\utils.rs:41:28 Failed to add batches to table zhai: lance error: LanceError(Arrow): Invalid argument error: Values length 2570496 is less than the length (3584) multiplied by the value size (3584) for FixedSizeList(Field { name: "item", data_type: Float32, nullable: true, dict_id: 0, dict_is_ordered: false, metadata: {} }, 3584) ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:23:38 -05:00
yindo closed this issue 2026-02-22 18:23:38 -05:00
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@o85757o commented on GitHub (Jul 9, 2024):

i just reinstall

@o85757o commented on GitHub (Jul 9, 2024): i just reinstall
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@saulwang83 commented on GitHub (Jul 19, 2024):

v
the same bug

@saulwang83 commented on GitHub (Jul 19, 2024): ![v](https://github.com/user-attachments/assets/3c33859b-db1b-4cdf-b54d-849ff748a542) the same bug
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@guhao17 commented on GitHub (Jul 22, 2024):

the same bug，how to do

@guhao17 commented on GitHub (Jul 22, 2024): the same bug，how to do
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jul 22, 2024):

This error occurs when you have changed your embedders and are attempting to use a previously embed file that was using a different embedder. At least this is the only way i have ever been able to replicate the bug, you should not change your embedders when you have content already embed because the dimensionality mismatch causes this.

If this is not the case let me know how you got to this stage and also what embedder you are using

@timothycarambat commented on GitHub (Jul 22, 2024): This error occurs when you have changed your embedders and are attempting to use a previously embed file that was using a different embedder. At least this is the only way i have ever been able to replicate the bug, you should not change your embedders when you have content already embed because the dimensionality mismatch causes this. If this is not the case let me know how you got to this stage and also what embedder you are using
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@guhao17 commented on GitHub (Jul 22, 2024):

image
image
image
When updating my embedders, I created a new workspace and deleted the original workspace along with its data. Initially, I was using the 'anythingllm' embedder, but later I switched to the 'ollama' embedder. What should I do now?

@guhao17 commented on GitHub (Jul 22, 2024): ![image](https://github.com/user-attachments/assets/ca3282bd-4b27-4ff2-9d4e-be58016c457f) ![image](https://github.com/user-attachments/assets/4dd6e759-6d9f-42e2-bd93-5ddcf380fdd3) ![image](https://github.com/user-attachments/assets/d1171320-2f1e-4c3b-b468-be1d6e67384a) When updating my embedders, I created a new workspace and deleted the original workspace along with its data. Initially, I was using the 'anythingllm' embedder, but later I switched to the 'ollama' embedder. What should I do now?
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jul 22, 2024):

To be double sure all dimensionality aligns you can do the following:

  1. Delete workspaces or just reset the vector database in each workspace
  2. Ensure any cached documents are fully deleted from the system
  3. Reupload and embed into fresh/reset workspace - should have no issues
@timothycarambat commented on GitHub (Jul 22, 2024): To be double sure all dimensionality aligns you can do the following: 1. Delete workspaces _or_ just reset the vector database in each workspace 2. Ensure any `cached` documents are fully deleted from the system 3. Reupload and embed into fresh/reset workspace - should have no issues
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@guhao17 commented on GitHub (Jul 23, 2024):

Where can I find the address of the cached document

@guhao17 commented on GitHub (Jul 23, 2024): Where can I find the address of the cached document
yindo commented 2026-02-22 18:23:38 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jul 23, 2024):

You would just select the document in the UI and then click the "trash" icon - the cached filenames are hashed so you would not know which belongs to which file

@timothycarambat commented on GitHub (Jul 23, 2024): You would just select the document in the UI and then click the "trash" icon - the cached filenames are hashed so you would not know which belongs to which file
yindo changed title from [BUG]: embedding error，but i dont know why to [GH-ISSUE #1834] [BUG]: embedding error，but i dont know why 2026-06-05 14:39:27 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label possible bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1193
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?