[GH-ISSUE #1239] [CHORE]: Embedder embedText length check #773

Open
opened 2026-02-22 18:21:17 -05:00 by yindo · 0 comments
Owner

Originally created by @timothycarambat on GitHub (Apr 30, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1239

Originally assigned to: @timothycarambat on GitHub.

How are you running AnythingLLM?

All versions

What happened?

Continuation of #1238

When embedding a string or array of strings we need to ensure that every item is < the length of the maximum length of the selected embedding model or else the embedder will fail to encode and vectorized a prompt.

This only applies to the prompt given, which tends to be below the embedders length, but we need to ensure this is always the case via a util/helper function.

Are there known steps to reproduce?

No response

Originally created by @timothycarambat on GitHub (Apr 30, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1239 Originally assigned to: @timothycarambat on GitHub. ### How are you running AnythingLLM? All versions ### What happened? Continuation of #1238 When embedding a string or array of strings we need to ensure that every item is < the length of the maximum length of the selected embedding model or else the embedder will fail to encode and vectorized a prompt. This only applies to the prompt given, which tends to be below the embedders length, but we need to ensure this is always the case via a util/helper function. ### Are there known steps to reproduce? _No response_
yindo added the core-team-only label 2026-02-22 18:21:17 -05:00
yindo changed title from [CHORE]: Embedder `embedText` length check to [GH-ISSUE #1239] [CHORE]: Embedder `embedText` length check 2026-06-05 14:37:08 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#773