[GH-ISSUE #4339] [BUG]: unsupported Unicode escape sequence #2764

Closed
opened 2026-02-22 18:31:08 -05:00 by yindo · 2 comments
Owner

Originally created by @andreiramani on GitHub (Aug 29, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4339

Originally assigned to: @angelplusultra on GitHub.

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I'm testing 3 pdf file, 2 files successfully created in pgvector.
While 1 file getting log error like this:

....
[backend] info: [NativeEmbedder] Embedded Chunk Group 68 of 69
[backend] info: [NativeEmbedder] Embedded Chunk Group 69 of 69
[backend] info: [PGVectorDb] Inserting vectorized chunks into PGVector collection.
[backend] info: [PGVectorDb] Creating embedding table with 384 dimensions
[backend] info: [PGVectorDb] Updating or creating collection mediation
[backend] info: [PGVectorDb] Rolling back 1716 vectors to mediation error: unsupported Unicode escape sequence
    at D:\install\AnythingLLM\resources\backend\node_modules\pg\lib\client.js:545:17
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Object.updateOrCreateCollection (D:\install\AnythingLLM\resources\backend\server.js:38:14087)
    at async Object.addDocumentToNamespace (D:\install\AnythingLLM\resources\backend\server.js:38:16875)
    at async Object.addDocuments (D:\install\AnythingLLM\resources\backend\server.js:246:30355)
    at async Object.moveToDocumentsAndEmbed (D:\install\AnythingLLM\resources\backend\server.js:7:6443)
    at async D:\install\AnythingLLM\resources\backend\server.js:278:14831

Any suggestion much appreciated


AnythingLLM Desktop with pgvector v0.8, PostgreSQL v16
OS: Windows 11
GPU: RTX 3060 6GB
RAM: 32GB
Ryzen 7 7840 HS

Are there known steps to reproduce?

No response

Originally created by @andreiramani on GitHub (Aug 29, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/4339 Originally assigned to: @angelplusultra on GitHub. ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? I'm testing 3 pdf file, 2 files successfully created in pgvector. While 1 file getting log error like this: ``` .... [backend] info: [NativeEmbedder] Embedded Chunk Group 68 of 69 [backend] info: [NativeEmbedder] Embedded Chunk Group 69 of 69 [backend] info: [PGVectorDb] Inserting vectorized chunks into PGVector collection. [backend] info: [PGVectorDb] Creating embedding table with 384 dimensions [backend] info: [PGVectorDb] Updating or creating collection mediation [backend] info: [PGVectorDb] Rolling back 1716 vectors to mediation error: unsupported Unicode escape sequence at D:\install\AnythingLLM\resources\backend\node_modules\pg\lib\client.js:545:17 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async Object.updateOrCreateCollection (D:\install\AnythingLLM\resources\backend\server.js:38:14087) at async Object.addDocumentToNamespace (D:\install\AnythingLLM\resources\backend\server.js:38:16875) at async Object.addDocuments (D:\install\AnythingLLM\resources\backend\server.js:246:30355) at async Object.moveToDocumentsAndEmbed (D:\install\AnythingLLM\resources\backend\server.js:7:6443) at async D:\install\AnythingLLM\resources\backend\server.js:278:14831 ``` Any suggestion much appreciated ------------------------- AnythingLLM Desktop with pgvector v0.8, PostgreSQL v16 OS: Windows 11 GPU: RTX 3060 6GB RAM: 32GB Ryzen 7 7840 HS ### Are there known steps to reproduce? _No response_
yindo added the possible bugneeds info / can't replicateinvestigating labels 2026-02-22 18:31:09 -05:00
yindo closed this issue 2026-02-22 18:31:09 -05:00
Author
Owner

@timothycarambat commented on GitHub (Sep 12, 2025):

One file likely contains \u0000 somewhere in it in unicode - which will always fail on upsert of jsonb column types. Do you have the file available that you can share so we can reproduce the bug?

@timothycarambat commented on GitHub (Sep 12, 2025): One file likely contains `\u0000` somewhere in it in unicode - which will always fail on upsert of `jsonb` column types. Do you have the file available that you can share so we can reproduce the bug?
Author
Owner

@andreiramani commented on GitHub (Sep 13, 2025):

One file likely contains \u0000 somewhere in it in unicode - which will always fail on upsert of jsonb column types. Do you have the file available that you can share so we can reproduce the bug?

this is pdf file example - unicode.pdf

@andreiramani commented on GitHub (Sep 13, 2025): > One file likely contains `\u0000` somewhere in it in unicode - which will always fail on upsert of `jsonb` column types. Do you have the file available that you can share so we can reproduce the bug? this is pdf file example - [unicode.pdf](https://github.com/user-attachments/files/22308895/Introduction.to.Mediation.Moderation.and.Conditional.Process.Analysis.-.A.Regression-Based.Approach.3rd.ed.2022.pdf)
yindo changed title from [BUG]: unsupported Unicode escape sequence to [GH-ISSUE #4339] [BUG]: unsupported Unicode escape sequence 2026-06-05 14:48:25 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2764