[GH-ISSUE #926] [BUG]: Foreign language handled incorrectly #556

Closed
opened 2026-02-22 18:20:09 -05:00 by yindo · 7 comments
Owner

Originally created by @RahSwe on GitHub (Mar 19, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/926

Originally assigned to: @shatfield4 on GitHub.

How are you running AnythingLLM?

Not listed

What happened?

On hosted server (useanything), the prompt response sometimes displays odd characters instead of the Swedish characters.

image

Are there known steps to reproduce?

No response

Originally created by @RahSwe on GitHub (Mar 19, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/926 Originally assigned to: @shatfield4 on GitHub. ### How are you running AnythingLLM? Not listed ### What happened? On hosted server (useanything), the prompt response sometimes displays odd characters instead of the Swedish characters. <img width="596" alt="image" src="https://github.com/Mintplex-Labs/anything-llm/assets/163884933/5c752ae6-33a1-4af1-8ba6-1c65ffdc493f"> ### Are there known steps to reproduce? _No response_
yindo added the possible bug label 2026-02-22 18:20:09 -05:00
yindo closed this issue 2026-02-22 18:20:09 -05:00
Author
Owner

@shatfield4 commented on GitHub (Mar 19, 2024):

What model are you using here for your LLM? This may be an issue with language incompatibility in your model.

@shatfield4 commented on GitHub (Mar 19, 2024): What model are you using here for your LLM? This may be an issue with language incompatibility in your model.
Author
Owner

@RahSwe commented on GitHub (Mar 19, 2024):

Hi!I use Claude-3, have used many times before without any problems. Hard to day if it’s a LLM or ALLM problem I guess

@RahSwe commented on GitHub (Mar 19, 2024): Hi!I use Claude-3, have used many times before without any problems. Hard to day if it’s a LLM or ALLM problem I guess
Author
Owner

@timothycarambat commented on GitHub (Mar 19, 2024):

What is the target language, Swedish?

@timothycarambat commented on GitHub (Mar 19, 2024): What is the target language, Swedish?
Author
Owner

@RahSwe commented on GitHub (Mar 20, 2024):

Yes, we have the special characters å ä ö

@RahSwe commented on GitHub (Mar 20, 2024): Yes, we have the special characters å ä ö
Author
Owner

@shatfield4 commented on GitHub (Mar 20, 2024):

Is there any specific message that you send where you can consistently get these weird characters? I have tested all the claude models asking it to print out paragraphs in Swedish but cannot get the broken encoding like you are getting here. Also are you using this with your own documents? There is a possibility that your documents may include some characters with broken encoding and the LLM is just copying what it gets as context.

Screen Shot 2024-03-20 at 11 34 03 AM

@shatfield4 commented on GitHub (Mar 20, 2024): Is there any specific message that you send where you can consistently get these weird characters? I have tested all the claude models asking it to print out paragraphs in Swedish but cannot get the broken encoding like you are getting here. Also are you using this with your own documents? There is a possibility that your documents may include some characters with broken encoding and the LLM is just copying what it gets as context. ![Screen Shot 2024-03-20 at 11 34 03 AM](https://github.com/Mintplex-Labs/anything-llm/assets/2336488/a819e8f4-b6a3-418d-95b2-f2bd971559cd)
Author
Owner

@RahSwe commented on GitHub (Mar 20, 2024):

Hi!I did a lot of prompting today with no problems with the special characters. I will onboard a team on Friday, will return if there are any new language errors. May have been a temporary model lapse?

@RahSwe commented on GitHub (Mar 20, 2024): Hi!I did a lot of prompting today with no problems with the special characters. I will onboard a team on Friday, will return if there are any new language errors. May have been a temporary model lapse?
Author
Owner

@shatfield4 commented on GitHub (Mar 26, 2024):

Closing since we haven't heard back.

@shatfield4 commented on GitHub (Mar 26, 2024): Closing since we haven't heard back.
yindo changed title from [BUG]: Foreign language handled incorrectly to [GH-ISSUE #926] [BUG]: Foreign language handled incorrectly 2026-06-05 14:35:58 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#556