Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #1778] [BUG]: The Language Hindi is not fully supported as garbled text displayed in the output #1164

New Issue
Closed
opened 2026-02-22 18:23:26 -05:00 by yindo · 1 comment
yindo commented 2026-02-22 18:23:26 -05:00
Owner
Copy Link
Copy Source

Originally created by @hk-rajeev on GitHub (Jun 27, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1778

How are you running AnythingLLM?

Docker (local)

What happened?

Bug Report: Incorrect Display of Hindi Text in LLM Responses

Summary:
It is not displaying Hindi text correctly in its responses. The text contains incorrect characters and formatting issues, making it unreadable and inaccurate.

Details:
When asking for a joke in Hindi, the response given by the LLM contains garbled text and incorrect characters. Here is an example of the issue:

Expected Response in Hindi:
"तीन चिकने होकर एक चिकनी के पास आते हैं और उसने उनसे पूछा - आप क्या चाहते हो? चिकने बोले - हम एक चिकनी को पकाना चाहते हैं। चिकनी ने बोली - अच्छा, फिर आप लोग एक दूसरे को पका लो और मैं बाकी रह जाऊंगी।"

Actual Response received:
"तीन चिकने होकर एक चिकनी के पास आते हैं और उसने उनसे पooNT पूछा - आप क्या चाहते हो? चिकने bolE - हम एक चिकनी को पकाना चाहते हैं। चिकनी ने बोली - अच्छा, फिर आप लोग एक दूसरे को पका लो और मैं बाकी रह जाऊंगी।"

Issues Observed:

  1. Incorrect characters: "पooNT" should be "पूछा", "bolE" should be "बोले".
  2. Random insertion of English characters.
  3. Incorrect formatting that disrupts the readability of the text.

Steps to Reproduce:

  1. Query the LLM with a request for a joke in Hindi.
  2. Observe the response for any garbled or incorrect characters.

Expected Outcome:
The LLM should provide correctly formatted Hindi text without any garbled characters or random English insertions. The response should be:

Please prioritize this bug as it affects the usability of the application for Hindi-speaking users.

image

Are there known steps to reproduce?

Steps to Reproduce:

  1. Query the LLM with a request for a joke in Hindi.
  2. Observe the response for any garbled or incorrect characters.
Originally created by @hk-rajeev on GitHub (Jun 27, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/1778 ### How are you running AnythingLLM? Docker (local) ### What happened? ### Bug Report: Incorrect Display of Hindi Text in LLM Responses **Summary**: It is not displaying Hindi text correctly in its responses. The text contains incorrect characters and formatting issues, making it unreadable and inaccurate. **Details**: When asking for a joke in Hindi, the response given by the LLM contains garbled text and incorrect characters. Here is an example of the issue: **Expected Response in Hindi**: "तीन चिकने होकर एक चिकनी के पास आते हैं और उसने उनसे पूछा - आप क्या चाहते हो? चिकने बोले - हम एक चिकनी को पकाना चाहते हैं। चिकनी ने बोली - अच्छा, फिर आप लोग एक दूसरे को पका लो और मैं बाकी रह जाऊंगी।" **Actual Response received**: "तीन चिकने होकर एक चिकनी के पास आते हैं और उसने उनसे पooNT पूछा - आप क्या चाहते हो? चिकने bolE - हम एक चिकनी को पकाना चाहते हैं। चिकनी ने बोली - अच्छा, फिर आप लोग एक दूसरे को पका लो और मैं बाकी रह जाऊंगी।" **Issues Observed**: 1. Incorrect characters: "पooNT" should be "पूछा", "bolE" should be "बोले". 2. Random insertion of English characters. 3. Incorrect formatting that disrupts the readability of the text. **Steps to Reproduce**: 1. Query the LLM with a request for a joke in Hindi. 2. Observe the response for any garbled or incorrect characters. **Expected Outcome**: The LLM should provide correctly formatted Hindi text without any garbled characters or random English insertions. The response should be: Please prioritize this bug as it affects the usability of the application for Hindi-speaking users. ![image](https://github.com/Mintplex-Labs/anything-llm/assets/127058120/a27fddb3-c08a-4596-8bce-f8be732b1f1c) ### Are there known steps to reproduce? **Steps to Reproduce**: 1. Query the LLM with a request for a joke in Hindi. 2. Observe the response for any garbled or incorrect characters.
yindo added the needs info / can't replicate label 2026-02-22 18:23:26 -05:00
yindo closed this issue 2026-02-22 18:23:26 -05:00
yindo commented 2026-02-22 18:23:26 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jun 27, 2024):

Are you sure that this is even AnythingLLM and not the actual output from your LLM? We dont apply a charset transformer on top of outputs - we just store what is given back from the LLM buffers

@timothycarambat commented on GitHub (Jun 27, 2024): Are you sure that this is even AnythingLLM and not the actual output from your LLM? We dont apply a charset transformer on top of outputs - we just store what is given back from the LLM buffers
yindo changed title from [BUG]: The Language Hindi is not fully supported as garbled text displayed in the output to [GH-ISSUE #1778] [BUG]: The Language Hindi is not fully supported as garbled text displayed in the output 2026-06-05 14:39:17 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label needs info / can't replicate
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1164
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?