Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #2430] [FEAT]: Adjusted url links in AnythingLLM citations for chat responses #1580

New Issue
Closed
opened 2026-02-22 18:25:30 -05:00 by yindo · 1 comment
yindo commented 2026-02-22 18:25:30 -05:00
Owner
Copy Link
Copy Source

Originally created by @Alminc91 on GitHub (Oct 5, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2430

Originally assigned to: @shatfield4 on GitHub.

How are you running AnythingLLM?

Docker (remote machine)

What happened?

Hi!

I am building a private chatbot prototype for clients in the education/welfare sector.
My goal:
For this, when the chatbot recommends some courses (e.g. language courses), I like to provide the url link directly to the website with the course information.
Problem:
Sadly AnythingLLM changes the uploaded url quite a lot in the documents section. This happens with the bulk link scraper or manually the API upload_link() function. In both cases, the original url is changed and the chatbot recommends a broken link.

Example for a course in German:

Short-term solution/fix:
I am giving the bot some examples of correct links in the system prompt, but that doesn't work always perfectly and it consumes input tokens.

I would be happy about a solution in AnythingLLM for this! Maybe I can also collaborate or help as a software engineer. Thanks and blessings!

Helpful Information:
For example in my loaded sources the chatbot gets the information for the link from the metadata and sourceDocument:
sourceDocument: www_vhs-lingen.de-programmkursPrivate-Kochkurse-nur-fuer-Euch2024H92000.html published: 10/7/2024, 7:57:11 AM </document_metadata>

But inside the citations dropdown the links are correct, so I suppose they are saved somewhere correctly. If this could be saved in the metadata, maybe that would be a solution. Usable links may be under chunkSource also.
citations_links

Possibly I could set the link inside the metadata with the API function (raw-text) myself. I need to test that.

Are there known steps to reproduce?

No response

Originally created by @Alminc91 on GitHub (Oct 5, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2430 Originally assigned to: @shatfield4 on GitHub. ### How are you running AnythingLLM? Docker (remote machine) ### What happened? Hi! I am building a private chatbot prototype for clients in the education/welfare sector. **My goal:** For this, when the chatbot recommends some courses (e.g. language courses), I like to provide the url link directly to the website with the course information. **Problem:** Sadly AnythingLLM changes the uploaded url quite a lot in the documents section. This happens with the bulk link scraper or manually the API upload_link() function. In both cases, the original url is changed and the chatbot recommends a broken link. **Example** for a course in German: * **Broken** uploaded link in AnythingLLM documents section: www_vhs muehldorf.de-programmberuf-karrierekursIHK-Fachkraft-Rechnungswesen-Steuerrechtliche-GrundlagenA20000.html * **Real** link from website that I uploaded: https://www.vhs-muehldorf.de/programm/beruf-karriere/kurs/IHK-Fachkraft-Rechnungswesen-Steuerrechtliche-Grundlagen/A20000 **Short-term solution/fix**: I am giving the bot some examples of correct links in the system prompt, but that doesn't work always perfectly and it consumes input tokens. I would be happy about a solution in AnythingLLM for this! Maybe I can also collaborate or help as a software engineer. Thanks and blessings! **Helpful Information**: For example in my loaded sources the chatbot gets the information for the link from the metadata and sourceDocument: sourceDocument: www_vhs-lingen.de-programmkursPrivate-Kochkurse-nur-fuer-Euch2024H92000.html published: 10/7/2024, 7:57:11 AM </document_metadata> But inside the citations dropdown the links are correct, so I suppose they are saved somewhere correctly. If this could be saved in the metadata, maybe that would be a solution. Usable links may be under chunkSource also. ![citations_links](https://github.com/user-attachments/assets/411ccd3c-d921-49a1-abc8-0d74bb697a24) Possibly I could set the link inside the metadata with the API function (raw-text) myself. I need to test that. ### Are there known steps to reproduce? _No response_
yindo added the enhancementfeature request labels 2026-02-22 18:25:30 -05:00
yindo closed this issue 2026-02-22 18:25:30 -05:00
yindo commented 2026-02-22 18:25:30 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Oct 7, 2024):

So one thing we do for this is this:
https://github.com/Mintplex-Labs/anything-llm/blob/b658f5012de0658272fb0853a1c00a1fda2ccf1f/server/utils/TextSplitter/index.js#L48-L57

Which puts the metadata at the top of every chunk of text - this is also how the citation knows what the correct link actually is - as it is saved in metadata. What is looks like is that to your point the chunkMetadata can be improved to use the full qualified source instead of the document name as saved in documents.

This obviously does not work for local document references but would be very useful for web-resources

@timothycarambat commented on GitHub (Oct 7, 2024): So one thing we do for this is this: https://github.com/Mintplex-Labs/anything-llm/blob/b658f5012de0658272fb0853a1c00a1fda2ccf1f/server/utils/TextSplitter/index.js#L48-L57 Which puts the metadata at the top of every chunk of text - this is also how the citation knows what the correct link actually is - as it is saved in metadata. What is looks like is that to your point the chunkMetadata can be improved to use the full qualified source instead of the document name as saved in documents. This obviously does not work for local document references but would be very useful for web-resources
yindo changed title from [FEAT]: Adjusted url links in AnythingLLM citations for chat responses to [GH-ISSUE #2430] [FEAT]: Adjusted url links in AnythingLLM citations for chat responses 2026-06-05 14:41:33 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1580
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?