[GH-ISSUE #5479] [BUG]: Hugely incorrect information given when providing a list of links #5112

Closed
opened 2026-06-05 14:52:04 -04:00 by yindo · 3 comments
Owner

Originally created by @Xogue on GitHub (Apr 21, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5479

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

the LLM seems to be very confident that It got the correct information, and seems to complete its processing, but the actual information is horribly incorrect.

In my specific case, I asked it to keep track of my inventory of purchased parts for my hobby and provided it with a list of links to follow (all from amazon) to get the information from. Instead of getting the info for one link, then going back to the list, it seems to try and follow some of the links from the page instead. the process it take to do this is very odd and hard to describe. But it seems like it does reference the list of links I give it, but instead of following the one it says its going to follow, in follows a different link seemingly from the page it goes to first. (in most cases it changes between successive runs, even if the wording is identical, hence my believe that something more random is impacting it, such as the recommended section of an amazon product page)

Are there known steps to reproduce?

Drop this list of links for it and ask it to save the details to a database for it to reference

https://www.amazon.com/dp/B0FMJH3DML?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FLGZB3VP?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FL1T4ZHT?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B00HJ6AE72?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FJ5SPRM9?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0DHPCFJD6?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B07KZW86YR?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0GJSFMNBT?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0D3GWJK82?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B09T6SJBV5?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FJ7Z9ZML?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B08K2GZYN9?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B097BWJGYK?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B08FD1XVL6?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0852HL336?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B09DRZLM5N?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B082F1WKP9?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B07GD1XFWV?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B08YRGVYPV?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B07DL13RZH?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B01MFA3OFA?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0DYP7CFZZ?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B075WB98FJ?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0972XP1YS?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B07GD1XFWV?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B08FQBS97L?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FFLXM9KL?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B01LN8ONG4?ref=ppx_yo2ov_dt_b_fed_asin_title
https://www.amazon.com/dp/B0FHWB5VFW?ref=ppx_yo2ov_dt_b_fed_asin_title

LLM Provider & Model (if applicable)

Qwen Vision 4B Instruct

Embedder Provider & Model (if applicable)

Anything LLM Embedder / all-MiniLM-L6-v2

Originally created by @Xogue on GitHub (Apr 21, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5479 ### How are you running AnythingLLM? AnythingLLM desktop app ### What happened? the LLM seems to be very confident that It got the correct information, and seems to complete its processing, but the actual information is horribly incorrect. In my specific case, I asked it to keep track of my inventory of purchased parts for my hobby and provided it with a list of links to follow (all from amazon) to get the information from. Instead of getting the info for one link, then going back to the list, it seems to try and follow some of the links from the page instead. the process it take to do this is very odd and hard to describe. But it seems like it does reference the list of links I give it, but instead of following the one it says its going to follow, in follows a different link seemingly from the page it goes to first. (in most cases it changes between successive runs, even if the wording is identical, hence my believe that something more random is impacting it, such as the recommended section of an amazon product page) ### Are there known steps to reproduce? Drop this list of links for it and ask it to save the details to a database for it to reference https://www.amazon.com/dp/B0FMJH3DML?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FLGZB3VP?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FL1T4ZHT?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B00HJ6AE72?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FJ5SPRM9?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0DHPCFJD6?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B07KZW86YR?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0GJSFMNBT?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0D3GWJK82?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B09T6SJBV5?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FJ7Z9ZML?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B08K2GZYN9?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B097BWJGYK?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B08FD1XVL6?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0852HL336?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B09DRZLM5N?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B082F1WKP9?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B07GD1XFWV?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B08YRGVYPV?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B07DL13RZH?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B01MFA3OFA?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0DYP7CFZZ?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B075WB98FJ?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0972XP1YS?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B07GD1XFWV?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B08FQBS97L?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FFLXM9KL?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B01LN8ONG4?ref=ppx_yo2ov_dt_b_fed_asin_title https://www.amazon.com/dp/B0FHWB5VFW?ref=ppx_yo2ov_dt_b_fed_asin_title ### LLM Provider & Model (if applicable) Qwen Vision 4B Instruct ### Embedder Provider & Model (if applicable) Anything LLM Embedder / all-MiniLM-L6-v2
yindo added the possible bug label 2026-06-05 14:52:04 -04:00
yindo closed this issue 2026-06-05 14:52:04 -04:00
Author
Owner

@Xogue commented on GitHub (Apr 21, 2026):

I also just tried to use them one at a time to create the database. it still got them wrong. I reworked it and it probably has something to do with amazon's "share" links. when I get the original link, it gets the correct item. I am going to try to get the full list of original links and see what happens

<!-- gh-comment-id:4292391655 --> @Xogue commented on GitHub (Apr 21, 2026): I also just tried to use them one at a time to create the database. it still got them wrong. I reworked it and it probably has something to do with amazon's "share" links. when I get the original link, it gets the correct item. I am going to try to get the full list of original links and see what happens
Author
Owner

@Xogue commented on GitHub (Apr 21, 2026):

ok, that worked, which I guess means this is a much lower priority, but Ill leave this here because its not the only site that uses shorter links for sharing. should probably look into it. but for anyone else having a similar problem, try the long links, that worked for me.

<!-- gh-comment-id:4292511798 --> @Xogue commented on GitHub (Apr 21, 2026): ok, that worked, which I guess means this is a much lower priority, but Ill leave this here because its not the only site that uses shorter links for sharing. should probably look into it. but for anyone else having a similar problem, try the long links, that worked for me.
Author
Owner

@timothycarambat commented on GitHub (Apr 22, 2026):

This seems like part of this has to do with the model hallucinating but then some other, actual problem which has to do with redirect following/loading since that share link likely goes somewhere else beyond the short link?

What provider/model are you using so that at least clears up one side of the puzzle?

<!-- gh-comment-id:4293579524 --> @timothycarambat commented on GitHub (Apr 22, 2026): This seems like part of this has to do with the model hallucinating but then some other, actual problem which has to do with redirect following/loading since that share link likely goes somewhere else beyond the short link? What provider/model are you using so that at least clears up one side of the puzzle?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#5112