[GH-ISSUE #2631] [FEAT]: Feature Request 「plz support InternLM2.5」 #1706

Closed
opened 2026-02-22 18:26:09 -05:00 by yindo · 1 comment
Owner

Originally created by @boshallen on GitHub (Nov 13, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2631

What would you like to see?

Hi,

I noticed that the repository currently lacks support for the InternLM2.5-7B (1.8B, 20B) model, which may cause compatibility issues or missing steps for users trying to implement it. It would be beneficial to update the repository with detailed instructions or tools for integrating and using the InternLM2.5-7B model, ensuring the content remains relevant.

I believe that adding this support would significantly enhance the usability of the project. While some manual adjustments are possible, official guidance or toolchain support would be much more efficient and advantageous, especially for new users.

If possible, including example scripts or demonstrating integration with InternLM2.5-7B would also be a valuable addition.

For further support, please add the InternLM Assistant (WeChat search: InternLM) or join the InternLM Discord(https://discord.com/invite/xa29JuW87d).

Originally created by @boshallen on GitHub (Nov 13, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2631 ### What would you like to see? Hi, I noticed that the repository currently lacks support for the InternLM2.5-7B (1.8B, 20B) model, which may cause compatibility issues or missing steps for users trying to implement it. It would be beneficial to update the repository with detailed instructions or tools for integrating and using the InternLM2.5-7B model, ensuring the content remains relevant. I believe that adding this support would significantly enhance the usability of the project. While some manual adjustments are possible, official guidance or toolchain support would be much more efficient and advantageous, especially for new users. If possible, including example scripts or demonstrating integration with InternLM2.5-7B would also be a valuable addition. For further support, please add the InternLM Assistant (WeChat search: InternLM) or join the InternLM Discord(https://discord.com/invite/xa29JuW87d).
yindo added the enhancementfeature request labels 2026-02-22 18:26:09 -05:00
yindo closed this issue 2026-02-22 18:26:09 -05:00
Author
Owner

@timothycarambat commented on GitHub (Nov 15, 2024):

You can document quantized GGUF models directly from HuggingFace from our built in LLM as of 1.6.9.

Otherwise, you can also just use an LLM provider who supports InternLM, and it will work. We dont build LLM inference engines, we just connect to them.

@timothycarambat commented on GitHub (Nov 15, 2024): You can document quantized GGUF models directly from HuggingFace from our built in LLM as of 1.6.9. Otherwise, you can also just use an LLM provider who supports InternLM, and it will work. We dont build LLM inference engines, we just connect to them.
yindo changed title from [FEAT]: Feature Request 「plz support InternLM2.5」 to [GH-ISSUE #2631] [FEAT]: Feature Request 「plz support InternLM2.5」 2026-06-05 14:42:13 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1706