Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-21 01:25:28 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #450] Add mistralai/Mixtral-8x7B-Instruct-v0.1 #254

New Issue
Closed
opened 2026-02-22 18:18:35 -05:00 by yindo · 4 comments
yindo commented 2026-02-22 18:18:35 -05:00
Owner
Copy Link
Copy Source

Originally created by @andsty on GitHub (Dec 15, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/450

Trying with mistralai/Mixtral-8x7B-Instruct-v0.1 it seems that the chat works fine. when i add a document in my workspace the responses are not related to the document i have added at all

Originally created by @andsty on GitHub (Dec 15, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/450 Trying with mistralai/Mixtral-8x7B-Instruct-v0.1 it seems that the chat works fine. when i add a document in my workspace the responses are not related to the document i have added at all
yindo added the wontfixIntegration Request labels 2026-02-22 18:18:35 -05:00
yindo closed this issue 2026-02-22 18:18:35 -05:00
yindo commented 2026-02-22 18:18:35 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 15, 2023):

Are you sure that the context from a relevant document is being passed to the model? Additionally, not all models behave the same. Are you running this via LocalAI or LMStudio or otherwise?

@timothycarambat commented on GitHub (Dec 15, 2023): Are you sure that the context from a relevant document is being passed to the model? Additionally, not all models behave the same. Are you running this via LocalAI or LMStudio or otherwise?
yindo commented 2026-02-22 18:18:35 -05:00
Author
Owner
Copy Link
Copy Source

@lunamidori5 commented on GitHub (Dec 15, 2023):

Are you sure that the context from a relevant document is being passed to the model? Additionally, not all models behave the same. Are you running this via LocalAI or LMStudio or otherwise?

Localai as of right now does not support Mixtral, they are working on adding support for it.

@lunamidori5 commented on GitHub (Dec 15, 2023): > Are you sure that the context from a relevant document is being passed to the model? Additionally, not all models behave the same. Are you running this via LocalAI or LMStudio or otherwise? Localai as of right now does not support Mixtral, they are working on adding support for it.
yindo commented 2026-02-22 18:18:36 -05:00
Author
Owner
Copy Link
Copy Source

@lunamidori5 commented on GitHub (Dec 20, 2023):

@andsty Localai now supports Mixtral

@lunamidori5 commented on GitHub (Dec 20, 2023): @andsty Localai now supports Mixtral
yindo commented 2026-02-22 18:18:36 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 20, 2023):

Closing this as wontfix since support for this would need to come from the provider itself (LocalAI, LMStudio or another provider) and not from AnythingLLM directly.

Since LocalAI supports this model now you can use that!

@timothycarambat commented on GitHub (Dec 20, 2023): Closing this as wontfix since support for this would need to come from the provider itself (LocalAI, LMStudio or another provider) and not from AnythingLLM directly. Since LocalAI supports this model now you can use that!
yindo changed title from Add mistralai/Mixtral-8x7B-Instruct-v0.1 to [GH-ISSUE #450] Add mistralai/Mixtral-8x7B-Instruct-v0.1 2026-06-05 14:34:18 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label Integration Request wontfix
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#254
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?