[GH-ISSUE #903] [FEAT]: Multiple simulataneous Chats with Ollama #539

Closed
opened 2026-02-22 18:20:04 -05:00 by yindo · 1 comment
Owner

Originally created by @sumitsodhi88 on GitHub (Mar 13, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/903

What would you like to see?

I can deploy infra for multiple users to chat at the same time. There should be provision in the admin account to choose number of people who can chat through their accounts at the same time instead of queing the responses.
I am using ollama as it is free to use.

Originally created by @sumitsodhi88 on GitHub (Mar 13, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/903 ### What would you like to see? I can deploy infra for multiple users to chat at the same time. There should be provision in the admin account to choose number of people who can chat through their accounts at the same time instead of queing the responses. I am using ollama as it is free to use.
yindo added the enhancementfeature request labels 2026-02-22 18:20:04 -05:00
yindo closed this issue 2026-02-22 18:20:04 -05:00
Author
Owner

@timothycarambat commented on GitHub (Mar 26, 2024):

This rate limiting can be applied via the system preferences in multi-user mode via the "chats per day". While this may not be ideal this is a specific infra problem with your implementation of Ollama and therefore it would be your responsibility to apply more granular rate limiting on top of this solution as it is specific to your use case using some kind of middleware between AnythingLLM and Ollama

@timothycarambat commented on GitHub (Mar 26, 2024): This rate limiting can be applied via the system preferences in multi-user mode via the "chats per day". While this may not be ideal this is a specific infra problem with your implementation of Ollama and therefore it would be your responsibility to apply more granular rate limiting on top of this solution as it is specific to your use case using some kind of middleware between AnythingLLM and Ollama
yindo changed title from [FEAT]: Multiple simulataneous Chats with Ollama to [GH-ISSUE #903] [FEAT]: Multiple simulataneous Chats with Ollama 2026-06-05 14:35:52 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#539