Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-21 09:35:22 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #430] Ability to set max tokens for localai api? #245

New Issue
Closed
opened 2026-02-22 18:18:32 -05:00 by yindo · 2 comments
yindo commented 2026-02-22 18:18:32 -05:00
Owner
Copy Link
Copy Source

Originally created by @dillfrescott on GitHub (Dec 12, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/430

I need this feature!

Originally created by @dillfrescott on GitHub (Dec 12, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/430 I need this feature!
yindo added the enhancementgood first issuefeature request labels 2026-02-22 18:18:32 -05:00
yindo closed this issue 2026-02-22 18:18:32 -05:00
yindo commented 2026-02-22 18:18:32 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Dec 12, 2023):

Would this limit apply to every workspace and chat sent? If so that can be configured for LocalAI LLM inferencing.

Is the chat running away and not terminating output?

@timothycarambat commented on GitHub (Dec 12, 2023): Would this limit apply to every workspace and chat sent? If so that can be configured for LocalAI LLM inferencing. Is the chat running away and not terminating output?
yindo commented 2026-02-22 18:18:32 -05:00
Author
Owner
Copy Link
Copy Source

@dillfrescott commented on GitHub (Dec 12, 2023):

I added it globally right around here actually:

https://github.com/Mintplex-Labs/anything-llm/blob/ce9233c258a6769ddf4e640dd49623c5c7b0f37d/server/utils/AiProviders/localAi/index.js#L119

So I guess that works for me!

@dillfrescott commented on GitHub (Dec 12, 2023): I added it globally right around here actually: https://github.com/Mintplex-Labs/anything-llm/blob/ce9233c258a6769ddf4e640dd49623c5c7b0f37d/server/utils/AiProviders/localAi/index.js#L119 So I guess that works for me!
yindo changed title from Ability to set max tokens for localai api? to [GH-ISSUE #430] Ability to set max tokens for localai api? 2026-06-05 14:34:15 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request good first issue
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#245
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?