[GH-ISSUE #2643] [FEAT]: Tokens per second (tok/s) #1715

Closed
opened 2026-02-22 18:26:12 -05:00 by yindo · 2 comments
Owner

Originally created by @NikosDi on GitHub (Nov 18, 2024).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2643

What would you like to see?

Hello.
I could be blind but I simply can't find a setting or another way to see the speed of replies, some kind of token report of the chat.

It would be useful to add tokens per second metric (tok/s)

thank you

Originally created by @NikosDi on GitHub (Nov 18, 2024). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/2643 ### What would you like to see? Hello. I could be blind but I simply can't find a setting or another way to see the speed of replies, some kind of token report of the chat. It would be useful to add tokens per second metric (tok/s) thank you
yindo added the enhancementfeature request labels 2026-02-22 18:26:12 -05:00
yindo closed this issue 2026-02-22 18:26:12 -05:00
Author
Owner

@timothycarambat commented on GitHub (Nov 20, 2024):

related #1404

@timothycarambat commented on GitHub (Nov 20, 2024): related #1404
Author
Owner

@timothycarambat commented on GitHub (Jan 3, 2025):

resolved by https://github.com/Mintplex-Labs/anything-llm/pull/2825

@timothycarambat commented on GitHub (Jan 3, 2025): resolved by https://github.com/Mintplex-Labs/anything-llm/pull/2825
yindo changed title from [FEAT]: Tokens per second (tok/s) to [GH-ISSUE #2643] [FEAT]: Tokens per second (tok/s) 2026-06-05 14:42:17 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#1715