Logits/Probabilities along with the generated token #83

Open
opened 2026-02-15 16:27:55 -05:00 by yindo · 3 comments
Owner

Originally created by @magic-YuanTian on GitHub (May 13, 2024).

Hi!

When generating tokens, I'm wondering if Ollama can also provide logits/probability distribution over the vocabulary. This would be a very useful feature in many use cases.

Thanks!

Originally created by @magic-YuanTian on GitHub (May 13, 2024). Hi! When generating tokens, I'm wondering if Ollama can also provide logits/probability distribution over the vocabulary. This would be a very useful feature in many use cases. Thanks!
Author
Owner

@paraschopra commented on GitHub (Jun 10, 2024):

any update?

@paraschopra commented on GitHub (Jun 10, 2024): any update?
Author
Owner

@jingyu1111 commented on GitHub (Jul 3, 2024):

can it?

@jingyu1111 commented on GitHub (Jul 3, 2024): can it?
Author
Owner

@athmanar commented on GitHub (Dec 12, 2024):

hi what is this option in Optionsconfig in chat: logits_all

@athmanar commented on GitHub (Dec 12, 2024): hi what is this option in Optionsconfig in chat: logits_all
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#83