mirror of
https://github.com/ollama/ollama-python.git
synced 2026-07-21 00:55:21 -04:00
Logits/Probabilities along with the generated token #83
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @magic-YuanTian on GitHub (May 13, 2024).
Hi!
When generating tokens, I'm wondering if Ollama can also provide logits/probability distribution over the vocabulary. This would be a very useful feature in many use cases.
Thanks!
@paraschopra commented on GitHub (Jun 10, 2024):
any update?
@jingyu1111 commented on GitHub (Jul 3, 2024):
can it?
@athmanar commented on GitHub (Dec 12, 2024):
hi what is this option in Optionsconfig in chat: logits_all