mirror of
https://github.com/langchain-ai/auto-evaluator.git
synced 2026-07-18 12:46:06 -04:00
[GH-ISSUE #15] bug: incorrect # of output rows #8
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @benisgold on GitHub (Apr 20, 2023).
Original GitHub issue: https://github.com/langchain-ai/auto-evaluator/issues/15
Sometimes the output will have 1 less than the # of eval pairs requested
@rlancemartin commented on GitHub (Apr 20, 2023):
Yes, this is a known issue: somethings QAgeneration fails and we get < the specified # of questions.
@rlancemartin commented on GitHub (Apr 22, 2023):
Fixed w/ re-try.
bug: incorrect # of output rowsto [GH-ISSUE #15] bug: incorrect # of output rows