[GH-ISSUE #15] bug: incorrect # of output rows #8

Closed
opened 2026-02-15 18:17:00 -05:00 by yindo · 2 comments
Owner

Originally created by @benisgold on GitHub (Apr 20, 2023).
Original GitHub issue: https://github.com/langchain-ai/auto-evaluator/issues/15

Sometimes the output will have 1 less than the # of eval pairs requested

Originally created by @benisgold on GitHub (Apr 20, 2023). Original GitHub issue: https://github.com/langchain-ai/auto-evaluator/issues/15 Sometimes the output will have 1 less than the # of eval pairs requested
yindo closed this issue 2026-02-15 18:17:00 -05:00
Author
Owner

@rlancemartin commented on GitHub (Apr 20, 2023):

Yes, this is a known issue: somethings QAgeneration fails and we get < the specified # of questions.

@rlancemartin commented on GitHub (Apr 20, 2023): Yes, this is a known issue: somethings QAgeneration fails and we get < the specified # of questions.
Author
Owner

@rlancemartin commented on GitHub (Apr 22, 2023):

Fixed w/ re-try.

@rlancemartin commented on GitHub (Apr 22, 2023): Fixed w/ re-try.
yindo changed title from bug: incorrect # of output rows to [GH-ISSUE #15] bug: incorrect # of output rows 2026-06-05 17:13:57 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/auto-evaluator#8