[PR #13] [MERGED] feat: Script for generating eval data #16

New Issue

2026-02-16T08:18:47-05:00

yindo commented

2026-02-16 08:18:47 -05:00

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/llmanager/pull/13
Author: @bracesproul
Created: 4/11/2025
Status: ✅ Merged
Merged: 4/11/2025
Merged by: @bracesproul

Base: main ← Head: brace/generate-eval-data

📝 Commits (4)

9798ef1 feat: Script for generating eval data
ff6bbf7 cr
b513710 nest all data inside assistant
a59c5a3 cr

📊 Changes

13 files changed (+414 additions, -118 deletions)

View changed files

➕ evals/e2e.int.test.ts (+255 -0)
➕ scripts/generate-eval-data.ts (+53 -0)
📝 src/llmanager/nodes/human-node.ts (+9 -3)
📝 src/llmanager/types.ts (+11 -30)
📝 src/reasoning/nodes/initial-reasoning.ts (+4 -4)
📝 src/reasoning/types.ts (+7 -24)
📝 src/reflection/nodes/explanation-reflection.ts (+8 -2)
📝 src/reflection/nodes/full-reflection.ts (+8 -2)
📝 src/reflection/types.ts (+15 -46)
📝 src/stores/few-shot.ts (+14 -2)
📝 src/stores/reflection.ts (+18 -2)
📝 src/utils/build-context.ts (+11 -3)
📝 src/utils/query.ts (+1 -0)

📄 Description

No description provided

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/llmanager/pull/13 **Author:** [@bracesproul](https://github.com/bracesproul) **Created:** 4/11/2025 **Status:** ✅ Merged **Merged:** 4/11/2025 **Merged by:** [@bracesproul](https://github.com/bracesproul) **Base:** `main` ← **Head:** `brace/generate-eval-data` --- ### 📝 Commits (4) - [`9798ef1`](https://github.com/langchain-ai/llmanager/commit/9798ef11806464d0e1cfece2bb6798d8b30bcfcb) feat: Script for generating eval data - [`ff6bbf7`](https://github.com/langchain-ai/llmanager/commit/ff6bbf742e8134eed56c189b0747dd4ee2446ef7) cr - [`b513710`](https://github.com/langchain-ai/llmanager/commit/b513710848b83ed779f3858d0021a3ac9ba7ae90) nest all data inside assistant - [`a59c5a3`](https://github.com/langchain-ai/llmanager/commit/a59c5a34da8aa9922b1b4a3b7eedf4756a2b05aa) cr ### 📊 Changes **13 files changed** (+414 additions, -118 deletions) <details> <summary>View changed files</summary> ➕ `evals/e2e.int.test.ts` (+255 -0) ➕ `scripts/generate-eval-data.ts` (+53 -0) 📝 `src/llmanager/nodes/human-node.ts` (+9 -3) 📝 `src/llmanager/types.ts` (+11 -30) 📝 `src/reasoning/nodes/initial-reasoning.ts` (+4 -4) 📝 `src/reasoning/types.ts` (+7 -24) 📝 `src/reflection/nodes/explanation-reflection.ts` (+8 -2) 📝 `src/reflection/nodes/full-reflection.ts` (+8 -2) 📝 `src/reflection/types.ts` (+15 -46) 📝 `src/stores/few-shot.ts` (+14 -2) 📝 `src/stores/reflection.ts` (+18 -2) 📝 `src/utils/build-context.ts` (+11 -3) 📝 `src/utils/query.ts` (+1 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

yindo added the pull-request label 2026-02-16 08:18:47 -05:00

yindo closed this issue

2026-02-16 08:18:47 -05:00

yindo referenced this issue

2026-02-16 08:18:47 -05:00

[PR #16] [MERGED] feat: Expand reflection step to generate a summary then extract #17

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: langchain-ai/llmanager#16