[PR #315] [MERGED] feat(evals): add OOLONG eval suite #352

Closed
opened 2026-06-05 17:22:46 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/deepagentsjs/pull/315
Author: @hntrl
Created: 3/17/2026
Status: Merged
Merged: 3/20/2026
Merged by: @hntrl

Base: mainHead: hunter/oolong-eval


📝 Commits (2)

📊 Changes

19 files changed (+1025 additions, -14 deletions)

View changed files

evals/oolong/.gitignore (+1 -0)
evals/oolong/README.md (+90 -0)
evals/oolong/datasets/agnews.test.ts (+15 -0)
evals/oolong/datasets/app_reviews.test.ts (+15 -0)
evals/oolong/datasets/formality.test.ts (+15 -0)
evals/oolong/datasets/imdb.test.ts (+15 -0)
evals/oolong/datasets/metaphors.test.ts (+15 -0)
evals/oolong/datasets/multinli.test.ts (+15 -0)
evals/oolong/datasets/negation.test.ts (+15 -0)
evals/oolong/datasets/spam.test.ts (+15 -0)
evals/oolong/datasets/trec_coarse.test.ts (+15 -0)
evals/oolong/datasets/yahoo.test.ts (+15 -0)
evals/oolong/load-oolong.ts (+251 -0)
evals/oolong/make-tests.ts (+125 -0)
evals/oolong/package.json (+17 -0)
evals/oolong/scoring.ts (+257 -0)
evals/oolong/tsconfig.json (+19 -0)
evals/oolong/vitest.config.ts (+13 -0)
📝 pnpm-lock.yaml (+102 -14)

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/deepagentsjs/pull/315 **Author:** [@hntrl](https://github.com/hntrl) **Created:** 3/17/2026 **Status:** ✅ Merged **Merged:** 3/20/2026 **Merged by:** [@hntrl](https://github.com/hntrl) **Base:** `main` ← **Head:** `hunter/oolong-eval` --- ### 📝 Commits (2) - [`639d4c2`](https://github.com/langchain-ai/deepagentsjs/commit/639d4c2bcbee46e2ff6856774a219114b240b8bd) feat(evals): add oolong evals - [`d50239b`](https://github.com/langchain-ai/deepagentsjs/commit/d50239b283b42c18b92b6f1fdea8b943e1015c9c) cr ### 📊 Changes **19 files changed** (+1025 additions, -14 deletions) <details> <summary>View changed files</summary> ➕ `evals/oolong/.gitignore` (+1 -0) ➕ `evals/oolong/README.md` (+90 -0) ➕ `evals/oolong/datasets/agnews.test.ts` (+15 -0) ➕ `evals/oolong/datasets/app_reviews.test.ts` (+15 -0) ➕ `evals/oolong/datasets/formality.test.ts` (+15 -0) ➕ `evals/oolong/datasets/imdb.test.ts` (+15 -0) ➕ `evals/oolong/datasets/metaphors.test.ts` (+15 -0) ➕ `evals/oolong/datasets/multinli.test.ts` (+15 -0) ➕ `evals/oolong/datasets/negation.test.ts` (+15 -0) ➕ `evals/oolong/datasets/spam.test.ts` (+15 -0) ➕ `evals/oolong/datasets/trec_coarse.test.ts` (+15 -0) ➕ `evals/oolong/datasets/yahoo.test.ts` (+15 -0) ➕ `evals/oolong/load-oolong.ts` (+251 -0) ➕ `evals/oolong/make-tests.ts` (+125 -0) ➕ `evals/oolong/package.json` (+17 -0) ➕ `evals/oolong/scoring.ts` (+257 -0) ➕ `evals/oolong/tsconfig.json` (+19 -0) ➕ `evals/oolong/vitest.config.ts` (+13 -0) 📝 `pnpm-lock.yaml` (+102 -14) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 17:22:46 -04:00
yindo closed this issue 2026-06-05 17:22:47 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/deepagentsjs#352