[PR #3861] [MERGED] docs: document deepagents eval matrix refresh script #3873

Closed
opened 2026-06-05 18:53:26 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/3861
Author: @open-swe[bot]
Created: 5/4/2026
Status: Merged
Merged: 5/4/2026
Merged by: @npentrel

Base: mainHead: open-swe/e20948c9-2e3d-2516-94b7-5aa03e17ab78


📝 Commits (1)

  • 63e4062 docs: document deepagents eval matrix refresh script [closes DOC-1070]

📊 Changes

2 files changed (+40 additions, -0 deletions)

View changed files

📝 AGENTS.md (+20 -0)
📝 CLAUDE.md (+20 -0)

📄 Description

Description

Mason asked for AGENTS.md/.github/ content describing how to refresh the deep agents model eval matrix so coding agents (open-swe) and contributors can rerun it on demand. Added a "Helper scripts" section to AGENTS.md (mirrored to CLAUDE.md) documenting scripts/refresh_deepagents_category_matrix.py, including required token scope, the manual uv run command, and the snippet path that should be committed.

Release Note

none

Test Plan

  • Verify AGENTS.md and CLAUDE.md stay in sync (enforced by check-agents-sync.yml).

Opened collaboratively by Naomi Pentrel and open-swe.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/3861 **Author:** [@open-swe[bot]](https://github.com/apps/open-swe) **Created:** 5/4/2026 **Status:** ✅ Merged **Merged:** 5/4/2026 **Merged by:** [@npentrel](https://github.com/npentrel) **Base:** `main` ← **Head:** `open-swe/e20948c9-2e3d-2516-94b7-5aa03e17ab78` --- ### 📝 Commits (1) - [`63e4062`](https://github.com/langchain-ai/docs/commit/63e40629592f55b0037a5e40fac7c28db739b63c) docs: document deepagents eval matrix refresh script [closes DOC-1070] ### 📊 Changes **2 files changed** (+40 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `AGENTS.md` (+20 -0) 📝 `CLAUDE.md` (+20 -0) </details> ### 📄 Description ## Description Mason asked for `AGENTS.md`/`.github/` content describing how to refresh the deep agents model eval matrix so coding agents (open-swe) and contributors can rerun it on demand. Added a "Helper scripts" section to `AGENTS.md` (mirrored to `CLAUDE.md`) documenting `scripts/refresh_deepagents_category_matrix.py`, including required token scope, the manual `uv run` command, and the snippet path that should be committed. ## Release Note none ## Test Plan - [ ] Verify `AGENTS.md` and `CLAUDE.md` stay in sync (enforced by `check-agents-sync.yml`). _Opened collaboratively by Naomi Pentrel and open-swe._ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 18:53:26 -04:00
yindo closed this issue 2026-06-05 18:53:26 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#3873