[PR #3485] [MERGED] Document evaluator re-use #3532

Closed
opened 2026-06-05 18:23:24 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/3485
Author: @fjmorris
Created: 4/7/2026
Status: Merged
Merged: 4/10/2026
Merged by: @fjmorris

Base: mainHead: fjmorris/DOC-960


📝 Commits (9)

  • 3074c9d Added evaluators.mdx to describe new Evaluators page.
  • 36f8123 Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960
  • 702ace0 Added dashes in LLM-as-a-Judge.
  • 493c06f Added Recommended as a Template category.
  • c25bbb5 Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960
  • 654fdd5 Added Created By column.
  • c20ce92 Added Template category table with descriptions.
  • 2bf2be0 Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960
  • 4b766f8 Incorporated feedback from Catherine.

📊 Changes

10 files changed (+103 additions, -34 deletions)

View changed files

📝 src/docs.json (+1 -0)
📝 src/langsmith/bind-evaluator-to-dataset.mdx (+7 -3)
📝 src/langsmith/evaluation-concepts.mdx (+7 -2)
src/langsmith/evaluators.mdx (+60 -0)
📝 src/langsmith/llm-as-judge.mdx (+6 -11)
📝 src/langsmith/online-evaluations-code.mdx (+9 -7)
📝 src/langsmith/online-evaluations-composite.mdx (+2 -2)
📝 src/langsmith/online-evaluations-llm-as-judge.mdx (+7 -5)
📝 src/langsmith/online-evaluations-multi-turn.mdx (+3 -3)
📝 src/langsmith/test-react-agent-pytest.mdx (+1 -1)

📄 Description

  • Added evaluators.mdx to describe new Evaluators page.
  • Modified other pages to describe new Add Evaluators panel.

Fixes DOC-960

Preview

Manage evaluators

evaluation-concepts
bind-evaluator-to-dataset
llm-as-judge
online-evaluations-llm-as-judge
online-evaluations-code
online-evaluations-composite
online-evaluations-multi-turn


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/3485 **Author:** [@fjmorris](https://github.com/fjmorris) **Created:** 4/7/2026 **Status:** ✅ Merged **Merged:** 4/10/2026 **Merged by:** [@fjmorris](https://github.com/fjmorris) **Base:** `main` ← **Head:** `fjmorris/DOC-960` --- ### 📝 Commits (9) - [`3074c9d`](https://github.com/langchain-ai/docs/commit/3074c9d6627f27e826e42435ff4cee049080df61) Added evaluators.mdx to describe new Evaluators page. - [`36f8123`](https://github.com/langchain-ai/docs/commit/36f812300e044caffd121b7ef4e9848df83e11fe) Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960 - [`702ace0`](https://github.com/langchain-ai/docs/commit/702ace09bbda459e568a7913ab2b5a5326206297) Added dashes in LLM-as-a-Judge. - [`493c06f`](https://github.com/langchain-ai/docs/commit/493c06fdb46309e4ee8df82d4208f50fbaf65023) Added Recommended as a Template category. - [`c25bbb5`](https://github.com/langchain-ai/docs/commit/c25bbb5817d1d83ababf0730cef9b6b9f8821f7b) Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960 - [`654fdd5`](https://github.com/langchain-ai/docs/commit/654fdd5ee1d9c5e488c27b2bd56cefe12a963785) Added Created By column. - [`c20ce92`](https://github.com/langchain-ai/docs/commit/c20ce925ac43a2283bb997bb5e9e3130b1e0ed0c) Added Template category table with descriptions. - [`2bf2be0`](https://github.com/langchain-ai/docs/commit/2bf2be07eddd5a89ef29be5ae2134d997ec7c7ab) Merge remote-tracking branch 'origin/main' into fjmorris/DOC-960 - [`4b766f8`](https://github.com/langchain-ai/docs/commit/4b766f8d4a07678b57fbc7d6c81a579a00c19a44) Incorporated feedback from Catherine. ### 📊 Changes **10 files changed** (+103 additions, -34 deletions) <details> <summary>View changed files</summary> 📝 `src/docs.json` (+1 -0) 📝 `src/langsmith/bind-evaluator-to-dataset.mdx` (+7 -3) 📝 `src/langsmith/evaluation-concepts.mdx` (+7 -2) ➕ `src/langsmith/evaluators.mdx` (+60 -0) 📝 `src/langsmith/llm-as-judge.mdx` (+6 -11) 📝 `src/langsmith/online-evaluations-code.mdx` (+9 -7) 📝 `src/langsmith/online-evaluations-composite.mdx` (+2 -2) 📝 `src/langsmith/online-evaluations-llm-as-judge.mdx` (+7 -5) 📝 `src/langsmith/online-evaluations-multi-turn.mdx` (+3 -3) 📝 `src/langsmith/test-react-agent-pytest.mdx` (+1 -1) </details> ### 📄 Description - Added evaluators.mdx to describe new Evaluators page. - Modified other pages to describe new Add Evaluators panel. Fixes DOC-960 ## Preview [Manage evaluators](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/evaluators) [evaluation-concepts](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/evaluation-concepts) [bind-evaluator-to-dataset](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/bind-evaluator-to-dataset) [llm-as-judge](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/llm-as-judge) [online-evaluations-llm-as-judge](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/online-evaluations-llm-as-judge) [online-evaluations-code](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/online-evaluations-code) [online-evaluations-composite](https://langchain-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/online-evaluations-composite) [online-evaluations-multi-turn](https://langchain-5e9cc07a-preview-fjmorr-1775760251-a4f6d5e.mintlify.app/langsmith/online-evaluations-multi-turn) --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 18:23:24 -04:00
yindo closed this issue 2026-06-05 18:23:24 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#3532