[PR #4091] [MERGED] Add note that few-shot examples don't work with thread-level evaluators #4091

Closed
opened 2026-06-05 19:12:43 -04:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/4091
Author: @langsmith-fleet[bot]
Created: 5/19/2026
Status: Merged
Merged: 5/26/2026
Merged by: @fjmorris

Base: mainHead: docs/few-shot-evaluators-thread-level-limitation


📝 Commits (3)

  • cfe4e8f Add note that few-shot examples don't work with thread-level evaluators
  • 9b86898 Modified create-few-shot-evaluators.mdx, added note that few-shot examples are only run-level, not thread-level.
  • 99cd3da Merge remote-tracking branch 'origin/main' into docs/few-shot-evaluators-thread-level-limitation

📊 Changes

2 files changed (+8 additions, -4 deletions)

View changed files

📝 src/langsmith/create-few-shot-evaluators.mdx (+5 -3)
📝 src/langsmith/evaluators.mdx (+3 -1)

📄 Description

Fixes DOC-1147

Summary

  • Added a note to the few-shot evaluators page (src/langsmith/create-few-shot-evaluators.mdx) clarifying that few-shot examples are not supported with thread-level evaluators, alongside the existing note about prompt hub incompatibility.

Links

Verification

Not run; docs-only copy change.

Reviewers

Requested review from: @katmayb, @fjmorris


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/4091 **Author:** [@langsmith-fleet[bot]](https://github.com/apps/langsmith-fleet) **Created:** 5/19/2026 **Status:** ✅ Merged **Merged:** 5/26/2026 **Merged by:** [@fjmorris](https://github.com/fjmorris) **Base:** `main` ← **Head:** `docs/few-shot-evaluators-thread-level-limitation` --- ### 📝 Commits (3) - [`cfe4e8f`](https://github.com/langchain-ai/docs/commit/cfe4e8f7a9f2bd051863ea75f4bd400e0f8167ce) Add note that few-shot examples don't work with thread-level evaluators - [`9b86898`](https://github.com/langchain-ai/docs/commit/9b86898263ac725c8676ebd81feb06d03af01a95) Modified create-few-shot-evaluators.mdx, added note that few-shot examples are only run-level, not thread-level. - [`99cd3da`](https://github.com/langchain-ai/docs/commit/99cd3dae198f865ca3456de93241dd6f2d8f2fe9) Merge remote-tracking branch 'origin/main' into docs/few-shot-evaluators-thread-level-limitation ### 📊 Changes **2 files changed** (+8 additions, -4 deletions) <details> <summary>View changed files</summary> 📝 `src/langsmith/create-few-shot-evaluators.mdx` (+5 -3) 📝 `src/langsmith/evaluators.mdx` (+3 -1) </details> ### 📄 Description Fixes DOC-1147 ## Summary - Added a note to the few-shot evaluators page (`src/langsmith/create-few-shot-evaluators.mdx`) clarifying that few-shot examples are not supported with thread-level evaluators, alongside the existing note about prompt hub incompatibility. ## Links - Linear: https://linear.app/langchain/issue/DOC-1147/add-note-that-few-shot-examples-dont-work-with-thread-level-evaluators - Slack: https://langchain.slack.com/archives/C09G1T60QV9/p1779232354248469 ## Verification Not run; docs-only copy change. ## Reviewers Requested review from: @katmayb, @fjmorris --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 19:12:43 -04:00
yindo closed this issue 2026-06-05 19:12:43 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#4091