langchain-ai/langsmith-docs
1
0
Fork 0
mirror of https://github.com/langchain-ai/langsmith-docs.git synced 2026-08-27 09:51:18 -04:00
Code Issues 16 Packages Projects Releases Wiki Activity

[PR #525] [MERGED] wip: eval how to revamp #577

New Issue
Closed
opened 2026-02-21 17:18:24 -05:00 by yindo · 0 comments
yindo commented 2026-02-21 17:18:24 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/langsmith-docs/pull/525
Author: @baskaryan
Created: 11/12/2024
Status: ✅ Merged
Merged: 11/23/2024
Merged by: @baskaryan

Base: main ← Head: bagatur/eval_how_to_revamp

📝 Commits (10+)

📊 Changes

41 files changed (+1811 additions, -629 deletions)

View changed files

📝 docs/evaluation/concepts/index.mdx (+6 -5)
📝 docs/evaluation/how_to_guides/datasets/export_filtered_traces_to_dataset.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/datasets/manage_datasets_in_application.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/datasets/manage_datasets_programmatically.mdx (+4 -4)
📝 docs/evaluation/how_to_guides/datasets/share_dataset.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/datasets/version_datasets.mdx (+2 -2)
➕ docs/evaluation/how_to_guides/evaluation/async.mdx (+80 -0)
📝 docs/evaluation/how_to_guides/evaluation/audit_evaluator_scores.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/evaluation/bind_evaluator_to_dataset.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/evaluation/compare_experiment_results.mdx (+1 -1)
📝 docs/evaluation/how_to_guides/evaluation/create_few_shot_evaluators.mdx (+1 -1)
➕ docs/evaluation/how_to_guides/evaluation/custom_evaluator.mdx (+142 -0)
➕ docs/evaluation/how_to_guides/evaluation/dataset_subset.mdx (+88 -0)
➕ docs/evaluation/how_to_guides/evaluation/dataset_version.mdx (+47 -0)
📝 docs/evaluation/how_to_guides/evaluation/evaluate_existing_experiment.mdx (+4 -4)
📝 docs/evaluation/how_to_guides/evaluation/evaluate_llm_application.mdx (+183 -445)
📝 docs/evaluation/how_to_guides/evaluation/evaluate_on_intermediate_steps.mdx (+6 -2)
📝 docs/evaluation/how_to_guides/evaluation/evaluate_pairwise.mdx (+77 -58)
📝 docs/evaluation/how_to_guides/evaluation/fetch_perf_metrics_experiment.mdx (+3 -3)
📝 docs/evaluation/how_to_guides/evaluation/filter_experiments_ui.mdx (+1 -1)

...and 21 more files

📄 Description

No description provided

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/langsmith-docs/pull/525 **Author:** [@baskaryan](https://github.com/baskaryan) **Created:** 11/12/2024 **Status:** ✅ Merged **Merged:** 11/23/2024 **Merged by:** [@baskaryan](https://github.com/baskaryan) **Base:** `main` ← **Head:** `bagatur/eval_how_to_revamp` --- ### 📝 Commits (10+) - [`f7f83a9`](https://github.com/langchain-ai/langsmith-docs/commit/f7f83a954e7114c611509ccbcd7b747ccf6e2f80) wip: eval how to revamp - [`3ae30e2`](https://github.com/langchain-ai/langsmith-docs/commit/3ae30e22972d28be44986ec9c73df94a77f5fc09) wip - [`b7d4341`](https://github.com/langchain-ai/langsmith-docs/commit/b7d4341b15e4a44962dce0af813ae095d4854a96) wip - [`e4efc7d`](https://github.com/langchain-ai/langsmith-docs/commit/e4efc7d554d0a27c3b087b56080ff93cc4a314f8) wip - [`e258077`](https://github.com/langchain-ai/langsmith-docs/commit/e258077dfb4dcbb6bc1a308848ab289cc329e06b) fix - [`26a8101`](https://github.com/langchain-ai/langsmith-docs/commit/26a8101cc9c1af9eefd3bf0ea344c614f963d7ef) wip - [`ef5b3ae`](https://github.com/langchain-ai/langsmith-docs/commit/ef5b3aefd1d0c0b2ef42620d1ffbc36906923873) wip - [`ebbd945`](https://github.com/langchain-ai/langsmith-docs/commit/ebbd9459d65f97c5a7e33f8a81f24714f2ce4bd9) wip - [`028de02`](https://github.com/langchain-ai/langsmith-docs/commit/028de027a2d9755346c1454e5eb2b13ef14d503e) links - [`7d021f6`](https://github.com/langchain-ai/langsmith-docs/commit/7d021f6ed7f075d1a832621cce08bbb8115fe9b1) intro ### 📊 Changes **41 files changed** (+1811 additions, -629 deletions) <details> <summary>View changed files</summary> 📝 `docs/evaluation/concepts/index.mdx` (+6 -5) 📝 `docs/evaluation/how_to_guides/datasets/export_filtered_traces_to_dataset.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/datasets/manage_datasets_in_application.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/datasets/manage_datasets_programmatically.mdx` (+4 -4) 📝 `docs/evaluation/how_to_guides/datasets/share_dataset.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/datasets/version_datasets.mdx` (+2 -2) ➕ `docs/evaluation/how_to_guides/evaluation/async.mdx` (+80 -0) 📝 `docs/evaluation/how_to_guides/evaluation/audit_evaluator_scores.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/evaluation/bind_evaluator_to_dataset.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/evaluation/compare_experiment_results.mdx` (+1 -1) 📝 `docs/evaluation/how_to_guides/evaluation/create_few_shot_evaluators.mdx` (+1 -1) ➕ `docs/evaluation/how_to_guides/evaluation/custom_evaluator.mdx` (+142 -0) ➕ `docs/evaluation/how_to_guides/evaluation/dataset_subset.mdx` (+88 -0) ➕ `docs/evaluation/how_to_guides/evaluation/dataset_version.mdx` (+47 -0) 📝 `docs/evaluation/how_to_guides/evaluation/evaluate_existing_experiment.mdx` (+4 -4) 📝 `docs/evaluation/how_to_guides/evaluation/evaluate_llm_application.mdx` (+183 -445) 📝 `docs/evaluation/how_to_guides/evaluation/evaluate_on_intermediate_steps.mdx` (+6 -2) 📝 `docs/evaluation/how_to_guides/evaluation/evaluate_pairwise.mdx` (+77 -58) 📝 `docs/evaluation/how_to_guides/evaluation/fetch_perf_metrics_experiment.mdx` (+3 -3) 📝 `docs/evaluation/how_to_guides/evaluation/filter_experiments_ui.mdx` (+1 -1) _...and 21 more files_ </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-21 17:18:24 -05:00
yindo closed this issue 2026-02-21 17:18:24 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
pull-request
Mirrored from GitHub Pull Request
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langsmith-docs#577
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?