langchain-ai/langchain-benchmarks
1
0
Fork 0
mirror of https://github.com/langchain-ai/langchain-benchmarks.git synced 2026-07-01 22:34:02 -04:00
Code Issues 20 Packages Projects Releases 10 Wiki Activity

[PR #152] [MERGED] Update Math Evaluator #160

New Issue
Closed
opened 2026-02-16 00:18:23 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 00:18:23 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/langchain-benchmarks/pull/152
Author: @eyurtsev
Created: 12/19/2023
Status: ✅ Merged
Merged: 12/19/2023
Merged by: @eyurtsev

Base: main ← Head: eugene/without_question

📝 Commits (4)

📊 Changes

3 files changed (+77 additions, -3 deletions)

View changed files

📝 langchain_benchmarks/tool_usage/evaluators.py (+53 -2)
📝 langchain_benchmarks/tool_usage/prompts.py (+23 -0)
📝 langchain_benchmarks/tool_usage/tasks/multiverse_math.py (+1 -1)

📄 Description

Try another evaluator that ignores the question

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/langchain-benchmarks/pull/152 **Author:** [@eyurtsev](https://github.com/eyurtsev) **Created:** 12/19/2023 **Status:** ✅ Merged **Merged:** 12/19/2023 **Merged by:** [@eyurtsev](https://github.com/eyurtsev) **Base:** `main` ← **Head:** `eugene/without_question` --- ### 📝 Commits (4) - [`75eb702`](https://github.com/langchain-ai/langchain-benchmarks/commit/75eb702b63730425c2d8b3577169c94478a91612) x - [`04dc205`](https://github.com/langchain-ai/langchain-benchmarks/commit/04dc2057ef8dbe52ae24aa5c0bb63bfc108504f6) x - [`5269dc0`](https://github.com/langchain-ai/langchain-benchmarks/commit/5269dc0c1414d2706c96b64c4ca7f126bd5d2696) x - [`f4b492d`](https://github.com/langchain-ai/langchain-benchmarks/commit/f4b492d3946b7a863788c01e5d59e578e418f864) x ### 📊 Changes **3 files changed** (+77 additions, -3 deletions) <details> <summary>View changed files</summary> 📝 `langchain_benchmarks/tool_usage/evaluators.py` (+53 -2) 📝 `langchain_benchmarks/tool_usage/prompts.py` (+23 -0) 📝 `langchain_benchmarks/tool_usage/tasks/multiverse_math.py` (+1 -1) </details> ### 📄 Description Try another evaluator that ignores the question --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 00:18:23 -05:00
yindo closed this issue 2026-02-16 00:18:23 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
enhancement
pull-request
Mirrored from GitHub Pull Request
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langchain-benchmarks#160
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?