mirror of
https://github.com/langchain-ai/langchain-benchmarks.git
synced 2026-07-01 22:34:02 -04:00
[PR #112] [MERGED] Tool Tasks: Add eval params to task definition #120
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/langchain-ai/langchain-benchmarks/pull/112
Author: @eyurtsev
Created: 12/10/2023
Status: ✅ Merged
Merged: 12/11/2023
Merged by: @hinthornw
Base:
main← Head:eugene/add_eval_params📝 Commits (1)
2b04516x📊 Changes
6 files changed (+40 additions, -2 deletions)
View changed files
📝
langchain_benchmarks/schema.py(+22 -0)📝
langchain_benchmarks/tool_usage/evaluators.py(+1 -1)📝
langchain_benchmarks/tool_usage/tasks/multiverse_math.py(+3 -0)📝
langchain_benchmarks/tool_usage/tasks/relational_data.py(+1 -0)📝
langchain_benchmarks/tool_usage/tasks/type_writer.py(+7 -1)📝
langchain_benchmarks/tool_usage/tasks/type_writer_26_funcs.py(+6 -0)📄 Description
This will make it easier to treat all tasks uniformly.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.