langchain-ai/langsmith-docs
1
0
Fork 0
mirror of https://github.com/langchain-ai/langsmith-docs.git synced 2026-08-27 01:41:19 -04:00
Code Issues 16 Packages Projects Releases Wiki Activity

DOC: <Issue related to /evaluation/tutorials/rag> #77

New Issue
Closed
opened 2026-02-21 17:17:07 -05:00 by yindo · 0 comments
yindo commented 2026-02-21 17:17:07 -05:00
Owner
Copy Link
Copy Source

Originally created by @uhrinalex on GitHub (Jun 11, 2025).

The code provided is not working properly.

025-06-11 13:38:51 - ERROR - langsmith.evaluation._runner - _runner._run_evaluators:1674 - Error running evaluator on run b0d8e743-fb19-46ba-b847-6b98ae1cf421: 2 validation errors for ChatRequest
format.literal['','json']
Input should be '' or 'json' [type=literal_error, input_value=<module 'modules.evaluato...s\CorrectnessGrade.py'>, input_type=module]
For further information visit https://errors.pydantic.dev/2.11/v/literal_error
format.dict[str,any]
Input should be a valid dictionary [type=dict_type, input_value=<module 'modules.evaluato...s\CorrectnessGrade.py'>, input_type=module]
For further information visit https://errors.pydantic.dev/2.11/v/dict_type

Originally created by @uhrinalex on GitHub (Jun 11, 2025). The code provided is not working properly. 025-06-11 13:38:51 - ERROR - langsmith.evaluation._runner - _runner._run_evaluators:1674 - Error running evaluator <DynamicRunEvaluator correctness> on run b0d8e743-fb19-46ba-b847-6b98ae1cf421: 2 validation errors for ChatRequest format.literal['','json'] Input should be '' or 'json' [type=literal_error, input_value=<module 'modules.evaluato...s\\CorrectnessGrade.py'>, input_type=module] For further information visit https://errors.pydantic.dev/2.11/v/literal_error format.dict[str,any] Input should be a valid dictionary [type=dict_type, input_value=<module 'modules.evaluato...s\\CorrectnessGrade.py'>, input_type=module] For further information visit https://errors.pydantic.dev/2.11/v/dict_type
yindo closed this issue 2026-02-21 17:17:08 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
pull-request
Mirrored from GitHub Pull Request
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langsmith-docs#77
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?