[PR #3462] Fix issues in chatbot simulation evaluation tutorial #3301

Closed
opened 2026-02-20 17:48:23 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langchain-ai/langgraph/pull/3462

State: closed
Merged: Yes


Description

While following the LangChain tutorial on chatbot simulation evaluation, I encountered some issues and made the following fixes to ensure proper functionality:

  1. Updated deprecated run_on_dataset to evaluate to resolve PydanticUserError

  2. Added missing langchain_community import

  3. Added required simulation_utils.py file to docs directory

Testing

Successfully ran the langsmith-agent-simulation-evaluation.ipynb notebook without any errors.

**Original Pull Request:** https://github.com/langchain-ai/langgraph/pull/3462 **State:** closed **Merged:** Yes --- ## Description While following the LangChain tutorial on [chatbot simulation evaluation](https://langchain-ai.github.io/langgraph/tutorials/chatbot-simulation-evaluation/langsmith-agent-simulation-evaluation/), I encountered some issues and made the following fixes to ensure proper functionality: 1. Updated deprecated `run_on_dataset` to `evaluate` to resolve PydanticUserError - Following the migration guide: https://docs.smith.langchain.com/old/evaluation/migration 2. Added missing `langchain_community` import 3. Added required `simulation_utils.py` file to docs directory - Source: https://github.com/langchain-ai/langgraph/blob/main/examples/chatbot-simulation-evaluation/simulation_utils.py ## Testing Successfully ran the `langsmith-agent-simulation-evaluation.ipynb` notebook without any errors.
yindo added the pull-request label 2026-02-20 17:48:23 -05:00
yindo closed this issue 2026-02-20 17:48:23 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langgraph#3301