[GH-ISSUE #1494] DOC: <Issue related to /evaluation/tutorials/rag> #28

Open
opened 2026-02-17 17:19:01 -05:00 by yindo · 0 comments
Owner

Originally created by @marjan-extenteam on GitHub (May 4, 2025).
Original GitHub issue: https://github.com/langchain-ai/docs/issues/1494

I might be mistaken since I am fairly new to LangSmith, but after analyzing the source code for the latest version of the LangSmith's TypeScript library (the DynamicRunEvaluator class) it seems that asynchronous evaluator functions which communicate with an LLM and await on that call are not supported, even though they are showcased as such within the documentation's code examples.

Thank you.

Originally created by @marjan-extenteam on GitHub (May 4, 2025). Original GitHub issue: https://github.com/langchain-ai/docs/issues/1494 I might be mistaken since I am fairly new to LangSmith, but after analyzing the source code for the latest version of the LangSmith's **TypeScript** library (the `DynamicRunEvaluator` class) it seems that asynchronous evaluator functions which communicate with an LLM and await on that call are not supported, even though they are showcased as such within the documentation's code examples. Thank you.
yindo added the external label 2026-02-17 17:19:01 -05:00
yindo changed title from DOC: <Issue related to /evaluation/tutorials/rag> to [GH-ISSUE #1494] DOC: <Issue related to /evaluation/tutorials/rag> 2026-06-05 17:24:39 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#28