langchain-ai/langsmith-docs
1
0
Fork 0
mirror of https://github.com/langchain-ai/langsmith-docs.git synced 2026-08-27 01:41:19 -04:00
Code Issues 16 Packages Projects Releases Wiki Activity

DOC: <Issue related to /evaluation/how_to_guides/evaluation/fetch_perf_metrics_experiment> #35

New Issue
Closed
opened 2026-02-21 17:17:01 -05:00 by yindo · 2 comments
yindo commented 2026-02-21 17:17:01 -05:00
Owner
Copy Link
Copy Source

Originally created by @majorgilles on GitHub (Nov 6, 2024).

Hello, in pratice, when we do

results = evaluate(
  lambda inputs: "Hello " + inputs["input"],
  data=dataset_name,
  evaluators=[foo_label],
  experiment_prefix="Hello",
)

resp = client.read_project(project_name=results.experiment_name, include_stats=True)

we get a not found error. If we use the evaluators project_name (a project name we are actually able to find under Tracing projects in the LangSmith UI), we do get results. What is happening here? Is the documentation outdated?

Originally created by @majorgilles on GitHub (Nov 6, 2024). Hello, in pratice, when we do ```python results = evaluate( lambda inputs: "Hello " + inputs["input"], data=dataset_name, evaluators=[foo_label], experiment_prefix="Hello", ) resp = client.read_project(project_name=results.experiment_name, include_stats=True) ``` we get a not found error. If we use the `evaluators` project_name (a project name we are actually able to find under `Tracing projects` in the LangSmith UI), we do get results. What is happening here? Is the documentation outdated?
yindo closed this issue 2026-02-21 17:17:01 -05:00
yindo commented 2026-02-21 17:17:01 -05:00
Author
Owner
Copy Link
Copy Source

@hinthornw commented on GitHub (Nov 7, 2024):

Thank you for reporting!

Running that code gives a "not found" error in the "read_project" call?

I just ran it again and it worked as expected:

import langsmith as ls

client = ls.Client()

dataset_name = "Evaluate Examples"


def foo_label(run, example):
    return {"score": 1}


results = ls.evaluate(
    lambda inputs: "Hello " + str(inputs),
    data=dataset_name,
    evaluators=[foo_label],
    experiment_prefix="Hello",
)

resp = client.read_project(project_name=results.experiment_name, include_stats=True)

How are you initializing your client?

@hinthornw commented on GitHub (Nov 7, 2024): Thank you for reporting! Running that code gives a "not found" error in the "read_project" call? I just ran it again and it worked as expected: ```python import langsmith as ls client = ls.Client() dataset_name = "Evaluate Examples" def foo_label(run, example): return {"score": 1} results = ls.evaluate( lambda inputs: "Hello " + str(inputs), data=dataset_name, evaluators=[foo_label], experiment_prefix="Hello", ) resp = client.read_project(project_name=results.experiment_name, include_stats=True) ``` How are you initializing your client?
yindo commented 2026-02-21 17:17:01 -05:00
Author
Owner
Copy Link
Copy Source

@katmayb commented on GitHub (Nov 18, 2025):

Closing this issue. We've moved to a new docs repository at: https://github.com/langchain-ai/docs/issues
If you still need to report a bug or issue with LangSmith docs, please open an issue there. Thank you!

@katmayb commented on GitHub (Nov 18, 2025): Closing this issue. We've moved to a new docs repository at: https://github.com/langchain-ai/docs/issues If you still need to report a bug or issue with LangSmith docs, please open an issue there. Thank you!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
pull-request
Mirrored from GitHub Pull Request
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langsmith-docs#35
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?