langchain-ai/docs
1
0
Fork 0
mirror of https://github.com/langchain-ai/docs.git synced 2026-07-23 21:05:23 -04:00
Code Issues 490 Packages Projects Releases Wiki Activity

[GH-ISSUE #1483] DOC: <Issue related to /evaluation> #44

New Issue
Open
opened 2026-02-17 17:19:03 -05:00 by yindo · 0 comments
yindo commented 2026-02-17 17:19:03 -05:00
Owner
Copy Link
Copy Source

Originally created by @mrkthmpsn on GitHub (Jul 29, 2025).
Original GitHub issue: https://github.com/langchain-ai/docs/issues/1483

Either a docs issue (how to navigate this isn't clear for providers like Bedrock) or LangSmith UI issue - evaluators aren't saving when using Amazon Bedrock as a provider, possibly because AWS_SESSION_TOKEN is left blank - despite the interface saying that that secret is optional. I can save the same evaluators using an OpenAI API key.

Apologies for the screenshots, the screen record upload failed

OpenAI screenshot, which saved as demonstrated in LangSmith tutorials
Image

Amazon Bedrock screenshot, which showed a loading state after clicking 'Create' but remained on the same screen and didn't update the evaluators list in the background
Image

Originally created by @mrkthmpsn on GitHub (Jul 29, 2025). Original GitHub issue: https://github.com/langchain-ai/docs/issues/1483 Either a docs issue (how to navigate this isn't clear for providers like Bedrock) or LangSmith UI issue - evaluators aren't saving when using Amazon Bedrock as a provider, possibly because `AWS_SESSION_TOKEN` is left blank - despite the interface saying that that secret is optional. I can save the same evaluators using an OpenAI API key. Apologies for the screenshots, the screen record upload failed OpenAI screenshot, which saved as demonstrated in LangSmith tutorials <img width="1166" height="681" alt="Image" src="https://github.com/user-attachments/assets/82ea1d0f-ea97-4990-8fc5-2c132fbb93aa" /> Amazon Bedrock screenshot, which showed a loading state after clicking 'Create' but remained on the same screen and didn't update the evaluators list in the background <img width="1165" height="682" alt="Image" src="https://github.com/user-attachments/assets/b6430e46-cadc-4374-8b7f-a48c0d93f0aa" />
yindo added the external label 2026-02-17 17:19:03 -05:00
yindo changed title from DOC: <Issue related to /evaluation> to [GH-ISSUE #1483] DOC: <Issue related to /evaluation> 2026-06-05 17:24:43 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
deepagents
docs-infra
external
external
help wanted
integration
internal
internal
javascript
js/ts
langchain
langgraph
langsmith
needs-title
pull-request
Mirrored from GitHub Pull Request
 python
reference
No Label external
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#44
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?