langchain-ai/auto-evaluator
1
0
Fork 0
mirror of https://github.com/langchain-ai/auto-evaluator.git synced 2026-07-19 22:53:35 -04:00
Code Issues 21 Packages Projects Releases Wiki Activity

[GH-ISSUE #102] Server error when using online Playground #56

New Issue
Open
opened 2026-02-15 18:17:11 -05:00 by yindo · 9 comments
yindo commented 2026-02-15 18:17:11 -05:00
Owner
Copy Link
Copy Source

Originally created by @klein-t on GitHub (May 24, 2023).
Original GitHub issue: https://github.com/langchain-ai/auto-evaluator/issues/102

I keep getting this error whenever I try to run an experiment on the online Playground. Any idea on what's wrong? Do I need to run the tool locally?

image

Originally created by @klein-t on GitHub (May 24, 2023). Original GitHub issue: https://github.com/langchain-ai/auto-evaluator/issues/102 I keep getting this error whenever I try to run an experiment on the online Playground. Any idea on what's wrong? Do I need to run the tool locally? ![image](https://github.com/langchain-ai/auto-evaluator/assets/62718109/c6b32c58-ae4a-4ce9-9d22-b4108dc51f83)
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@rich5000 commented on GitHub (Jun 2, 2023):

getting the same error here as well, are there other requirements to test the online playground?

@rich5000 commented on GitHub (Jun 2, 2023): getting the same error here as well, are there other requirements to test the online playground?
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@rlancemartin commented on GitHub (Jun 2, 2023):

What inputs (settings and document) are you testing? This indicates a general error with the back-end, but doesn't tell us the specific problem. For example, the LLM API may have thrown an error or there might have been an invalid token in your doc. I can try to reproduce if you send along your inputs.

@rlancemartin commented on GitHub (Jun 2, 2023): What inputs (settings and document) are you testing? This indicates a general error with the back-end, but doesn't tell us the specific problem. For example, the LLM API may have thrown an error or there might have been an invalid token in your doc. I can try to reproduce if you send along your inputs.
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@rich5000 commented on GitHub (Jun 3, 2023):

the playground seems to be working fine now with all the same inputs. Maybe there was a server issue yesterday? Once again, thanks for the great work on this repo!

@rich5000 commented on GitHub (Jun 3, 2023): the playground seems to be working fine now with all the same inputs. Maybe there was a server issue yesterday? Once again, thanks for the great work on this repo!
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@rklostermann commented on GitHub (Jul 10, 2023):

I'm having the same issue. Do I need to input any API key to use the front end playground?

@rklostermann commented on GitHub (Jul 10, 2023): I'm having the same issue. Do I need to input any API key to use the front end playground?
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@TechnicolorGUO commented on GitHub (Jul 11, 2023):

even the demo did not work

@TechnicolorGUO commented on GitHub (Jul 11, 2023): even the demo did not work
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@hwaneric commented on GitHub (Jul 17, 2023):

Getting the same server error even when just trying to re-run the experiment on the base demo

@hwaneric commented on GitHub (Jul 17, 2023): Getting the same server error even when just trying to re-run the experiment on the base demo
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@karansapolia commented on GitHub (Jul 17, 2023):

Getting the same server error even when just trying to re-run the experiment on the base demo

The auto-evaluator tool is basically unusable at the moment for me because of this. Cannot even run the demo.

@karansapolia commented on GitHub (Jul 17, 2023): > Getting the same server error even when just trying to re-run the experiment on the base demo The auto-evaluator tool is basically unusable at the moment for me because of this. Cannot even run the demo.
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@rlancemartin commented on GitHub (Jul 17, 2023):

Ya, back-end is down due to issue w/ provider (Railway). Working on a fix now cc @hwchase17

@rlancemartin commented on GitHub (Jul 17, 2023): Ya, back-end is down due to issue w/ provider (Railway). Working on a fix now cc @hwchase17
yindo commented 2026-02-15 18:17:12 -05:00
Author
Owner
Copy Link
Copy Source

@flyspirit99 commented on GitHub (Aug 11, 2023):

Still not working.

@flyspirit99 commented on GitHub (Aug 11, 2023): Still not working.
yindo changed title from Server error when using online Playground to [GH-ISSUE #102] Server error when using online Playground 2026-06-05 17:14:16 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
bug
good first issue
pull-request
Mirrored from GitHub Pull Request
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/auto-evaluator#56
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?