[PR #100] [CLOSED] change wording in bias check prompt template #108

New Issue

2026-02-15T19:15:02-05:00

yindo commented

2026-02-15 19:15:02 -05:00

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/auto-evaluator/pull/100
Author: @mziru
Created: 5/13/2023
Status: ❌ Closed

Base: main ← Head: main

📝 Commits (1)

6c28117 change wording in bias check prompt template

📊 Changes

1 file changed (+1 additions, -1 deletions)

View changed files

📝 api/text_utils.py (+1 -1)

📄 Description

I modified the bias check prompt so that the ground truth is referred to in the response as the "expected answer" rather than the "true answer", i.e. for consistency with the column name in the results display table. A bit nitpicky and not very elegant, but seems to work as intended.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/auto-evaluator/pull/100 **Author:** [@mziru](https://github.com/mziru) **Created:** 5/13/2023 **Status:** ❌ Closed **Base:** `main` ← **Head:** `main` --- ### 📝 Commits (1) - [`6c28117`](https://github.com/langchain-ai/auto-evaluator/commit/6c28117faf14d2cf0341922520517dcc96403816) change wording in bias check prompt template ### 📊 Changes **1 file changed** (+1 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `api/text_utils.py` (+1 -1) </details> ### 📄 Description I modified the bias check prompt so that the ground truth is referred to in the response as the "expected answer" rather than the "true answer", i.e. for consistency with the column name in the results display table. A bit nitpicky and not very elegant, but seems to work as intended. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

yindo added the pull-request label 2026-02-15 19:15:02 -05:00

yindo closed this issue

2026-02-15 19:15:02 -05:00

yindo referenced this issue

2026-06-05 17:14:18 -04:00

[GH-ISSUE #108] Isolated evaluation of retrieval #61

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: langchain-ai/auto-evaluator#108