mirror of
https://github.com/Mintplex-Labs/langchain-python.git
synced 2026-07-21 00:35:23 -04:00
Vashisht Madhavan
aa439ac2ff
Right now, eval chains require an answer for every question. It's cumbersome to collect this ground truth so getting around this issue with 2 things: * Adding a context param in `ContextQAEvalChain` and simply evaluating if the question is answered accurately from context * Adding chain of though explanation prompting to improve the accuracy of this w/o GT. This also gets to feature parity with openai/evals which has the same contextual eval w/o GT. TODO in follow-up: * Better prompt inheritance. No need for seperate prompt for CoT reasoning. How can we merge them together --------- Co-authored-by: Vashisht Madhavan <vashishtmadhavan@Vashs-MacBook-Pro.local>
10 lines
344 B
Python
10 lines
344 B
Python
"""Chains and utils related to evaluating question answering functionality."""
|
|
from langchain.evaluation.qa.eval_chain import (
|
|
ContextQAEvalChain,
|
|
CotQAEvalChain,
|
|
QAEvalChain,
|
|
)
|
|
from langchain.evaluation.qa.generate_chain import QAGenerateChain
|
|
|
|
__all__ = ["QAEvalChain", "QAGenerateChain", "ContextQAEvalChain", "CotQAEvalChain"]
|