Filter

Clear Filter

Archived Not Archived

Forked Not Forked

Mirrored Not Mirrored

Template Not Template

Private Public

Sort

Newest Oldest Alphabetically Reverse alphabetically Most recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks Smallest size Largest size

truera/ trulens

0 0 0

Evaluation and Tracking for LLM Experiments and AI Agents

agent-evaluation agentops ai-agents ai-monitoring ai-observability evals explainable-ml llm-eval llm-evaluation llmops llms machine-learning neural-networks

Updated 2026-10-11 21:24:50 +00:00

promptfoo/ promptfoo

0 0 0

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

ci ci-cd cicd evaluation evaluation-framework llm llm-eval llm-evaluation llm-evaluation-framework llmops pentesting prompt-engineering prompt-testing prompts rag red-teaming testing vulnerability-scanners

Updated 2026-10-11 21:24:49 +00:00

Arize-ai/ phoenix

0 0 0

AI Observability & Evaluation

agents ai-monitoring ai-observability aiengineering anthropic datasets evals langchain llamaindex llm-eval llm-evaluation llmops llms openai prompt-engineering smolagents

Updated 2026-10-11 21:10:33 +00:00

mlflow/ mlflow

0 0 0

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

agentops agents ai ai-governance apache-spark evaluation langchain llm-evaluation llmops machine-learning ml mlflow mlops model-management observability open-source openai prompt-engineering

Updated 2026-10-11 21:10:33 +00:00

langfuse/ langfuse

TypeScript 0 0 0

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

analytics autogen evaluation langchain large-language-models llama-index llm llm-evaluation llm-observability llmops monitoring observability open-source openai playground prompt-engineering prompt-management self-hosted ycombinator

Updated 2026-10-11 02:54:33 +00:00

confident-ai/ deepeval

Python 0 0 0

The LLM Evaluation Framework

evaluation-framework evaluation-metrics llm-evaluation llm-evaluation-framework llm-evaluation-metrics python

Updated 2026-10-10 00:15:09 +00:00

Heretek-AI/ harness-benchmark

Python 0 0 0

Production-grade evaluation framework & turnkey GitHub Action for benchmarking AI coding harnesses (Claude Code, Gemini CLI, Antigravity, OpenCode, DeepSeek), Model Context Protocol (MCP) servers, LSP diagnostics, and agent plugins across CoderEval & Terminal-Bench.

ablation-study ai-agents antigravity benchmark claude-code coder-eval coding-assistant deepseek developer-tools gemini-cli github-action language-server-protocol llm-evaluation lsp mcp model-context-protocol opencode terminal-bench

Updated 2026-08-22 20:33:17 +00:00