Commit Graph
12 Commits
Author SHA1 Message Date
Nicholas Tindle 185e443aee feat: add 4 scorer kinds (retrieval, demotion, procedure, dedup) + dashboard surface + dedup React install (#40) 2026-05-26 11:34:16 -05:00
SwiftyandClaude Opus 4.7 a61df071f8 Add human scoring view with rubric correlation (#38)
* update rubric

* add human scoring feature with rubric correlation tracking

Adds an end-to-end "Score" surface for human review of completed runs:
a new persisted human_dimension_scores table mirroring judge_dimension_scores,
HTTP routes that drain an unscored backlog one chat at a time, and a React
dashboard view with rubric/objective/tool-call sidebars and Pearson-correlation
pills against the LLM judge scores. Replaces the legacy inline dashboard with
the built React bundle as the only frontend, and adds a one-shot
seed-test-scores script for retargeting old data onto the new product rubric.

Co-Authored-By: Claude Opus 4.7 <[email protected]>

* fix postgres-backend test mock for sql.unsafe column fragments

The PostgresRepository.listPresets path uses `sql.unsafe(RUN_SUMMARY_COLUMNS)`
inline inside a tagged template to interpolate the column list. JS evaluates
that call eagerly before the tagged template runs, so the mock's `sql.unsafe`
was being invoked with just the column list and throwing because the text did
not match any "from <table>" branch. Make `sql.unsafe` return an inert empty
result for fragment-style calls instead of throwing; the parent template still
records the real query string so the existing query-count assertions hold.

Co-Authored-By: Claude Opus 4.7 <[email protected]>

* refresh generated docs (quality score + workspace inventory)

Re-run of `docs:quality` and `docs:workspace` after the test fix.

Co-Authored-By: Claude Opus 4.7 <[email protected]>

---------

Co-authored-by: Claude Opus 4.7 <[email protected]>
2026-05-08 16:18:25 +02:00
Swifty 32023907f3 updating to full react app 2026-05-05 11:58:31 +02:00
Swifty 063f5c9e66 add pre-release preset 2026-05-04 14:17:22 +02:00
Swifty 355bfbeb61 update ui 2026-04-28 15:39:10 +02:00
Swifty ffc3daf3cc seed presets 2026-04-22 12:22:25 +02:00
SwiftyandCodex 7dd6e5226d chore(harness): add update-harness skill and CI gate
Summary:
- Add the repo-local update-harness skill and Claude skill symlink.
- Add a Bun-owned ci command and route GitHub CI through it.
- Tighten generated-doc freshness and workspace inventory generation.

Rationale:
- Keeps the harness upgrade workflow available in-repo for future agents.
- Gives local and hosted CI one shared command instead of duplicated YAML.
- Makes generated inventory depend on tracked files and catches real drift.

Tests:
- bun install --frozen-lockfile
- bun run ci

Co-authored-by: Codex <[email protected]>
2026-04-18 22:19:15 +02:00
Swifty 4747f055fe Switch project to typescript 2026-04-10 15:39:47 +02:00
Swifty f686578b17 switch to typescript 2026-04-10 15:07:35 +02:00
Swifty 3d9d836beb Implemented the docs and repo-contract restructure so the repository now presents a Bun-first, agent-first knowledge base instead of the old Python-first docs story. 2026-04-10 13:12:56 +02:00
Swifty bc61929c4b update harness 2026-04-10 12:28:53 +02:00
Swifty a26419d8d4 setup project for agentic harness development 2026-04-09 14:45:41 +02:00