mirror of
https://github.com/esengine/DeepSeek-Reasonix.git
synced 2026-11-07 10:45:59 -10:00
Will
74ad7e5f39
A batch printed its aggregates and kept nothing they could be recomputed from, so a published figure could not be tied to the runs behind it after the temp directory was gone. -batch DIR now writes results.jsonl (one row per attempt) beside batch.json (manifest v1), and -mode audit re-derives the report's headline figures from those rows with the harness's own aggregation, printing the claim beside the recomputation and naming every figure that moved. The manifest records what the figures are over (command axes, a task-id digest, filters, and a denominator defined in tasks), which run produced them (commit or an explicit unknown, model/provider names, seed when known, timestamps, harness and runtime), and why they can still be checked (results_sha256, the claimed figures, and a ledger of planned / attempted / completed / scored / failed / unmeasured / excluded that the audit checks for consistency). Absent figures are omitted and read as unknown, never as zero. This is an aggregation audit, not a replay: it proves the published figures follow from the retained rows. It does not re-execute the model, tools or environment, and a real replay (commit, corpus fingerprint, model/provider configuration, seed, flags, raw results, runtime version) is not implemented.