docs: README records the byte-agnostic diff result on real REA output

Co-Authored-By: Claude Opus 4.8 <[email protected]>
This commit is contained in:
safishamsiandClaude Opus 4.8 committed 2026-10-18 00:30:29 +01:00
1 parent 5562a8ec37
commit 21a53119f0
1 file changed
+9 -3
+9 -3
View File
@@ -139,9 +139,15 @@ below are from this machine; they are synthetic and machine-dependent, and the
REA-call latency in the cache benchmark is modeled (real REA analyses take seconds
to minutes), so treat them as orders of magnitude, not guarantees.
- **Diff is byte-agnostic (the #4520 win).** On a build where every symbol's
location moved but the structure is identical: REAgraph reports **0% changed**;
a naive location-keyed diff reports **100% changed**.
- **Diff is byte-agnostic (the #4520 win) -- on REAL REA output.** Measured on
real `rea-agents` graphs of an Electron app (`bench/bench_diff_quality.py`,
fixtures in `bench/fixtures/diff/real`, generated via `examples/rea-docker`):
REA's node ids are per-build, so a naive id-keyed diff reports **73-80 of 56
nodes changed** on every build-pair. Matching by build-stable signature,
`reagraph diff` reports a reformatted-but-identical build as **0 changed** and
each real mutation (added endpoint / renamed function / removed handler) as
**exactly its true delta** -- precision/recall/**F1 = 1.00, noise floor 0.00**,
zero spurious changes, zero data loss.
- **Alignment abstains instead of mis-matching.** Measured against generated
ground truth: **precision 1.00** both when symbols survive and when the binary is
stripped; recall **1.00** with symbols, **0.95** stripped (structure-only). All