Compare commits

..
158 Commits
Author SHA1 Message Date
esengine 9e3c62ed1e chore(release): 0.7.1 2026-04-25 04:47:34 -07:00
esengine ee274035c6 fix(loop,prompt): storm recovery, PYTHONUTF8, recency rule
Three runtime fixes that all surfaced from a single user trace
(model looped on a broken read_file, the chat ended without
explanation, embedded GBK encoding errors, plus a separate
"PDF report on global economy" turn that wrote a 2024 report
from training memory instead of searching).

Storm-break no longer dead-ends the turn
- When the storm-breaker suppressed every tool call in a turn,
  the loop yielded `done` with empty assistant content. The user
  saw a one-line warning then silence and didn't know what to do.
  Now routes through `forceSummaryAfterIterLimit` with a new
  `"stuck"` reason: the model gets one no-tools call to explain
  what it tried, what blocked, and what would unblock — turning
  the silent stop into actionable feedback the user can act on.

PYTHONUTF8 / PYTHONIOENCODING for spawned shells
- run_command's spawn env now sets PYTHONIOENCODING=utf-8 and
  PYTHONUTF8=1. On Chinese Windows, Python's default stdout
  encoder is GBK; emoji / non-GBK output raises UnicodeEncodeError
  and the model sees a Python traceback instead of the script's
  real result, then loops trying to fix the wrong problem.
  These env vars force UTF-8 unconditionally. Harmless on
  non-Python processes (env vars they don't read).

Recency rule in default chat system prompt
- New short section in DEFAULT_SYSTEM telling the model that
  when an answer's correctness depends on something that
  changes over time (the user is asking what's *happening*,
  not what's *true*) and a search tool is available, search
  before composing. Phrased as a principle ("if I'm wrong
  about this, is it because reality moved on?") rather than
  a topic list, so it doesn't go stale or over-prescribe.
- web_search description rewritten in matching language —
  emphasis on "current state" rather than enumerating
  topics like markets / news / releases, which tied the
  description to a particular moment in time.

Tests: loop +1 (storm→summary regression). 1264 tests total,
lint + tsc + build clean.
2026-04-25 04:47:27 -07:00
esengine 500868b490 fix(ui,prompt): paste sentinels, hard /clear, multi-line nav
Several long-standing input-box and TUI annoyances fixed in one batch.

Paste handling
- Big pastes (3000-line error logs, etc.) used to be inlined into
  the buffer verbatim — surrounding typed text drowned, every
  keystroke re-rendered hundreds of rows. Replace with a sentinel
  scheme: each paste blob becomes ONE PUA codepoint in the buffer
  (`\uE100..\uE1FF`), full content lives in a side registry,
  rendered as `[paste #N · 33l · 1.0KB]` magenta block. Buffer
  stays small, cursor steps over the placeholder as one unit, a
  single Backspace removes the whole paste. On submit the
  sentinels expand back to full content for the model.
- Bracketed-paste mode (DECSET 2004) enabled at app start so
  cooperating terminals deliver one marker pair per paste action.
- For terminals where the markers don't reach Ink (PowerShell +
  ConPTY parses them out), a sub-30ms time-window + position-guard
  fallback collapses chunks of one paste into a single sentinel.
  30ms is well below human reaction for double-pasting (~100ms+),
  so two deliberate pastes never falsely merge.
- Critical fix: PowerShell+Ink fires useInput TWICE per stdin
  chunk, both with stale React closure over `value` / `cursor`.
  The merge guard read stale state and never matched the previous
  sentinel — one Ctrl+V kept producing four `[paste #N]`
  placeholders. registerPaste now reads from refs we update
  synchronously inside the function, so the second fire sees the
  first's insert.
- Pasted CR/CRLF normalize to LF; bracketed-paste markers are
  stripped if they leak through.

Multi-line cursor
- ↑/↓ at the buffer boundary (line 0 / last line) used to be
  silent NOOP — felt stuck. Now hands off to the parent's history
  recall, so users can escape into history from a multi-line
  draft without first emptying it.
- Raw-escape fallback: terminals that don't set `key.upArrow`
  and instead leak `\x1b[A` into `input` (older Windows configs)
  now get the escape rewritten into the structured key event,
  preventing the literal escape bytes from being inserted.

Buffer-wide shortcuts
- PageUp / PageDown jump to top / bottom of the WHOLE buffer
  (was NOOP).
- Ctrl+U clears the entire buffer (readline-style; necessary
  given the renderer can collapse the buffer to a few visible
  rows after a paste — backspacing N times wasn't ergonomic).
- Ctrl+W deletes the word before the cursor (eats trailing
  whitespace first, spans newlines).
- Hint row appears under the input when buffer has > 20 lines:
  `[N lines · PageUp/PageDown jump to top/bottom · Ctrl+U clear ·
  Ctrl+W del word]` so users discover the shortcuts in the
  exact moment they need them.

Visual stability
- StatsPanel pinned to `width={columns}` so each render's frame
  is exactly terminal-width — reduces (doesn't eliminate) the
  resize ghost-frame stacking from Ink's eraseLines miscount on
  re-wrapped lines.
- /help gains a "Known limitation" section about the resize
  artifact so users aren't blindsided.

`/clear` actually clears
- Used to only `setHistorical([])` (React state). Terminal
  scrollback was untouched — user kept seeing prior turns until
  they scrolled past them. Now writes CSI 2J + 3J + H so the
  viewport AND scrollback buffer are nuked. Ink's next render
  paints the TUI on the fresh screen.

Tests: paste-sentinels (new file, 18 tests), multiline-keys +57.
Total 1264 tests, lint + tsc + build clean.
2026-04-25 04:47:05 -07:00
esengine 7aa71324c4 feat(md): extended markdown rendering
Substantial expansion of the chat-output Markdown renderer.

Block-level
- Blockquote `>` with proper recursion: nested quotes (`> >`) render as
  adjacent left bars, lists / code fences / tables INSIDE a quote
  parse via the same `parseBlocks` recursively (instead of being
  flattened to text), GFM-style.
- Task lists (`- [ ]` / `- [x]`) — item text gains `task: "todo" |
  "done"`, rendered as `☐` / `☒` with strikethrough on done items.
- Diagram code blocks (mermaid / dot / graphviz / plantuml / puml /
  flowchart / sequencediagram / gantt / erdiagram) render with a
  distinct magenta double-line frame + `◇ <lang> diagram (source)`
  header + viewer-URL hint. Terminal can't draw the graph, but the
  user knows it's source-of-a-diagram and where to paste it.
- Hard line break: trailing `  ` (two-or-more spaces) on a line now
  inserts a real `\n` in the rendered paragraph instead of being
  silently collapsed into a space.

Inline
- `***bold-italic***` (added as the first INLINE_RE alternative
  before the bold and italic checks).
- `~~strikethrough~~` (with proper guards so subscript / strike
  don't fight).
- Pandoc-style `^x^` superscript and `~x~` subscript — only
  fire when every char is in the Unicode SUPERSCRIPT/SUBSCRIPT
  table; otherwise leave the markers literal so we don't drop the
  user's intent.
- Math: `$inline$` and `$$block$$` delimiters are stripped
  (delimiters only — content still flows through the existing
  LaTeX → Unicode pipeline).
- Emoji shortcodes: ~70-entry curated table covering the common
  faces / hearts / gestures / signals (`:smile:`, `:fire:`, `:+1:`,
  `:white_check_mark:`, etc.). Unknown names pass through literal.
- Autolinks: `<http://…>`, `<https://…>`, `<mailto:…>`, `<ftp://…>`
  rewrite to `[url](url)` so the existing link path renders them.
- Backslash escapes: `\*` / `\` ` ` / `\~` / `\[` / `\]` / `\`  etc.
  emit literal characters via a final INLINE_RE branch — the
  surrounding markup parsers don't get to consume the escaped
  punctuation. `stripInlineMarkup` rebuilt around a single-pass
  INLINE_RE walk so escape precedence matches the runtime.

Citation guard
- `collectCitations` now skips URLs that obviously aren't repo
  paths: anchor-only (`#foo`), bare `/`, and short placeholder
  words with no `/` `\` or `.` in them. Eliminates the false
  "broken citation" red-strikethrough on demo / non-citation
  links.

Bug fixes uncovered along the way
- `\sum_{i=1}^n` and friends were being eaten by the catch-all
  LaTeX command stripper because `\b` doesn't match between `m`
  and `_` (both are word chars). Switched the relevant rules to
  `(?![a-zA-Z])` so the specific Σ / Π / ∫ / etc. substitutions
  fire even when followed by a subscript.

Tests: markdown 60 → 173 (+113).
2026-04-25 04:45:21 -07:00
esengine e530cab7a7 chore(release): 0.7.0 2026-04-24 20:14:25 -07:00
esengine bf45687414 chore(models): retire deepseek-chat/-reasoner defaults, name v4 directly
deepseek-chat and deepseek-reasoner are now just compat aliases for
v4-flash's non-thinking and thinking modes (same underlying model,
same bill per telemetry.ts). Presets already all point at
deepseek-v4-flash / deepseek-v4-pro. Retire the old names everywhere
they were still surfacing as the default or discoverable surface:

- harvest.ts default model: deepseek-chat → deepseek-v4-flash
  (behaviorally identical — both route to v4-flash non-thinking)
- subagent tool enum: drop deepseek-chat/-reasoner; users pick
  flash vs pro now, no legacy names to distract the model
- subagent JSDoc: default was documented as pro but the actual
  constant is flash; fix the docs
- /model empty-arg hint: suggest v4 names instead of legacy aliases
- /think empty-reasoning hint: explain "thinking-mode models"
  generically instead of pinning to deepseek-reasoner

Kept legacy names in telemetry.ts (DEEPSEEK_PRICING,
DEEPSEEK_CONTEXT_TOKENS) because historical usage.jsonl rows still
reference them — the table is for pricing old sessions, not routing
new requests. Runtime `--model deepseek-chat` still works; the
isThinkingModeModel() abstraction is semantic (thinking vs
non-thinking), not version-bound, so it stays correct.
2026-04-24 20:14:20 -07:00
esengine f28d27290c fix(r1): unify reasoning_content round-trip around producing model
Prior fixes (0.5.15, 0.5.18) progressively unscoped the stamp but kept
a reasoning.length > 0 guard that silently dropped the field whenever
the model happened to return empty reasoning — legitimate on flash
thinking-mode turns with zero reasoning deltas, forced-summary paths
whose resp.reasoningContent is null, and non-streaming responses
returning reasoning_content: null. The next API call then 400'd with
"The reasoning_content in the thinking mode must be passed back."

Architectural smell: assistantMessage gated on reasoning-content
presence, while syntheticAssistantMessage gated on model type — two
different encodings of the same invariant.

Unify both around isThinkingModeModel(producingModel): the field is
present on the persisted assistant turn iff the model that generated
it runs in thinking mode, using the captured reasoning (or empty
string) as the value. Call sites pass the real producing model — not
this.model — so escalation (pro) and forced-summary (flash)
round-trip correctly.

Session-load heal: stampMissingReasoningForThinkingMode back-fills
empty reasoning_content on assistant turns from pre-fix session
files, so resuming an older session on a thinking-mode model no
longer 400s on the first request.

Tests: +5 (null-reasoning stamping on v4-flash, chat stays clean,
session-load heal for reasoner/v4-pro/chat). 1150 tests, tsc clean.
2026-04-24 20:14:05 -07:00
esengine 5453fc6dc3 refactor(plan): finish the split model started — types out, explicit barrel, per-tool helpers
The agent's live-run refactor (2c8... in the local log) correctly
split plan.ts into plan-core + plan-errors and preserved the barrel,
but stopped short of three things worth doing:

1. plan-errors.ts was mis-named — it also held the value types
   (PlanStep, PlanStepRisk, StepCompletion). Extracted those to
   a new plan-types.ts so file names match contents. Dependency
   direction is now plan-core → plan-errors → plan-types.

2. Barrel used \`export *\` from both modules, which would silently
   shadow on any future name collision. Replaced with explicit named
   re-exports so TS catches duplicates the moment they appear.

3. plan-core.ts was still ~240 lines, mostly a single
   registerPlanTool body with three inline tool-description strings.
   Split into registerSubmitPlan / registerMarkStepComplete /
   registerRevisePlan (one per screen) with descriptions hoisted to
   SCREAMING_SNAKE constants at the top and the duplicated step-item
   schema extracted to STEP_ITEM_SCHEMA. Function bodies now read as
   control flow, not prose. Public API unchanged.

1145 tests still green, typecheck + lint clean. Zero behavior change.
2026-04-24 19:55:39 -07:00
esengine 94a3c9d56e fix(choice): rewrite ask_choice guidance as one principle, not pattern list
Previous pass at tightening ask_choice guidance leaned on specific
anti-patterns — "方案 A:" headers, "你选哪个?" trailers, markdown
comparison tables. Ugly and brittle: next time the model adopts a
slightly different phrasing, we'd be patching yet another bullet.

Reframe as a single principle in both the tool description and the
code system prompt: "if the user is supposed to pick, the tool
picks — you don't enumerate the choices as prose." The model can
generalize from that.

Behavior contract is unchanged; the guidance is just cleaner and
easier to maintain. Prompt-engineering change only, no code logic.
2026-04-24 19:28:50 -07:00
esengine 4cb445b280 feat(plan): /replay — Time Travel canvas for archived plans
Atlas W2 wave 2: load an archived plan as a read-only snapshot.
'/replay' defaults to the newest archive; '/replay 2' jumps to the
second-newest; '/plans' enumerates the full set.

- SlashResult grows replayPlan field so the handler can push a
  structured payload — App.tsx mounts it as a plan-replay event
  rather than flattening to info text. Keeps the bordered box +
  step list + markdown body styling consistent with plan-resumed.
- New plan-replay DisplayRole + EventRow branch: gray border, ⏪
  icon, dim header (completed time, N/total nav, archive filename),
  markdown body rendered through the full pipeline, PlanStepList
  with every step marked done, footer hint for jumping archives.
- /replay handler in plans.ts looks up listPlanArchives(session)
  by 1-based index, validates range, carries the payload through.
  Per-session only — same project-isolation as /plans.
- /replay added to commands.ts with argsHint=[N] so slash
  autocomplete / hint surface picks it up.

Tests: 6 new slash tests cover default-newest, indexed lookup,
out-of-range rejection, empty-archive state, no-session guard, and
/plans summary label surfacing. Full suite 1145 green.
2026-04-24 19:16:18 -07:00
esengine 918ed2ca50 feat(plan): persist markdown body + add human summary field
Two schema additions that unblock Time Travel and make /plans
listings useful.

- submit_plan accepts optional \`summary\`: one-line title. Surfaces
  in the PlanConfirm header, the resume banner, and /plans so users
  identify plans by intent ('Refactor auth into signed tokens')
  rather than by filename.
- plan.json now stores the markdown \`body\` that came in with
  submit_plan. Replay will read this; previously the body only
  lived in the JSONL log, which is fine for the active session but
  hard to surface in a closed archive without re-parsing tool-call
  JSON.

Both fields are optional. Older plans without them still load and
render cleanly; /plans falls back to filename when no summary is set.

PlanProposedError carries summary through toToolResult. plan-store's
savePlanState grows an extras bag so callers don't have to care
about field proliferation. listPlanArchives surfaces both fields
on the PlanArchiveSummary type.

Tests: body+summary roundtrip, omission default, submit_plan
summary trim behavior, blank-rejection. Total: 1139 tests green.
2026-04-24 19:06:43 -07:00
esengine ebc967be35 feat(plan): /plans slash — list active + archived plans for the session
Adds a per-session history view. Active plan (from plan.json) +
archived completed plans (.done.json), newest-first. Project-local
by design — cd to another project to see its plans, no cross-project
listing.

Output:
  ▸ active plan: 2/5 steps done · last touched 1h ago

  Archived (3):
    ✓ 3d ago     5 steps · complete  code-foo.plan.2026-04-21-...done.json
    ✓ 2026-04-15 8 steps · complete  code-foo.plan.2026-04-15-...done.json
    ✓ 2026-04-10 3 steps · complete  code-foo.plan.2026-04-10-...done.json

- listPlanArchives scans sessionsDir() for the session-prefixed
  .done.json files. Sorts by stored updatedAt (with mtime fallback
  for hand-edited archives). Skips corrupt JSON / wrong-version /
  zero-steps archives instead of failing the whole list.
- /plans handler renders both views; falls back to a discovery hint
  when no plans exist yet.
- Tests: 6 new — empty state, ordering, active-only ignored,
  cross-session isolation, corrupt-resilience, mtime fallback.

Foundation for upcoming /replay <archive> + Time Travel canvas —
both will read these summaries to find replayable artifacts.
2026-04-24 18:55:42 -07:00
esengine 2e64d63c8b feat(plan): auto-archive completed plans for the artifact trail
When the model marks the final step done, the active plan.json moves
to a timestamped .done.json archive instead of lingering. Two reasons
this matters: (1) the next session starts with a clean slate — no
stale resume banner for work that's actually finished; (2) the
archive is the foundation Time Travel replay will read from in W2
wave 2 to show "what the model actually did vs what was planned".

- archivePlanState renames plan.json → plan.<ISO-stamp>-<rand>.done.json
  in sessionsDir(). Random 4-char suffix dodges within-millisecond
  collisions if two plans finalize back-to-back. Returns the archive
  path, or null when there's no active plan / rename fails.
- App.tsx mark_step_complete handler: after the progress row pushes,
  if total > 0 && completed >= total, archive and post a
  '▸ plan complete — all 5 steps done · archived' info row.
- Tests: 4 new — null-return on missing, rename verification,
  payload preservation through archive, collision-resistance.
2026-04-24 18:50:30 -07:00
esengine 6d8a2c596c feat(loop): visible reasons for auto-escalation decisions
Auto-escalation (flash → pro) was the only truly automatic per-turn
decision the user couldn't see into. The warning fired but said only
'flash requested escalation' or 'flash hit N edit failure(s)' — no
WHY. Two changes surface the rationale.

1. Self-report marker now carries an optional reason:
     <<<NEEDS_PRO>>>                    ← bare, still works
     <<<NEEDS_PRO: <reason>>>>          ← preferred, surfaces in warning

   parseEscalationMarker pulls the reason out, the warning becomes
   '⇧ flash requested escalation — <reason>'. Buffer bumped to 256
   chars so reasons aren't truncated mid-stream. The streaming
   look-ahead now uses looksLikePartialEscalationMarker so multi-
   line / colon-form markers don't flush prematurely.

2. Failure-threshold escalation tracks PER-TYPE counts (search-
   mismatch, scavenged, truncated, storm-broken). The warning now
   says 'flash hit 2× search-mismatch, 1× truncated' instead of
   '3 repair/error signals'. Same FAILURE_ESCALATION_THRESHOLD
   semantics; just better attribution.

ESCALATION_CONTRACT prompt fragment teaches both forms with examples.
Three new tests cover the reason-carrying marker, empty-reason edge,
and the unclosed-marker fallthrough (still treats as content, no
silent retry on a malformed signal).
2026-04-24 18:45:27 -07:00
esengine f6931481ba feat(plan): render full step list on resume, not just a one-liner
The W2 resume banner was a single info row — '▸ resumed plan: 2/5
steps done · last touched 3h ago'. Useful but minimal. Users had no
way to see WHICH steps were done or what's coming next without
scrolling back through the prior session's log.

New plan-resumed display role mounts a bordered box at the top of
the new session: header (badge + counter + relative time) plus
the full PlanStepList — same component used in PlanConfirm and the
checkpoint picker, with done steps dimmed + ✓, the next pending
step focused with the › cursor, and the risk gutter color-coded.

Carries the structured plan data through DisplayEvent.resumedPlan
so the renderer doesn't need access to the live planStepsRef. Pure
render layer; no new logic, no new tests needed (plan-store tests
already cover the data side).
2026-04-24 18:21:04 -07:00
esengine 15b0cfc894 feat(plan): persist structured plan state across session restarts
Atlas W2 wave 1: the plan the model submits via submit_plan (and
mutates via mark_step_complete / revise_plan) now survives terminal
close. Without this, all the structured-step / risk / checkpoint /
revise UX evaporated whenever you took a coffee break.

- New src/code/plan-store.ts: loadPlanState / savePlanState /
  clearPlanState / relativeTime. Storage path mirrors the JSONL
  convention: ~/.reasonix/sessions/<sanitized>.plan.json. Format is
  versioned (v1) with defensive parsing — corrupt files load as
  null, malformed step entries are filtered, invalid risk values
  are stripped, the rest of the plan still loads.
- App.tsx: load on mount, save after every plan-state change
  (submit_plan, mark_step_complete, revise_plan accept), clear on
  PlanConfirm cancel. The persistPlanState callback is threaded
  through all the relevant useCallback deps so React's exhaustive-
  deps rule stays clean.
- Resume banner: when an existing plan loads on startup, push
  '▸ resumed plan: 2/5 steps done · last touched 3h ago' into the
  scrollback so the user immediately sees the picked-up state.
- Tests: 15 covering save/load roundtrip, malformed-JSON recovery,
  version mismatch, partial step sanitization, completedStepIds
  filtering, path safety, and relativeTime branches.

The plan markdown body itself is NOT persisted here — it lives in
the session JSONL (it was a tool result), so resuming the session
replays it naturally. We carry forward only the live state needed
to keep mark_step_complete and revise_plan meaningful.
2026-04-24 18:16:05 -07:00
esengine 331e01fda1 feat(ui): tool duration + /tool N hint on compact rows
Compact tool rows now annotate with timing and a navigation hint:

  ▣ run_command (1.2s) → exit 0 · ✓ tests passed       /tool 12
  ▣ read_file → import { foo } · 234 lines · 4.5KB     /tool 13
  ▣ search_content (8.5s) → 5 matches · src/foo.ts:12  /tool 14

Duration is suppressed under 100ms (every read_file would scream
'47ms' otherwise — noise). Above that, formatDuration picks a tight
representation: ms → s.s → s → m+s as the magnitude grows.

The /tool N suffix makes the existing slash command discoverable
without scrolling — users can jump straight to full content via
`/tool 14` instead of guessing the position. toolIndex is captured
at push time as the 1-based length of the tool history.

App.tsx: toolStartedAtRef captures Date.now() on tool_start and
diffs at result. Single ref is enough — tools dispatch serially.
2026-04-24 18:04:07 -07:00
esengine 877a9ee03b feat(ui): compact one-line tool rendering with smart per-tool summary
Old tool rows were 6–8 vertical lines each (glyph row + blank + 400-
char body block). 10 tool calls in a session = ~70 lines of
mostly-noise content drowning the actually-interesting events
(checkpoint pickers, plan submissions, edit diffs).

New rendering: one line per tool call.

  ▣ read_file      →  import { foo } from 'bar' · 234 lines · 4.5KB
  ▣ list_directory →  17 entries
  ▣ search_content →  5 matches · src/foo.ts:12: const x = 1
  ▣ run_command    →  exit 0 · ✓ 17 tests passed
  ▥ run_command    ✗  exit 1 · TypeError: Cannot read property
  ▣ submit_plan    →  PlanProposedError — STOP, picker shown to user.

edit_file keeps its multi-line colored diff renderer (the diff IS the
value). Plan / Choice control-flow signals (PlanProposedError etc.)
render in non-error yellow even though they technically come through
the error envelope — they're picker triggers, not failures.

The summarizer is a pure function in tool-summary.ts so it tests
without Ink and can be reused by replay / transcript export later.
Full content remains accessible via `/tool N`.
2026-04-24 17:58:42 -07:00
esengine a4ff99236b feat(plan): revise_plan tool — surgical mid-flight plan edits with diff picker
Phase 2 Revise was just text-forwarding: user typed feedback, model
got a synthetic, model adjusted however it wanted with no structured
contract. Add revise_plan as the structured counterpart — the model
proposes new remainingSteps + a one-sentence reason, the TUI shows
a step-level diff, user accepts or rejects.

- New revise_plan tool (readOnly, throws PlanRevisionProposedError).
  Sanitization reuses sanitizeSteps so risk levels and malformed
  entries are handled the same as submit_plan.
- New PlanReviseConfirm modal: amber border, reason header, diff
  rows (-removed/red+strikethrough, +added/green, kept/dim), counter
  badge -N +M (K kept), Accept/Reject picker.
- App.tsx: pendingRevision state + handler. Accept splices the new
  steps onto the done-step prefix in planStepsRef (done work never
  undone), pushes an info row with -N+M counts, sends a continue
  synthetic. Reject sends a 'keep original' synthetic. Picker takes
  priority over checkpoint picker so a checkpoint-revise → revision-
  proposal flow chains naturally.
- Checkpoint Revise synthetic now nudges the model toward revise_plan
  for structural changes vs submit_plan for full reset.

Tests cover the error roundtrip, sanitization, risk preservation,
empty-input rejection, and the readOnly flag.
2026-04-24 17:38:53 -07:00
esengine c3d327e27f feat(plan): risk gutter + structured step list in plan pickers
Phase 1 structured steps were only used for post-approval progress
tallying — the user never saw them at decision time. Add risk-coded
step list to both PlanConfirm (approval) and PlanCheckpointConfirm
(mid-execution) so the plan shape is visible where it matters.

- New PlanStep.risk: "low"|"med"|"high" (optional). submit_plan
  description guides the model: high = hard-to-undo / prod / API
  changes; med = non-trivial but reversible; low = safe local.
- PlanStepList renders a compact list with 1–3 colored dots per step
  (●/●●/●●● green/yellow/red) + a ✓/▶/— glyph, a legend row, and
  a '3 steps · 1 done' counter. Steps without risk render a blank
  gutter, so pure-markdown plans degrade cleanly.
- PlanConfirm mounts the list above the approve/refine/cancel picker
  when steps are supplied.
- PlanCheckpointConfirm mounts the same list with the current step
  highlighted via a › cursor and completed steps dimmed, so the user
  can see what just finished and what's next before picking
  continue/revise/stop.

Result: a structured plan with risks looks like a real plan, not a
markdown blob. Pure-markdown plans keep working unchanged.
2026-04-24 10:14:48 -07:00
esengine acb3a3ffee fix(choice): make ask_choice reliably fire via tool desc + system prompt
Phase 1 ask_choice was technically working but models rarely called it
— the description leaned defensive ('don't misuse') with only a light
'use when genuinely user's call' nudge, so DeepSeek Flash kept writing
prose comparisons that ended with '你选哪个?' (no picker rendered).

Two-layer fix:
- Tool description leads with 'CALL THIS WHENEVER your next reply
  would end with A/B/C — 你选哪个?'. Spells out the self-detect
  triggers and the failure mode of text menus. 'When in doubt, call
  the tool' as the tiebreaker.
- Code system prompt gains a dedicated '# When to ask the user to
  pick (ask_choice)' section sibling to the submit_plan one, plus an
  inline warning in the submit_plan section against option-menu
  plans cross-referencing ask_choice.

Costs one prefix-cache miss on first turn after the update; hit rate
re-stabilizes after that. No test changes (the behavior under test
was already correct — this is pure prompt-engineering).
2026-04-24 09:15:28 -07:00
esengine 7e1695f945 feat(choice): ask_choice primitive for A/B/C branching decisions
New tool gives the model a proper home for branching questions —
submit_plan was getting misused as a route-picker and leaving users
stuck at approve/refine/cancel with no way to choose.

Tool throws ChoiceRequestedError (same toToolResult protocol as
PlanProposedError), TUI mounts ChoiceConfirm — a magenta-bordered
modal with the question, the option rows (title + dim summary), an
optional "Let me type my own answer" escape hatch, and cancel.
Picking routes a synthetic 'user picked <id>' back to the model;
custom ships whatever the user typed verbatim.

Registered in both code and chat modes so branching works anywhere.
Sanitizes malformed option arrays (DeepSeek V3/R1 occasionally drops
fields even with Pillar 3 auto-flatten) and caps at 6 options so the
model can't drown the user in choices. submit_plan's description now
cross-references ask_choice so the model learns the dispatch.

Foundation for the Atlas redesign — Fork Nodes in W2 will render
pending choices inline in the plan canvas instead of as a separate
modal.
2026-04-24 08:44:45 -07:00
esengine 248dd134ba fix(plan): forbid submit_plan from presenting A/B/C option menus
Tool description now explicitly tells the model not to use submit_plan
as a "pick one of these routes" menu. The approve/refine/cancel picker
has no branch selector, so a menu plan strands the user — hit in the
wild where the model used submit_plan to offer three project directions.

Branches belong in plain assistant text with a question; submit_plan
stays reserved for a single actionable plan.
2026-04-24 08:17:02 -07:00
esengine e5a75119cb feat(plan): mid-execution checkpoints — Continue / Revise / Stop
mark_step_complete now throws PlanCheckpointError so the loop pauses
after each step. A new PlanCheckpointConfirm picker drives what happens
next: Continue resumes the plan, Revise opens a feedback box whose
text is threaded into the next turn's context, Stop ends cleanly with
a summary.

Revise reuses PlanRefineInput's single-line UX with a new
"checkpoint-revise" mode label. Esc on the feedback input restores the
picker. The ✓ progress row from Phase 1 still renders before the
picker mounts, so the scrollback always records what was just done.

Ports the useful half of @imlingdu/reasonix-tools' dynamic-plan loop
into Reasonix's submit-plan / approval-gate model — Phase 3 will add
an LLM-driven revise helper on top.
2026-04-24 08:10:56 -07:00
esengine 11155add8a feat(plan): structured steps + mark_step_complete progress rows
submit_plan now accepts an optional steps:[{id,title,action}] array;
new mark_step_complete tool ticks them off during execution so the
scrollback shows `✓ step-1 · title — result (2/5)` instead of leaving
the user to infer progress from tool noise.

Pure-markdown plans keep working unchanged — steps and progress
rows only render when the model opted into the structured form.
2026-04-24 08:02:36 -07:00
esengine f82f93559b chore(release): 0.6.0
Cost control promoted to Pillar 4. Breaking behavior: default model
flipped from v4-pro to v4-flash; smart (default) preset no longer
auto-enables harvest; max preset no longer auto-enables branch 3.
New: /pro one-shot arming, failure-triggered auto-escalate, model
self-report <<<NEEDS_PRO>>>, turn-end auto-compaction, per-turn cost
badges. UI refactor: App.tsx -33%, slash.ts split into slash/ with
13 focused modules. See CHANGELOG for the full matrix.
2026-04-24 07:26:40 -07:00
esengine 5a7d16c24f fix(ui,prompt): dedupe edit_file result display; teach run_command its shell limits upfront
Two small papercuts from a 70-turn live run surfaced:

1. Every edit_file tool call showed the apply result TWICE — once
   as a dim info row (pushed by applyNow in the edit-mode
   interceptor), then again as a full `▣ edit_file → …` tool row
   yielded by the loop. Both with identical text. Wasted rows, made
   long sessions harder to skim.

   Fix: drop the info-row push inside applyNow. The returned string
   still becomes the tool result AND the model sees it via the tool
   event; the user sees it once via the tool row with its
   identifying header. The auto-text branch at turn-end (for
   text-form SEARCH/REPLACE blocks parsed from assistant prose)
   still pushes its own info row — there's no tool event to back
   it up.

2. The model repeatedly tried `cd dir && cmd`, `cmd1 | cmd2`,
   `cmd 2>&1`, learning only from the error reply. run_command's
   top-level description didn't spell the constraints upfront.

   Fix: front-load a "Constraints (read these before the first
   call):" block in both run_command and run_background
   descriptions. Explicit list of rejected operators, cd-doesn't-
   persist, and concrete alternatives (`npm --prefix`, `cargo -C`,
   `git -C`, `pytest tests/…` instead of `cd && …`). Also warns
   against unbounded-output commands like `netstat -ano` /
   `find /` that balloon context for no reason, with filtered
   alternatives.

Both are tool/UI changes only; 1054 tests green, typecheck + biome
clean.
2026-04-24 07:12:14 -07:00
esengine 292e51f0c2 fix(plan): render full plan body in scrollback, shrink PlanConfirm to picker only
User bug: "submit_plan" proposals were being truncated inside the
PlanConfirm modal with "(25 more lines truncated — resize the terminal
to see more)". The whole point of a plan review gate is that the user
can read the full thing before approving; the old design cut it off
at roughly 11 source lines to keep the picker on-screen.

Root cause: PlanConfirm rendered both the plan body (via Markdown)
AND the 3-option picker inside one Ink modal, with a hard line clamp
so total height never exceeded the TTY. The clamp fired unavoidably
on any non-trivial plan.

Fix: push the plan body to Static scrollback as a new display role
"plan" the moment submit_plan fires. The Static component renders
once into the terminal's permanent buffer (users can scroll back
through the terminal itself), and the PlanConfirm modal below
shrinks to a tight picker header + choice list. No truncation ever.

Changes:
- EventLog.tsx: new DisplayRole "plan" renders the plan body through
  the full Markdown pipeline inside a cyan-bordered box with a 📋
  header. Goes into <Static> so it's render-once + scrollable.
- App.tsx: on submit_plan detection, setHistorical pushes a "plan"
  row BEFORE setPendingPlan so the body is in scrollback by the
  time the modal mounts.
- PlanConfirm.tsx: dropped the embedded Markdown render, the line-
  clamp helper (clampBodyByLines), maxRenderedChars / terminalRows
  props, and the two constants that drove them. The modal is now
  just a header + open-questions hint + SingleSelect.
- tests/plan-confirm.test.ts deleted — its 5 tests were all for
  the removed clampBodyByLines helper.

Everything else (approve/refine/cancel semantics, staged-input
handoff, hasOpenQuestions hint toggle) unchanged. 1054 tests green.
2026-04-24 07:05:40 -07:00
esengine c5b0906576 fix(skill): run_skill accepts decorated names; index uses trailing [🧬 subagent] tag
Users hit \`run_skill({"name":"🧬 explore"}) → {"error":"unknown skill: \"🧬 explore\""}\`.
The Skills index wrote entries like \`- 🧬 explore — …\`, with the marker
LEADING the name. Models copied the whole thing verbatim into the
\`name\` argument and the lookup failed (VALID_SKILL_NAME regex rejects
emoji + spaces).

Two fixes, defense in depth:

1. Prompt format (primary fix). Rewrite skillIndexLine so the
   subagent marker trails the name, bracketed and labeled:
     old: \`- 🧬 explore — …\`
     new: \`- explore [🧬 subagent] — …\`
   Name comes first, unambiguous. The index intro + tool descriptions
   + CODE_SYSTEM_PROMPT all explicitly spell out "the \`name\` is ONLY
   the identifier before the tag."

2. run_skill normalization (belt-and-suspenders). If the model still
   passes a decorated name, strip \`[...]\` bracketed tags and pick
   the first whitespace-delimited token that starts with a word
   character. Handles every shape observed in the wild:
     "🧬 explore", "[🧬 subagent] explore", "[🧬] explore",
     "explore [🧬 subagent]", "  explore  "  → all resolve to "explore"

Tests:
- tests/skills.test.ts: updated to expect the trailing-tag format,
  explicit regression assertion against the old \`- 🧬 name\` pattern.
- tests/tools-skills.test.ts: new "normalizes decorated names" case
  exercising each decoration shape through run_skill dispatch.

All 1059 tests green.
2026-04-24 06:55:07 -07:00
esengine 30ca814809 feat(cost): model self-report escalation — flash emits <<<NEEDS_PRO>>>, loop retries on pro
Reactive-only escalation (wait for flash to rack up 3+ errors before
bumping to pro) burns tokens and time on tasks flash itself could
recognize as too hard upfront. Add a prompt-level contract: on flash,
the model can output `<<<NEEDS_PRO>>>` as the FIRST line of its
response to abort the current call and retry this turn on v4-pro,
one shot. Pro never self-escalates (the check short-circuits when
modelForCurrentCall === ESCALATION_MODEL).

This matters because non-expert users can't reliably predict which
tasks need the frontier tier. Letting the model self-assess catches
hard tasks upfront — design tradeoffs, architecture refactors, subtle
invariants — without auto-upgrading every prompt (which would destroy
the cost savings from flash-first defaults).

Implementation:
- loop.ts: NEEDS_PRO_MARKER constant, isEscalationRequest() helper,
  post-call retry check that sets _escalateThisTurn and re-enters
  the iter with `iter--; continue` on match. Streaming path buffers
  the first 80 chars / first line before yielding assistant_delta
  events so the marker never flickers on-screen before retry fires.
  Guarded against infinite retries by checking modelForCurrentCall
  against ESCALATION_MODEL — users who already chose /preset max
  see the marker as normal content.

- prompt-fragments.ts: new ESCALATION_CONTRACT fragment spells out
  when to use the marker (cross-file refactors, subtle correctness
  invariants, design tradeoffs) and when NOT to (small edits, clear
  bug fixes). Embedded into CODE_SYSTEM_PROMPT, DEFAULT_SYSTEM, and
  DEFAULT_SUBAGENT_SYSTEM — subagents default to flash+high too,
  so they benefit from the same escape hatch.

Tests (3 new in loop.test.ts):
- flash emits marker → retry on pro, final content is pro's response
- marker mid-text (not lead-in) → no retry
- pro emits marker → no infinite-retry loop

All 1058 tests green.
2026-04-24 06:47:31 -07:00
esengine 000e7c3ac0 docs(architecture): rewrite for v0.6 — four pillars, flash-first, new module layout
The previous ARCHITECTURE.md stopped at v0.3 (MCP + session persistence)
and read three-pillar (cache loop, harvest, tool-call repair) with a
roadmap that predates everything from v0.4 onward. After six months
of cost and refactor work the codebase is fundamentally different:
file layout reorganized, defaults flipped flash-first, branch + harvest
removed from every preset, /pro arming and failure-triggered
auto-escalation added.

New sections:
- Pillar 4 — Cost Control as a first-class subsystem: tiered defaults,
  turn-end auto-compaction, /pro one-shot arming, failure-signal
  auto-escalation, cost transparency thresholds.
- Module layout refreshed — reflects the slash/ + handlers/ split,
  the six hooks under cli/ui/, prompt-fragments.ts, and actual LOC
  counts (App.tsx 2931 → 1984).
- Design evolution replaces the stale roadmap — covers v0.0 through
  v0.6 with a line each so readers orient without reading six months
  of CHANGELOG.
- Non-goals updated to call out "automatic cost escalation without
  user-visible announcement" as explicitly rejected.

Pillar 2 (harvest) and Pillar 3 (tool-call repair) content kept intact
and marked as before. Pillar 1 unchanged.

Pure docs change — no code touched.
2026-04-24 06:32:00 -07:00
esengine a22355a2ab feat(cost): per-turn cost badge in StatsPanel + pro armed/escalated pills
Cost transparency is the last piece of the cost-control design —
users can now see at a glance how much the current turn cost and
which model it ran on, without opening /stats.

StatsPanel header picks up two new pills:
- ⇧ pro armed (yellow) — /pro queued, next turn will run on v4-pro
- ⇧ pro escalated (red) — current turn is on v4-pro (either /pro
  armed was consumed at turn start, or the failure threshold
  tripped mid-turn auto-escalation)

The cost cell now splits into two readings:
- turn $0.0042 — last turn's cost, colored by threshold
  (green <$0.05, yellow $0.05-0.20, red ≥$0.20)
- session $0.1234 — cumulative, same color scale 10× up
  (green <$0.50, yellow $0.50-5, red ≥$5)

No hard circuit-breaker that blocks turns — a mid-session pop-up
gate would be annoying. The colored thresholds are the signal;
users who notice yellow/red can /preset fast or /compact before
shipping the next message.

Plumbing:
- telemetry.ts: SessionSummary.lastTurnCostUsd added. Populated by
  SessionStats.summary() from the most recent TurnStats.cost.
- replay.ts + ReplayApp.tsx: summary-shape call sites updated.
- StatsPanel.tsx: proArmed/escalated props; CostCell refactor;
  turnCostColor/sessionCostColor threshold helpers.
- slash types: armPro / disarmPro ctx callbacks so the /pro handler
  can update App's mirror state synchronously.
- App.tsx: proArmed + turnOnPro state mirrors, turn-start/end
  transitions, warning-event sniff for "⇧" prefix flips turnOnPro.

Tests: 1055 green, typecheck + biome clean.
2026-04-24 06:27:23 -07:00
esengine 39a4e137dc feat(cost): /pro single-turn arming + auto-escalate on repeated flash failures
Two cost-aware escalation paths join the loop, keeping flash-first
as the default but letting the system (or the user) bump to v4-pro
when flash is visibly struggling — without requiring a persistent
preset switch.

1. `/pro` slash command arms pro for the NEXT turn only. Consumed
   at turn start, auto-disarms after the turn ends. Use case: the
   user knows the upcoming ask is hard and wants one-shot strength
   without typing /preset max + remembering to revert. Separate from
   /preset max (persistent, changes this.model) — armed state is
   strictly single-turn.

2. Auto-escalation on failure. The loop tracks visible "flash is
   struggling" signals per turn:
     - edit_file / write_file SEARCH-not-found errors
     - ToolCallRepair fires: scavenge, truncation-fix, storm-break
   Once the count hits FAILURE_ESCALATION_THRESHOLD (3) in one
   turn, the remainder of that turn's model calls upgrade to
   v4-pro. Announced via a yellow warning row — no silent cost
   surprises. Counter + escalation flag reset at every turn start.

Wiring:
- loop.ts: `_proArmedForNextTurn`, `_escalateThisTurn`,
  `_turnFailureCount` private state. Public `armProForNextTurn`,
  `disarmPro`, `proArmed`, `escalatedThisTurn` getters for UI.
  `modelForCurrentCall()` returns the effective model (escalated
  or this.model). `noteToolFailureSignal()` centralizes the
  increment+threshold logic.
- All three chat call sites (branch path, streaming, non-streaming)
  use `modelForCurrentCall()` instead of `this.model` directly.
- stats.record uses the actual model for cost attribution.
- Library-mode default model: v4-pro → v4-flash (aligned with CLI).
- slash/handlers/model.ts: new `pro` handler with /pro, /pro off.
- slash/commands.ts: /pro registered in SLASH_COMMANDS + /help text.

Tests: 1055 green, typecheck + biome clean.
2026-04-24 05:51:24 -07:00
esengine 0383255de2 feat(cost): auto-compact tool results at turn end + lower proactive threshold
Context bloat was the real cost driver, not model tier. A single
read_file returning 12K tokens rides every subsequent turn's prompt
at the cache-hit rate; 10 reads accumulate to 100K+ carry-cost
that each turn pays until the 60% reactive threshold kicks in.
By then the user has already paid for 20-40 turns of inflated
context.

Two changes shift us from reactive to preventive:

1. autoCompactToolResultsOnTurnEnd — fires at every `done` event
   (normal completion, abort, forced summary). Shrinks every tool
   result in the log over 3000 tokens to a tight cap. The model
   can re-read the file if it needs fresh detail — one extra
   read_file call is far cheaper than dragging 12KB through every
   future turn.

2. Proactive in-turn threshold lowered from 60% → 40%. The turn-end
   compact already handles the common case; this threshold now
   only catches multi-iter turns where one tool returned a huge
   payload mid-turn, before the turn ends. 40% triggers earlier
   without waiting for context to get tight.

Net impact on long sessions: per-turn prompt tokens stop compounding.
Expected monthly cost reduction for active users: ~3-5× on long
projects where tool results accumulate.

Constants:
- TURN_END_RESULT_CAP_TOKENS = 3000 (new)
- ARGS_COMPACT_THRESHOLD_TOKENS = 800 (unchanged; per-response args shrink)

Tests: 1055 green, typecheck + biome clean.
2026-04-24 05:22:32 -07:00
esengine b2a50d50f5 feat(cost): cheap defaults everywhere — flash-first, pro opt-in, no auto-branch/harvest
Overhauls the cost model so `reasonix code` doesn't burn pro-tier
tokens by default. Three principles:

1. The default turn runs on v4-flash, not v4-pro. Pro is a ~12× tier
   and shouldn't be implicit. Users escalate with /preset max.
2. Branch and harvest are NEVER auto-enabled by any preset. Both
   multiply per-turn cost (N× and +1 flash call respectively); both
   now require explicit /branch N or /harvest on.
3. Non-user-facing model calls (forced summary on budget exhaustion,
   subagent runs, truncation repair) route through flash+high
   regardless of the user's main-turn tier. No reason to pay pro
   rates for a wrap-up paragraph or an explore subagent's grep chain.

Preset redefinition (branch=1, harvest=false for all three):
  fast   v4-flash + effort=high   cheapest · Q&A, one-line edits
  smart  v4-flash + effort=max    default · day-to-day coding
  max    v4-pro   + effort=max    ~12× fast · hard single-shots

Default preset is now `smart` (was `fast`) — flash+max is the best
price-per-quality point for coding work. `fast` is the "I just want
a quick answer" escape hatch.

Specific changes:
- cli/ui/presets.ts — new PresetSettings shape adds `reasoningEffort`;
  PRESETS values rewritten; PRESET_DESCRIPTIONS reflect cost story;
  `resolvePreset` default is now "smart".
- cli/resolve.ts — ResolvedDefaults gains `reasoningEffort`; default
  preset is "smart".
- cli/commands/code.tsx — default model v4-pro → v4-flash.
- tools/subagent.ts — DEFAULT_SUBAGENT_MODEL v4-pro → v4-flash;
  DEFAULT_SUBAGENT_EFFORT = "high" (down from parent's "max").
  Skill frontmatter `model:` / `effort:` remain the escape hatches.
- loop.ts — forceSummaryAfterIterLimit hard-codes flash+high for the
  wrap-up call; stats.record attributes the actual summaryModel so
  /stats reflects reality.
- slash handlers — /preset rewritten (persists effort now); /harvest
  and /branch print cost-warning suffixes; /help + /keys text updated
  to match new presets and warn harvest/branch are opt-in only.
- CLI --help strings for `reasonix chat` / `reasonix code` / `--preset`
  / `--harvest` / `--branch` updated.

Tests:
- resolve.test.ts: expectations updated to new defaults (flash+max,
  no branch in max preset).
- slash.test.ts: preset test expectations updated to new combos.
- subagent.test.ts: default-model fallback expectation updated.
All 1055 tests green; typecheck + biome clean.
2026-04-24 04:59:15 -07:00
esengine e486a8e23a refactor(prompt): share TUI formatting + negative-claim rules across prompts
The TUI formatting rules (GFM tables, no Unicode box-drawing, no
decorative ┌──┐ frames, flow charts as bullet lists) were
maintained as three near-identical copies across
DEFAULT_SUBAGENT_SYSTEM, BUILTIN_EXPLORE_BODY, and
BUILTIN_RESEARCH_BODY — and missing entirely from
CODE_SYSTEM_PROMPT, even though the main code reply goes through
the same markdown renderer.

Subagents also lacked the "negative claims are the #1
hallucination shape" guardrail that the main code prompt has.
When an explore/research subagent confidently reported "X is
missing", the parent swallowed it at face value.

Changes:
- New src/prompt-fragments.ts holds TUI_FORMATTING_RULES and
  NEGATIVE_CLAIM_RULE as shared constants — single source of
  truth, embedded literally so prefix-cache hashing stays stable.
- DEFAULT_SUBAGENT_SYSTEM, BUILTIN_EXPLORE_BODY, and
  BUILTIN_RESEARCH_BODY import and interpolate both fragments
  instead of open-coding their own copies.
- CODE_SYSTEM_PROMPT imports TUI_FORMATTING_RULES and appends it
  after the Style section.
- CODE_SYSTEM_PROMPT's intro tool list now names every
  filesystem tool (read_file, write_file, edit_file,
  list_directory, directory_tree, search_files, search_content,
  get_file_info) instead of trailing off at "etc." before the
  essential search_content / edit_file were listed.

Behavior change is small and aligned: fewer hallucinated absences
from subagents, fewer Unicode-box-drawing tables to patch around
in markdown.tsx. Typecheck + biome + 1055 tests green.
2026-04-24 04:38:56 -07:00
esengine a4c1e9b478 refactor(ui): split slash.ts into per-topic handler modules
slash.ts had 1786 lines: types + SLASH_COMMANDS spec + parse
helpers + a ~800-line handleSlash switch + five private feature
handlers + utility helpers. Adding a command meant editing a
monolith; tests had to load the whole thing just to call one
handler. Layout:

    slash.ts                   20-line barrel (re-exports only)
    slash/types.ts             SlashResult / SlashContext / ...
    slash/commands.ts          SLASH_COMMANDS + parse functions
    slash/helpers.ts           git/memory/token/MCP utilities
    slash/dispatch.ts          SlashHandler type + registry +
                               handleSlash lookup
    slash/handlers/
      basic.ts     exit/clear/new/keys/help/setup/retry
      mcp.ts       mcp
      memory.ts    memory family
      skill.ts     skill/skills
      admin.ts     hooks/update/stats
      observability.ts   think/tool/context/status/compact
      edits.ts     undo/history/show/apply/discard/plan/mode/commit
      jobs.ts      jobs/kill/logs
      sessions.ts  sessions/forget
      model.ts     model/models/harvest/preset/branch/effort

Each handler is a plain (args, loop, ctx) => SlashResult function;
aliases (exit/quit, new/reset, skill/skills, apply-plan/applyplan,
hook/hooks, think/reasoning, help/?) are just duplicate keys in
the per-module handlers bag. The public import surface is
preserved via the barrel so App.tsx, tests, and sibling
components keep their existing imports.

Result: slash.ts 1786 -> 20 lines, fanned out into 13 focused
files each under 265 lines. Typecheck + biome + 1055 tests green.
2026-04-24 04:28:52 -07:00
esengine 9fdbdf738b refactor(ui): extract hooks + live components from App.tsx
App.tsx had grown to 2931 lines: streaming state, edit history,
pending-edits, shell/plan/edit confirm, @-picker, slash pickers,
subagent sink, hooks live-reload and cursor tracking all in one
function body. Split the cohesive clusters into dedicated modules
with no behavior change:

- LiveRows.tsx      StatusRow / ModeStatusBar / UndoBanner /
                    SubagentRow / OngoingToolRow + summarizeToolArgs
- edit-history.ts   EditHistoryEntry type + isEntryFullyUndone /
                    entryStatus / format{EditResults,PendingPreview,
                    UndoRows} / describeRepair
- useEditHistory    session-scoped /undo /history /show machinery
- useCompletionPickers  slash-name, @-mention, slash-arg pickers
- useSessionInfo    mount-time fetch of balance / models /
                    latestVersion + refresh callbacks
- useSubagent       subagent sink ref + live activity row

Also drops two dead helpers (formatQueuedEditPreview,
formatUndoResults) that had no callers.

Result: App.tsx 2931 -> 1984 lines (-32%). Typecheck + biome +
1055 tests green.
2026-04-24 04:28:33 -07:00
esengine f3f844b3dc fix(lint): pass biome check for 0.5.24 (format + unused template + exhaustive deps + comma/assign)
- biome format pass on EditConfirm / edit-blocks / jobs / shell /
  filesystem / compact-tokens / App / slash (auto-fixes)
- drop backtick template on a plain-string literal ("failed",
  "(already reverted — …)")
- annotate interceptor useEffect with a useExhaustiveDependencies
  ignore — the closure captures are intentional; adding the refs as
  deps would tear down the interceptor on every mode flip
- add codeHistory / codeShowEdit to handleSubmit deps
- expand comma-operator tricks in tests/tools.test.ts into
  explicit statements (biome rejects `(x = 1, "y")` and comma
  operator under lint/style/noCommaOperator + noAssignInExpressions)

prepublishOnly (lint + typecheck + test + build) now passes clean.
1055 tests, dist built.
2026-04-24 02:23:37 -07:00
esengine d65ca4f67f feat(code): review/auto edit gate, background jobs, context hygiene (0.5.24)
- EditConfirm modal for per-edit review (scrollable diff); Shift+Tab
  cycles review/auto; 5s undo banner + `u` keybind; session edit
  history with /history, /show [id] [path], /undo [id] [path]
- run_background / job_output / stop_job / list_jobs tools with
  ready-signal detection; /jobs, /kill, /logs; tree-kill (Windows
  taskkill /T /F, POSIX process.kill(-pid)) so dev servers actually
  stop; cleanup on SIGINT / SIGTERM / exit
- Bottom mode status bar always above the prompt: mode, pending
  count, Shift+Tab hint, running-jobs tag; one-time onboarding tip
  on first launch after upgrade
- Context hygiene: read_file `range:"A-B"` + auto-preview for files
  >200 lines; directory_tree default depth 4→2 + skip deps
  (node_modules / .git / dist / …) + per-directory 50-child collapse;
  auto-compact tool-call args after each tool response (>800 tok);
  /compact now covers both tool results and tool-call args
- Persist reasoningEffort to config so /effort high survives restart
  (earlier: silently reverted to max); editMode already persisted
- Prompt: scope discipline on "run/start/launch" requests so the
  model stops after verifying instead of auto-refactoring; teach
  model that run_background is for dev servers and review-mode
  rejections should not be retried with the same SEARCH/REPLACE

tests: 1055 passing (+17 new)
2026-04-24 02:17:34 -07:00
esengine ee577995d0 fix(errors): actionable messages for 401/402/422 + V4 context-overflow hint (0.5.23)
Before: DeepSeek auth/balance/parameter errors surfaced as raw
"DeepSeek 401: {\"error\":{\"message\":\"...\"}}" JSON blobs. Users
saw a wall of JSON and had to know to parse it themselves to learn
their API key was bad or they were out of credit.

formatLoopError now recognizes the per-code cases:

  401 → "Authentication failed (DeepSeek 401): <inner msg>. Your API
         key is rejected. Fix with `reasonix setup` or
         `export DEEPSEEK_API_KEY=sk-...`. Get one at
         https://platform.deepseek.com/api_keys."
  402 → "Out of balance (DeepSeek 402): <inner msg>. Top up at
         https://platform.deepseek.com/top_up — the panel header
         shows your balance once it's non-zero."
  422 → "Invalid parameter (DeepSeek 422): <inner msg>"
  400 → "Bad request (DeepSeek 400): <inner msg>"

Each unwraps `{"error":{"message":"..."}}` so the reader sees prose,
not JSON. Fallback keeps the raw body if parsing fails.

Context-overflow text also refreshed: mentions V4's 1M window AND
the legacy 131k for the chat/reasoner aliases, and drops the stale
"v0.3.0-alpha.6+" reference that's long-since rolled into the 0.5
release line. The "8k tokens per tool result" cap is current
(src/mcp/registry.ts DEFAULT_MAX_RESULT_TOKENS).

429/500/502/503/504/408 retries unchanged — fully absorbed by
retry.ts before they reach formatLoopError.

1013 tests (+6). Lint / typecheck / build clean.
2026-04-23 21:22:14 -07:00
esengine e3d6fe3a86 fix(client): bump default timeout past DeepSeek's 10-min queue cap (0.5.22)
DeepSeek's 2026-04 docs spell out that when concurrency is saturated
but the request is accepted, the connection stays open for up to 10
minutes while the request waits in the queue — non-streaming bodies
fill with empty lines, streaming bodies fill with `:` SSE keep-alive
comments. Both are invisible to our parsers (JSON.parse tolerates
leading whitespace; eventsource-parser drops `:`-prefixed comment
lines per the SSE spec), so no separate handling is needed.

What WAS broken: `timeoutMs` defaulted to 120s. A request that sat
in the queue past 2 min triggered our AbortController, which burned
the queue slot and bounced through retryWithBackoff — potentially
looping through the whole queue repeatedly and never landing.

Fix: bump default to 660_000ms (11 min). Server's own 10-min cap
closes the connection first on genuine queue overflow (clean EOF
→ our retry is normal), while still catching truly hung sockets.

Callers that want a tighter budget (short-lived CI checks, smoke
tests) keep their explicit `timeoutMs` override. No API shape change.

1007 tests. Lint / typecheck / build clean.
2026-04-23 21:17:04 -07:00
esengine bfc4cd38ee docs(readme): update for V4 models, /effort, /resource, /prompt, 1M context, !/@ shortcuts
- Tagline + /preset max + /think: V3/R1 → V4 (flash + pro)
- /model row lists v4-flash/pro as primary, chat/reasoner as compat aliases
- Add /effort, /resource, /prompt, /models, /context, /stats, /keys rows
- Context window 131k → 1M; test count 648 → 1007
- New "Prompt prefixes — !cmd and @path" section documenting the bang-
  mode shell shortcut (0.5.8, now session-durable) and @-mentions
  picker (0.5.5-0.5.7) — both are daily-use features that had no home
  in the README until now.
- Panel header example bumped from 0.4.22 to the current 0.5.21 with
  the reasoning-effort `· max` badge visible.

No code changes.
2026-04-23 21:13:00 -07:00
esengine 0ccc419d0d feat(v4): integrate DeepSeek V4 — models, pricing, thinking toggle, effort control (0.5.21)
Models & pricing (src/telemetry.ts):
- Add deepseek-v4-flash (¥0.2 / ¥1 / ¥2 per 1M hit/miss/out) and
  deepseek-v4-pro (¥1 / ¥12 / ¥24), converted at 7.2 CNY/USD.
- deepseek-chat and deepseek-reasoner now priced identically to
  v4-flash — per the 2026-04 V4 launch they're compat aliases for
  flash non-thinking / thinking modes respectively.
- Context bumped to 1M tokens across all four entries.

Defaults shifted to v4-pro (agent-class flagship):
- `reasonix code` mode, subagent DEFAULT_SUBAGENT_MODEL, loop
  constructor fallback, `max` preset all point at deepseek-v4-pro.
- `fast` / `smart` presets stay on chat/reasoner — those aliases are
  currently our only way to pin thinking ON or OFF via model name,
  so the preset system still has a cheap/fast option.
- Subagent tool enum widened to [v4-flash, v4-pro, chat, reasoner];
  description flipped to treat flash as the "cheaper opt-out" path.

Thinking-mode toggle + reasoning_effort (new API params):
- src/types.ts ChatRequestOptions gains `thinking?: "enabled" | "disabled"`
  serialized as extra_body.thinking.type, and `reasoningEffort?:
  "high" | "max"` as the top-level reasoning_effort field.
- src/loop.ts exposes thinkingModeForModel(model) and pins the
  correct value per model name (chat=disabled, reasoner=enabled,
  v4-*=enabled, unknown=undefined/server-default). Every turn now
  sets thinking + reasoningEffort explicitly — no more relying on
  server defaults to match what reasoning_content round-trip expects.
- reasoning_effort defaults to "max" because Reasonix is exactly the
  agent-class use case DeepSeek's docs call out.

UI: /effort slash + StatsPanel badge:
- `/effort [high|max]` flips the loop's reasoningEffort mid-session.
- `/effort` no-arg reports the current value.
- StatsPanel header shows a green `· max` or yellow `· high` tag next
  to harvest/branch/PLAN so users always see which tier the next turn
  will use. `/status` flags line also reports it.

Harvest cost tuning (src/harvest.ts):
- Default model reverted to deepseek-chat — harvest is a micro-
  extraction (4 small arrays of strings), not agent work.
- chat() call explicitly pins thinking=disabled + effort=high so a
  future default-model swap can't accidentally promote this micro-
  call into a multi-thousand-reasoning-token request.

1007 tests (+9 new: thinking toggle, /effort slash, v4 pricing).
Lint / typecheck / build clean.
2026-04-23 21:10:13 -07:00
esengine 7542aca687 feat(ui): show "N ready · building call M" during multi-tool turns (0.5.19)
Long assistant responses with many tool_calls used to render as a
single static "building tool call <write_file> · 37 chars" spinner
for 10–30s — user could see tokens being consumed but had no sense of
how many files were coming or how far along the stream was.

Each tool_call's `arguments` blob is now tried as JSON at every delta.
Once it first parses, the index is marked "ready" and the count goes
into subsequent `tool_call_delta` events. The UI label becomes
"building tool call (call 3) <write_file> · 127 chars · 2 ready"
so the user sees progress accumulating.

Dispatch timing is UNCHANGED — this is purely a visibility upgrade.
Mid-stream eager dispatch was considered and punted because it would
interact awkwardly with the repair step (truncation fix, storm
breaker, scavenge) that runs post-stream.

+6 tests locking down looksLikeCompleteJson (the gate that decides
when a streaming call counts as "ready"). 991 tests.
2026-04-23 20:18:10 -07:00
esengine 1e906bb577 fix(r1): round-trip reasoning_content on EVERY reasoner assistant turn (0.5.18)
0.5.15 scoped the fix too narrowly — only attached reasoning_content
when `tool_calls.length > 0`. DeepSeek's "thinking mode must be
passed back" rule applies to ANY R1-generated assistant message.

Symptom: plan approved → synthetic user message "implement it now" →
next API call 400s. The intermediate "plan submitted — awaiting
approval" plain-text R1 turn was persisted without its reasoning,
and R1 rejected the entire history the next time around.

Changes:
- assistantMessage() drops the tool_calls guard; reasoning attaches
  whenever the model emitted any (even on plain-text turns).
- Forced-summary path (no-tools fallback) now captures reasoning from
  the summary response.
- New syntheticAssistantMessage() stamps an empty-string
  reasoning_content on synthetic turns (Esc-abort notices) when the
  model is a reasoner, so R1's validator is satisfied even when no
  real reasoning exists. V3 stays clean.
- Test updated: plain-text reasoner turn now asserts reasoning
  DOES round-trip (reversed from 0.5.15's assumption).

985 tests.
2026-04-23 20:03:06 -07:00
esengine a8c367ad0c fix(citation): leading / resolves to project root, not filesystem root (0.5.17)
Symptom: user wrote a game design doc to `F:/Reasonix/game-design-doc.md`,
the model cited it as `[...](/game-design-doc.md)`, and Reasonix rendered
"✗ /game-design-doc.md → file not found" even though the file was
right there on disk.

Cause: `validateCitation` ran `isAbsolute(path)` on the raw URL. A model
writing `/foo.md` means "project-root relative" (Aider / Claude-Code
convention), but Node's isAbsolute returns true, so the validator
stat'd the literal `/foo.md` under the filesystem root and got ENOENT.

Fix: strip leading `/` or `\` before the absoluteness test. Drive-letter
paths (`C:\...`) still pass isAbsolute and are respected; plain
leading-slash paths become project-relative. Unix absolute citations
like `/etc/hosts` lose precision but are vanishingly rare in code
citations — if we need them we'll add an explicit scheme.

+2 markdown tests for the new leading-slash behavior (both `/` and `\`).
985 tests.
2026-04-23 19:57:49 -07:00
esengine 2d35cab39e fix(plan): actually stop the flicker — pause ticker, tighten clamp, stabilize onChoose (0.5.16)
0.5.14's clamp was insufficient. Three root causes the earlier fix missed:

1. TickerProvider kept pumping 120ms re-renders even while the picker
   was up — the memo'd PlanConfirm still re-evaluated on every tick
   because `onChoose` identity changed (handlePlanConfirm has `busy` in
   its deps; busy toggles during model streaming). Fix: disable the
   ticker while `pendingPlan` or `pendingShell` is set. No ticker = no
   re-render cadence to drive Ink redraws.

2. `clampBodyByLines` clamped SOURCE lines, not rendered rows.
   Markdown expands ~2× (wrap, code fences, heading blanks, list
   indent), so `rows - 18` source lines still overflowed on a 40-row
   terminal. Fix: divide by MARKDOWN_EXPANSION before clamping so the
   rendered output actually fits.

3. `handlePlanConfirm` identity churns — wrapped in a ref-stable
   `stableHandlePlanConfirm` so `React.memo(PlanConfirm)`'s shallow
   compare actually skips re-renders when `plan` + `projectRoot`
   haven't changed.

Together these pin the picker's rendered height to a known budget AND
eliminate the re-render loop that caused Ink to clear+redraw each
frame. The overflow-can't-scroll symptom is inherent to Ink's live
mode; only remedy is to make content fit, which the tightened clamp
now guarantees.
2026-04-23 19:54:19 -07:00
esengine 874d7df2f7 fix(r1): round-trip reasoning_content through tool loop (0.5.15)
DeepSeek R1 thinking mode 400s with "The reasoning_content in the
thinking mode must be passed back to the API" when a tool-loop
continuation replays an assistant message that had tool_calls but
no reasoning. Root cause: assistantMessage() stripped the field.

Fix: ChatMessage gains optional reasoning_content. Loop passes the
captured reasoning into assistantMessage; we attach it only when
the turn has tool_calls AND reasoning is non-empty — plain-text
R1 turns stay lean, deepseek-chat is unaffected.

+2 tests (loop-r1-reasoning): turn-2 body asserts the echoed
assistant message carries reasoning_content on a tool-call turn,
and does NOT carry it on a plain-text turn.
2026-04-23 19:50:18 -07:00
esengine 4d39744d99 feat(0.5.14): visible/durable/reachable + plan-flicker + pending-edit persistence
- !cmd bang output now persists via loop.appendAndPersist, so session
  resume sees the shell history the model already reasoned against.
- Subagent runs (run_skill · runAs:subagent) now emit cost/model/usage
  on their end event. App.tsx writes one row to ~/.reasonix/usage.jsonl
  per run; the completion line also shows $X inline. `/stats` and
  `reasonix stats` render a new "subagent activity" section with
  per-skill breakdown.
- `/resource [uri]` + `/prompt [name]` slashes with argument-level
  pickers (reusing 0.5.13's SlashArgPicker). No arg lists what every
  connected MCP server exposes; with arg reads via live McpClient
  stored on McpServerSummary. Display-only v1 — no loop injection.
  `/mcp` now hints toward these when servers expose resources/prompts,
  `/keys` gets an "MCP exploration" section, `/help` lists both.
- Bug A — plan picker flicker on small terminals: PlanConfirm's
  markdown body is now line-clamped to (rows − 18), and the component
  is React.memoed so tick-driven parent re-renders skip the heavy
  Markdown subtree when props are unchanged.
- Bug B — pending-edit queue wiped on crash: new
  src/code/pending-edits.ts checkpoints the queue to
  ~/.reasonix/sessions/<name>.pending.json on every parse. /apply
  and /discard clear the file; session resume restores it with a
  visible banner. deleteSession removes the sidecar too.

981 tests (+31). lint / typecheck / build clean.
2026-04-23 19:44:28 -07:00
esengine 74da4f2a92 revert /edit slash + fix picker blocking Enter on exact match (still 0.5.13)
Two small course-corrections on the 0.5.13 work-in-progress. Version
stays at 0.5.13 — these land before publish.

### 1. Remove /edit

The one-shot `/edit <file> <instruction>` slash was 99% redundant
with `@path/file.ts <instruction>`: the 0.5.5 `@`-mention already
inlines the file, and code-mode's system prompt already teaches the
model to output SEARCH/REPLACE blocks. `/edit` added only the
"output ONLY a block, no prose" hint — not worth a whole slash.

Reverted:
- case "edit" handler (slash.ts)
- SLASH_COMMANDS registry entry
- /help line
- /edit test describe block + "/help mentions /edit" + required-list
- "file" from the argCompleter union type (no consumer left; the
  `@` picker remains the single file-picker surface, avoiding two
  competing file-autocompletes)
- "file" branch in App.tsx's slashArgMatches memo + the trailing-
  space special case in pickSlashArg

Users who want one-shot edits type `@src/foo.ts fix the typo` —
clearer to read in history and the model obliges by default.

### 2. Picker blocked Enter after exact match

Typing `/preset smart` left the picker visible with one match
("smart") → Enter was intercepted and re-substituted the same value
instead of submitting the command. Fix: slashArgMatches memo now
returns null when the partial is a case-insensitive EXACT match for
an enum value (or a model id). Picker hides; Enter submits.

- Test added documenting that the detector itself remains kind-
  only — the hide-on-exact-match logic lives in the App-side memo
  so the detector stays UI-agnostic.

### Tests

946 (was 952; dropped 6 /edit-specific tests, added 1 regression
for the exact-match fix, dropped the File-picker-for-/edit detector
test since that path is gone). Lint + typecheck + build clean.
2026-04-23 19:08:14 -07:00
esengine 36f6d245f9 feat(ui): argument-level pickers for slash commands (0.5.13)
User feedback: "after I type `/edit` there's no hint about what files
exist — same for other commands with args." Fixed.

### Mechanism

SlashCommandSpec gains an `argCompleter` field:

- `"file"`    → file picker (reuses atFiles + rankPickerCandidates
                with mtime + recently-used ranking from 0.5.12)
- `"models"`  → DeepSeek model-id list fetched at startup
- `string[]`  → small enum (e.g. `["fast", "smart", "max"]`)
- omitted     → no picker, just a dim usage hint below the prompt

Attached to: /edit → file, /preset → enum, /model → models,
/plan → on/off, /harvest → on/off, /branch → off + a few N values.

`detectSlashArgContext(input, codeMode)` in slash.ts classifies the
buffer once the user has typed `/<cmd> ` — returns `{spec, partial,
partialOffset, kind}`. `kind` is "picker" (completable first-arg
position) or "hint" (past the first arg / no completer).

`src/cli/ui/SlashArgPicker.tsx` — new component mirroring the
SlashSuggestions / AtMentionSuggestions layout. Header row always
shows `/<cmd> <argsHint>  — <summary>` so even when no matches,
the user sees what's expected. Hint-only mode is a single dim row.

App.tsx: `slashArgSelected` state, `slashArgContext` memo,
`slashArgMatches` memo (dispatches on completer type), useEffect
clamp, `pickSlashArg` callback (splices at partialOffset; adds
trailing space for file picker so user can keep typing the
instruction; no trailing space for enum picks since those commands
take no further args). Wired into useInput arrow/Tab and
handleSubmit Enter intercept. Renders after SlashSuggestions +
AtMentionSuggestions.

### Tests (+11, suite 941 → 952)

tests/slash.test.ts — `detectSlashArgContext` suite covers: null
before name commit, null on unknown cmd, file picker for /edit in
code mode, contextual-command gating outside code mode, enum picker
for /preset, models completer for /model, /plan gated to code mode,
hint kind once partial has internal whitespace, picker with empty
partial (just-typed space), hint kind for free-form arg commands
like /commit.

Lint + typecheck + build clean. 952 tests, 7.5s.
2026-04-23 19:02:38 -07:00
esengine a44c23c0a8 feat(ui): @-picker recency ranking + /keys cheatsheet (0.5.12)
Two UX polishers bundled, closing out the A-E batch.

### D. `@` picker ranking by mtime + recently-used

Alphabetical sort was arbitrary on large repos — 500 files deep, the
first page was almost never what the user wanted. New ranking:

- Empty query → recently-used paths first, then mtime descending,
  then path alpha. "Recently used" = files touched by `read_file` /
  `edit_file` / `write_file` / `search_content` / etc. tool calls
  this session (20-slot LRU; resets on session change).
- Non-empty query → existing substring/prefix scoring, tiebreak by
  recently-used membership then mtime.
- Back-compat: `string[]` input with no recency list still returns
  input order (old tests pass unchanged).

Implementation:

- `listFilesWithStatsSync(root, opts)` — same walk as listFilesSync
  plus a statSync per file. Stat failures don't throw; the entry
  keeps `mtimeMs: 0` and sinks to the bottom of the recency bucket.
- `FileWithStats` / `PickerCandidate` / `RankPickerOptions` types
  exported for library callers.
- `rankPickerCandidates(files, query, limitOrOpts)` — overloaded:
  bare number still works (back-compat), or pass
  `{ limit, recentlyUsed }`.
- App.tsx: `atFiles` memo switched to listFilesWithStatsSync;
  `recentFilesRef` (useRef<string[]>) + `recordRecentFile(p)` LRU
  callback; `tool_start` event handler inspects `toolArgs` for
  `path` / `file_path` / `file` fields and feeds the LRU.

### E. `/keys` cheatsheet slash

Discoverability gap: `!` bang, `@` picker, `/` slash, Shift+Enter,
Ctrl+J, Ctrl+A/E, Esc, y/n — the kit is extensive but undocumented
in one place. `/keys` dumps a formatted table:

    Keyboard & prompt shortcuts:
      Enter                  submit the current prompt
      Shift+Enter / Ctrl+J   insert a newline
      ...

    Prompt prefixes:
      /<name>    slash command
      @<path>    inline a file (code mode)
      !<cmd>     run <cmd> as shell

    Pickers (slash + @-mention):
      ↑ / ↓      navigate
      Tab        insert without submitting
      Enter      insert + run/keep-editing

Added to SLASH_COMMANDS registry + cross-linked from `/help`.

### Tests (+9, suite 932 → 941)

- tests/at-mentions.test.ts — 5 new for rankPickerCandidates:
  mtime sort on empty query with FileWithStats, recently-used boost
  trumps mtime, non-empty query tiebreak by recent+mtime, back-compat
  input-order preservation for bare strings, numeric-limit literal
  as third arg.
- tests/slash.test.ts — 4 new for /keys: shortcuts listed, prefixes
  listed, pickers mentioned, /help cross-reference.

### Note on release cadence

A (0.5.9) + B (0.5.10) + C (0.5.11) + D + E were split across five
commits but each dist is cumulative — publishing only the final one
gets users everything. Going forward I'll bundle closer unless the
user asks otherwise.

Lint + typecheck + build clean. 941 tests, 8.3s.
2026-04-23 18:54:04 -07:00
esengine 337ded3839 feat(code): unified-diff preview for pending edit blocks (0.5.11)
Before /apply, the UI used to show only
    ▸ 2 pending edit block(s) — /apply or /discard
          src/a.ts  (-3 +4 lines)
          src/b.ts  (-1 +1 lines)
— a count summary, nothing about what was actually changing. Common
mistake shape: press y, look at git diff afterwards, discover the
model edited the wrong block / wrong file.

Now each pending block is rendered as a compact diff with ±2 lines of
context and a hard cap at 20 lines per block:

    ▸ 2 pending edit block(s) — /apply (or y) to commit · /discard (or n) to drop
          src/foo.ts  (-1 +1 lines)
            function foo() {
        -   const x = 1;
        +   const x = 2;
            return x;

      NEW src/bar.ts  (-0 +3 lines)
        + export const bar = 1;
        + export const baz = 2;
        + export default { bar, baz };

### Mechanism

`src/code/diff-preview.ts`:

- `formatEditBlockDiff(block, opts)` — shared leading/trailing lines
  collapse to context (default 2 lines each side, `… N unchanged lines
  above/below` when truncated). Middle divergence is `-old` / `+new`.
  Whole block capped at 20 lines with `… (N more diff lines — full
  content applies on /apply)` footer when exceeded. Empty-search
  (new file) case shows all-`+` lines.
- `formatAllBlockDiffs(blocks, opts)` — stitches each block's header
  (path + ±line counts, `NEW` prefix for new files) + its diff body,
  separated by blank lines.

Zero new deps. Small hand-rolled helper using prefix/suffix-compare;
sufficient for the typical SEARCH/REPLACE shape (small change inside
a function body, wrapped in a few lines of surrounding context).
Myers-diff quality is not needed — the model's SEARCH block already
minimizes context.

`formatPendingPreview` in App.tsx dropped its own summary line list
(paths now come from the per-block diff header) and its local
`countLines` helper (moved to diff-preview.ts alongside its only
consumer).

### No colors yet

Plain text, `-` / `+` / ` ` prefixes. ANSI colorization would need
Ink component plumbing that isn't worth the complexity for v1 —
the prefix convention is clear and universal (git / hunks / etc.).

### Tests (+10, suite 922 → 932)

tests/diff-preview.test.ts — new-file all-`+`, context collapse for
shared prefix/suffix, maxLines truncation with footer, leading and
trailing hidden-context annotations, single-line edits, custom
indent, multi-block formatAllBlockDiffs (path+counts headers, blank
separators, empty-input).

Lint + typecheck + build clean. 932 tests.
2026-04-23 18:47:01 -07:00
esengine 8ec6c630bd feat(slash): /edit <file> <instruction> — one-shot surgical edit (0.5.10)
One-liner shortcut for "change this one thing in this one file" —
faster than the multi-turn code-mode dance of "explain the file",
"here's my plan", "apply", etc. Code mode only.

### Mechanism

Zero new code paths. The slash is sugar: it builds a resubmit text of

    @<file> <instruction>

    Output ONLY a SEARCH/REPLACE block for this one edit. No prose,
    no explanation.

and hands that back through the normal turn machinery:

- 0.5.5's `@`-mention expansion inlines `<file>` under
  `[Referenced files]` so the model sees the current content.
- Code-mode's SEARCH/REPLACE handling already catches the output
  into `pendingEdits` (0.4.0+).
- The existing y/n confirm gate fires on the next event.

So `/edit src/foo.ts fix the typo` becomes equivalent to the user
typing `@src/foo.ts fix the typo. Output ONLY a SEARCH/REPLACE
block…` — the value is (a) discoverability via /help and slash
autocomplete, (b) the guaranteed-good prompt format without the user
having to remember it.

### Validation

- Outside code mode (no `codeRoot` in SlashContext) → refusal with a
  pointer to `reasonix code <dir>`.
- Missing file arg → usage hint.
- Missing instruction → usage hint with the file name echoed back.

### /help + discovery

Added to the slash autocomplete registry (`contextual: "code"` so
it only surfaces in code mode) and to the /help code-mode block.

### Tests (+6, suite 916 → 922)

tests/slash.test.ts — /edit describe block covers: non-code-mode
refusal, missing file, missing instruction, resubmit shape
(contains `@file` + instruction + SEARCH/REPLACE + ONLY), multi-
word instruction preservation. Plus `/help mentions /edit` and
`edit` added to the `SLASH_COMMANDS registry contains every handler`
required-list.

Lint + typecheck + build clean. 922 tests.
2026-04-23 18:41:12 -07:00
esengine a787272ceb feat(ui): collapse large user pastes in Historical display (0.5.9)
Pasting a stack trace / log dump / sample file flooded the Historical
scrollback with a massive block, hiding prior turns. Now user input
that exceeds a threshold renders as:

    ▸ pasted 2.3 KB (84 lines) — first 10 shown, full text sent to model
    line 1
    …
    line 10
    … (74 more lines)

The MODEL still receives the full text. Only the displayed row
collapses — `loop.step(modelInput)` gets the original string
(including any `@`-mention expansion) unchanged.

### Mechanism

- `src/cli/ui/paste-collapse.ts` — `formatLongPaste(text, opts)` pure
  helper. Collapse triggers when line count > 40 OR char count > 2000
  (defaults, override via opts). Head shows 10 lines; remaining
  footer reads "… (N more lines)". Byte header formats B/KB/MB.
- App.tsx — wired at the user-row push site in handleSubmit
  (between the UserPromptSubmit hook gate and the loop.step dispatch).
  The `pasteDisplay.displayText` goes to the Historical row; the
  existing `modelInput` variable (raw or `@`-expanded) goes to the
  loop.

### Scope

Affects only the regular user-message row. Separate paths for
`!`-bang commands, `@` expansions, and slash outputs are untouched.
Skipped on short messages (pass-through, no allocation overhead
beyond a `split("\n")`).

### Tests (+10, suite 906 → 916)

tests/paste-collapse.test.ts covers: short pass-through, multi-line
pass-through, line-threshold collapse, char-threshold collapse,
KB/MB formatting, 1-vs-N-more-lines pluralization, custom
thresholds, custom headLines, zero remaining (head covers all),
exported defaults.

Lint + typecheck + build clean. 916 tests.
2026-04-23 18:37:26 -07:00
esengine 0ca16d6e2d feat(ui): !cmd bash-mode prefix — user-typed shell passthrough (0.5.8)
Claude-Code-style bash mode. User types `!ls src/` or `!git status`;
Reasonix runs the command in the sandbox root, shows both the command
and its output, and appends the combined text to the conversation log
so the next model turn has the context automatically.

Faster than round-tripping through the model just to cat a file or
check git state, and closes a common UX gap vs. Claude Code.

### Mechanism

- `src/cli/ui/bang.ts` — `detectBangCommand(text)` returns the command
  body (whitespace-trimmed) or null. Only a LEADING `!` counts; `!`
  alone / `!   ` returns null; `echo !hi` doesn't trigger (the `!`
  isn't at position 0).
- `formatBangUserMessage(cmd, output)` — prepends a `[!cmd]\n`
  header so the model can distinguish user-typed shell output from
  its own `run_command` tool results (which are `role: tool`,
  structurally different).
- App.tsx handleSubmit intercept — fires AFTER the y/n fast-path (so
  pending edits still resolve cleanly) and BEFORE slash parsing:
  - Push `role: "user"` Historical row with the raw `!cmd` text.
  - `await runCommand(cmd, { cwd: codeMode?.rootDir ?? cwd,
    timeoutSec: 60, maxOutputChars: 32_000 })`.
  - Push `role: "info"` Historical row with
    `formatCommandResult(cmd, result)`.
  - `loop.log.append({ role: "user", content: formatBangUserMessage
    (cmd, formatted) })` so the next step() includes it in
    buildMessages.
  - setBusy true/false around the run so PromptInput reflects the
    in-flight state.
  - Catch errors → warning row, don't log.

### No allowlist gate

User-typed `!` is explicit consent (consistent with Claude Code; the
allowlist exists to bound what the MODEL can do with `run_command`,
not what the user chooses by hand). If someone wants stricter gating
later a `REASONIX_BANG_CONFIRM=1` toggle could layer on — out of
scope here.

### Known limitation: session durability

`loop.log.append` updates in-memory only. On session resume, the bang
output is gone (the session file didn't see it). The next actual
step() does appendAndPersist for the next user turn, and the model
sees this bang output live within the same session either way.
Treating bang as ephemeral keeps the fast-path simple; durable
capture could land later if real usage surfaces demand.

### /help + discovery

/help gains a "Shell shortcut" section documenting `!cmd` with
example commands (`!git status   !ls src/   !npm test`), plus a
"File references" section covering the `@` picker from 0.5.5 / 0.5.7
that was undocumented there.

### Tests (+9, suite 897 → 906)

tests/bang.test.ts — detectBangCommand covers: body extraction,
whitespace trim, non-bang pass-through, `!`-alone / blank body,
mid-string `!` rejection, embedded-trailing-`!` preservation,
multi-word with flags/quotes. formatBangUserMessage covers header
prepending and verbatim body preservation.

Lint + typecheck + build clean. 906 tests, 8.6s.
2026-04-23 18:31:30 -07:00
esengine ecf2ea372b feat(ui): @mentions picker + post-build bundle smoke test (0.5.7)
Two shipped, both extending 0.5's foundation:

### 1. @mentions picker UI

0.5.5 shipped `@path/to/file` inline expansion but made the user type
the full path. 0.5.7 adds a picker that mirrors the existing
/slash autocomplete: type `@` (with optional partial) in code mode,
get a filtered file list with ↑/↓ navigation and Tab/Enter pick.

- `listFilesSync(root, opts)` — sync recursive walk, skips
  node_modules / .git / dist / build / .next / etc. + any dot-dirs.
  Caps at 500 results by default. Forward-slash paths on all
  platforms. 10-50ms on moderate repos — fits the TUI's single-turn-
  per-tick model cleanly.
- `detectAtPicker(input)` — returns `{query, atOffset}` when the
  buffer ends with an in-progress mention; `null` otherwise. Distinct
  from `AT_MENTION_PATTERN` which finds completed mentions anywhere
  for expandAtMentions.
- `rankPickerCandidates(files, query, limit)` — case-insensitive
  substring filter with a boost for basename-prefix matches. Empty
  query returns the first `limit` candidates alpha.
- `AtMentionSuggestions.tsx` — same shape as `SlashSuggestions`
  (matches null = hide, empty = "no matches", array = highlight
  selected cyan/bold). Shows basename bold + dir dimmed à la
  VS Code Quick Open.
- App.tsx wiring: `atFiles` memo (walk on rootDir change), `atPicker`
  / `atMatches` memos, `atSelected` state with useEffect clamp.
  Arrow keys + Tab in useInput (before slash so they don't conflict
  — mutually exclusive by construction). Enter in handleSubmit
  substitutes at the `@` offset and appends a space (space auto-
  dismisses the picker, next Enter submits).
- Limitation intentionally not fixed: files created mid-session by
  edit tools won't appear in the picker until next launch. User can
  always type the full path. Rebuilding the list on every turn would
  be wasteful for the 95% case.

### 2. Bundle smoke test

v0.5.4 shipped to npm with a tokenizer path resolution bug that
crashed on first API call. The unit tests were fine — they load
modules from src/, which doesn't exercise the post-bundle directory
layout. These two tests close that gap:

- `dist/index.js`: dynamic import (via file:// URL on Windows),
  invoke `truncateForModelByTokens` to force a tokenizer load. ENOENT
  ⇒ fail.
- `dist/cli/index.js`: spawn with `DEEPSEEK_BASE_URL=127.0.0.1:1` so
  fetch fails fast. Preflight's tokenizer load runs BEFORE fetch, so
  if the bundled layout can't find the data file we see the ENOENT
  in stderr. If tokenizer loads fine, we see connection-refused and
  the test passes.
- Both tests skip when the bundle is absent (dev runs that haven't
  built yet). CI runs `build` before `test` → always exercised.

Would have caught 0.5.4's regression pre-publish.

### Tests (+23, suite 874 → 897)

- tests/at-mentions.test.ts — 7 new for detectAtPicker, 2 for
  AT_PICKER_PREFIX vs AT_MENTION_PATTERN sanity, 6 for
  rankPickerCandidates (empty query, substring, basename-prefix
  boost, path-prefix, no-match, limit), 6 for listFilesSync (recurse,
  forward slashes, ignore dirs, dotfile inclusion, custom ignores,
  maxResults cap, unreadable root).
- tests/bundle-smoke.test.ts — 2 tests for lib + CLI bundle
  tokenizer resolution.

Library exports: `detectAtPicker`, `listFilesSync`,
`rankPickerCandidates`, `AT_PICKER_PREFIX`, `DEFAULT_PICKER_IGNORE_DIRS`,
`ListFilesOptions`.

Lint + typecheck + build clean. 897 tests, 8.1s.
2026-04-23 18:14:46 -07:00
esengine 335de43db5 fix(tokenizer): resolve data-file path in bundled builds (0.5.6)
**Critical production bug.** Since 0.5.0 introduced the tokenizer, any
bundled `reasonix run` / `code` / `chat` crashed with ENOENT on the
first API turn after 0.5.4 put the tokenizer on the hot path.

Root cause: `resolveDataPath()` used
`join(dirname(import.meta.url), "..", "data", "deepseek-tokenizer.json.gz")`.

- In dev (`src/tokenizer.ts`) → resolves to `data/` ✓
- In the bundled CLI (`dist/cli/index.js`) → `dist/cli/` + `..` +
  `data/` = `dist/data/` ✗ — the data file ships at PACKAGE ROOT per
  package.json `files` entry; `dist/data/` doesn't exist.

Why this slipped through: before 0.5.4, `countTokens()` was only
called from the opt-in `/context` slash. Casual smoke tests and unit
tests (which run tokenizer.ts directly from src/) never hit the
bundled resolution. 0.5.4's preflight put `countTokens()` on every
step() call — so the first user-facing turn after `npm publish 0.5.4`
would have crashed.

Fix: `resolveDataPath()` now tries multiple candidate paths and
returns the first one that `existsSync`:

1. `REASONIX_TOKENIZER_PATH` env override (unchanged).
2. `../data/...` — dev + bundled `dist/index.js`.
3. `../../data/...` — bundled CLI at `dist/cli/index.js`.
4. `require.resolve("reasonix/package.json")` root — fallback for
   unusual bundlers.

Also falls back to `process.cwd() + data/...` if all candidates
missed, so readFileSync surfaces a concrete path in the error rather
than silently missing.

Caught via live `DEEPSEEK_API_KEY=... node dist/cli/index.js run
"hi"` against the actual bundled output. Unit tests alone would not
have caught this (they load src/tokenizer.ts directly, bypassing
the bundle path). Follow-up consideration: an integration test that
runs the bundled CLI against a fake API response — out of scope here.

874 tests still pass. Lint + typecheck + build clean.
2026-04-23 17:58:35 -07:00
esengine af077ddb24 feat: @file mentions in code mode + session-load heal → tokens (0.5.5)
Two shipped in one release, both closing out the 0.5 arc:

### 1. Session-load heal migrated to tokens

0.5.2 and 0.5.3 made dispatch truncation, /compact, and auto-compact
token-aware. Session load was the last char-based truncation surface;
now closed. CJK tool results in a resumed session come back at the
same effective context footprint as English instead of slipping past
the old 32k-char cap at 2× the token cost.

- `healLoadedMessagesByTokens(messages, maxTokens)` — sibling of the
  existing char-based `healLoadedMessages`.
- `fixToolCallPairing(messages)` — pure helper extracted so both
  variants reuse the structural tool_calls ↔ tool pairing pass.
- Session-resume call in loop.ts constructor switched to the token
  variant with `DEFAULT_MAX_RESULT_TOKENS`. Stderr "healed" line now
  reads "shrunk N tokens of oversized tool output" instead of chars.
- buildMessages's per-turn heal (hot path) stays on the char variant
  — avoids a per-turn tokenizer pass on every tool message.

### 2. `@file` mentions in code mode

User types `@src/loop.ts` → the model sees the file content inlined
under a "Referenced files" block:

    look at @src/loop.ts and explain

    [Referenced files]
    <file path="src/loop.ts">
    ...
    </file>

The user's original text is preserved verbatim; expansion is append-
only so the display stays clean and the model can cite the file
unambiguously.

- Regex `(?<=^|\s)@([a-zA-Z0-9_./\-]+)` — requires word boundary so
  `[email protected]` and `foo@bar` don't trigger. Trailing sentence
  period (`@foo.ts.`) is stripped before lookup.
- Sandbox: relative paths only, resolved against `rootDir`, no `..`
  escape, no absolute paths. Violations get
  `<file path="..." skipped="escape"/>` so the model sees the refusal.
- `DEFAULT_AT_MENTION_MAX_BYTES = 64 KB` (matches tool-result cap
  ballpark). Larger → skipped="too-large" with byte count.
- Missing / not-a-regular-file → skipped with reason.
- De-dupe: same file referenced twice inlines once.
- UI feedback: an info row lists inlined/skipped files so the user
  sees what reached the model.
- Only active in code mode (codeMode.rootDir). Plain chat mode
  doesn't expand — file references there are ambiguous.

### Tests (+15, suite 859 → 874)

- tests/at-mentions.test.ts — regex: boundary matching, email
  rejection, multi-mention; expansion: inline content, de-dupe,
  multiple distinct files, missing/escape/absolute/too-large skips,
  trailing-dot stripping, directory rejection.

Library exports: `expandAtMentions`, `AT_MENTION_PATTERN`,
`DEFAULT_AT_MENTION_MAX_BYTES`, `AtMentionExpansion`,
`AtMentionOptions`. Plus `healLoadedMessagesByTokens` and
`fixToolCallPairing` from loop.ts.

Lint + typecheck + build clean. 874 tests, 5.2s.
2026-04-23 17:48:50 -07:00
esengine 84ea648c84 feat(loop): preflight context-size check before each request (0.5.4)
Reactive auto-compact (60%/80% on prior prompt_tokens) keys off the
PREVIOUS turn's server usage, so a fresh resumed session — or one new
oversized tool result — can push the current turn's buildMessages
straight past 131,072 tokens and make DeepSeek 400 with "maximum
context length" before we see any usage number. Preflight closes that
hole by estimating locally before sending.

Mechanism:

- `estimateRequestTokens(messages, toolSpecs)` in src/tokenizer.ts:
  `estimateConversationTokens(messages) + countTokens(JSON.stringify
  (toolSpecs))`. Mirrors the arithmetic `/context` slash already uses
  so the two numbers don't drift.

- loop.step() injection right after buildMessages(). If the estimate
  exceeds 95% of `DEEPSEEK_CONTEXT_TOKENS[model]` (fallback
  `DEFAULT_CONTEXT_TOKENS`), run `compact(1_000)` and rebuild
  messages from the shrunk log. Warning event names the preflight
  path + tokens saved.

- When there's nothing to compact (first-ever turn with a bulky
  system prompt, for example), still yield a warning naming the
  preflight estimate + "nothing to auto-compact — DeepSeek will likely
  400". User sees the reason before the crash, can /forget or /clear.
  We don't short-circuit the request — let DeepSeek decide; its 400
  catch path already surfaces a useful hint.

- Non-branching AND branching paths share the `messages` variable
  from the outer buildMessages call, so the one injection covers
  both. Forced-summary fallback keeps its own path (a preflight
  there would be too late; the summary is the recovery step).

Tests (+3, suite 856 → 859) in tests/preflight.test.ts:

- Fires when estimate > 95%: compact runs, "pre-compacted N tool
  result(s), saved M tokens" warning appears, loop still completes.
- Stays silent when estimate is comfortably under 95%.
- Warns (but does not block) when over 95% with nothing to compact.

Per-test context budgets are set by mutating `DEEPSEEK_CONTEXT_TOKENS
[TEST_MODEL]` — the table is `Record<string, number>` so the write
is well-typed; teardown deletes the key. Seeded tool results are
properly paired with a prior assistant.tool_calls so
healLoadedMessages doesn't strip them as orphans (which would make
preflight never fire).

Lint + typecheck + build clean. 859 tests, 5.0s.
2026-04-23 17:32:09 -07:00
esengine 2d95c5787d feat(loop): token-aware /compact + auto-compact (0.5.3)
0.5.2 put the DeepSeek V3 tokenizer on the dispatch hot path to cap
NEW tool results by real tokens. 0.5.3 extends that to the live log:
/compact and auto-compact now shrink existing tool results by tokens
too, closing the last surface where CJK text slipped past a char cap
at 2× the intended context cost.

Mechanism:

- `shrinkOversizedToolResultsByTokens(messages, maxTokens)` in
  src/loop.ts — sibling of the char-based `shrinkOversizedToolResults`.
  Fast-pathes tool entries whose length ≤ cap (tokens ≤ length
  guarantee); otherwise tokenizes each candidate twice (before +
  after `truncateForModelByTokens`) to report exact tokensSaved.
  Never tokenizes the full input (same 0.5.2 guard against BPE
  O(n²) on pathological repetitive content).

- `loop.compact(maxTokens = 4000)` now shrinks by tokens and returns
  `{ healedCount, tokensSaved, charsSaved }` (was `{ healedCount,
  charsSaved }`). Persists to the session file when present.

- Auto-compact thresholds in `step()`:
  · 60%-80% band: soft compact at 4000 tokens/result (was 16k chars,
    which was 4k tokens in English but 16k tokens in CJK).
  · >80% band: hard compact at 1000 tokens/result (was 4k chars).
  Warnings report exact tokensSaved instead of `charsSaved / 4`.

- `/compact [N]` slash cap semantic flipped from chars to tokens
  (default 4000). The `info` line now reads "saved N tokens
  (M chars)". Help text + suggestion hint updated.

- Session-load heal (`healLoadedMessages`) left on the char cap so
  stored session files keep loading under their existing semantics.
  Live compaction and dispatch-time truncation are the only two
  surfaces that went token-aware.

Tests (+6, suite 850 → 856):

- tests/compact-tokens.test.ts — small-tool no-op, oversize shrink,
  input non-mutation, user/assistant protection, CJK parity, fast
  path by length.
- tests/loop.test.ts — seeded log content in the two auto-compact
  tests reshaped from `"Z".repeat(N)` to realistic log lines (was
  hitting BPE pathological path; also the 60%-80% warning now
  reads "4k tokens" instead of "16k" chars).
- tests/slash.test.ts — /compact assertions updated for token-based
  output ("saved N tokens", "N tokens each"); test content reshaped
  to realistic log lines.

Breaking change: library callers that pass an explicit number to
`loop.compact(N)` expecting chars will now get a tighter cap (4000
tokens ≈ 16k chars English, ~4k chars CJK). Fail mode is "compaction
is more aggressive than expected," which is the safe direction.

Lint + typecheck + build clean. 856 tests, 5.1s.
2026-04-23 17:21:02 -07:00
esengine 19a2b8d2be feat(tools): token-aware tool-result truncation at dispatch (0.5.2)
Before: every tool result was char-capped at 32K chars (8K English
tokens, but 16K+ tokens for CJK — Chinese/Japanese/Korean tool output
slipped past the budget at 2× the intended context cost).

After: dispatch truncates by REAL DeepSeek V3 tokens, using the
tokenizer that shipped in 0.5.0. Default 8K tokens per result, same
effective footprint regardless of char density.

Mechanism (src/mcp/registry.ts:truncateForModelByTokens):

- Fast path `s.length <= maxTokens` — every token is ≥1 char, so
  length bounds tokens. Skip tokenize entirely for small results.
- Intermediate check for moderate strings (`length <= maxTokens * 4`)
  — tokenize once to confirm it really is over budget.
- For large strings: char-slice head + tail by budget, tokenize the
  slices (NOT the full input), shrink on overshoot. 1–2 iterations per
  slice, bounded at 6. We explicitly never tokenize the whole input —
  pathological repetitive content (`"A".repeat(50_000)`) costs 30s+
  in the pure-TS BPE and is bounded to small slices.
- Dropped-tokens count in the marker is estimated from the per-slice
  char/token ratio (marker reads "~N tokens") so we don't pay a full
  tokenize just for diagnostics.

Wire-up:

- src/tools.ts — `ToolRegistry.dispatch` accepts both `maxResultChars`
  (legacy) and `maxResultTokens` (new). Both apply if both set; the
  tighter one wins. Char-only callers keep their old behavior.
- src/loop.ts — hot-path dispatch switched from
  `maxResultChars: 32_000` to `maxResultTokens: DEFAULT_MAX_RESULT_TOKENS`
  (8_000). Session-healing paths still use chars (preserves backwards
  compat on loaded session files).
- `DEFAULT_MAX_RESULT_TOKENS` and `truncateForModelByTokens` exported
  via src/index.ts for library consumers.

Tests (+9, suite 841 → 850):

- tests/truncate-tokens.test.ts — fast-path, short-string verify,
  CJK cap parity with English, head+tail preservation, zero-budget,
  empty input, marker format.
- tests/loop.test.ts — existing "pre-clips at dispatch" test reshaped
  to use realistic log-line content (was `"A".repeat(50_000)` which
  hit the BPE O(n²) pathological path, 46s+ in the suite).

Lint + typecheck clean. Suite now 5.2s total.
2026-04-23 16:52:23 -07:00
esengine ca27ca50bf fix(shell): reject shell operators (|, >, <, &, &&, ||, 2>) with a clear error (0.5.1)
Before: model writes `dir | findstr foo` → tokenizer produced `["dir",
"/b", "|", "findstr", "foo"]` → quoteForCmdExe wrapped `|` as `"|"`
(literal) → cmd.exe passed `|` as an argument to dir → no pipe, no
error, silent wrong output. The 0.4.26 memory flagged this as a known
issue; encoding fix from that release made the failure visible but
didn't address the root confusion.

After: detectShellOperator() walks the raw command with quote-tracking
and returns the first unquoted operator token at a token boundary.
runCommand rejects before spawn with:

  run_command: shell operator "|" is not supported — this tool spawns
  one process, no shell expansion. Split into separate run_command
  calls and combine the output in your reasoning...

Quoted operators (`grep "a|b" file.txt`) and chars embedded in larger
tokens (`--flag=1&2`) pass through — those are literal argv bytes.
Matches the tool's stated "no shell expansion, no pipes, no redirects"
contract; turns the silent failure into a loud, actionable one.

Tool description updated to document the rejection + the quote-it-as-
a-literal workaround so the model learns the constraint from the spec.

Tests: 841 (+13 covering pipe, redirect, fd-redirect, &&/||, stuck-
redirect, quoted operators, embedded operators).
2026-04-23 16:38:27 -07:00
esengine d4615d6e76 chore(0.5.0): fix CI + add animated SVG logo
CI fix — biome lint surfaced 9 errors on the 0.5.0 commit:
- tokenizer.ts: Infinity → Number.POSITIVE_INFINITY (style/useNumberNamespace)
- tokenizer.ts: formatter wrap on the CJS fallback branch
- StatsPanel.tsx: noArrayIndexKey on the Wordmark map — restructured to a
  module-level WORDMARK_STYLES table keyed by char+color pair, dropped
  the `i` parameter entirely (previous biome-ignore comment only
  suppressed one of two sites the rule fires on)
- various whitespace / line-wrap fixes from `biome check --write`

Animated SVG logo at docs/logo.svg, embedded at the top of README:
- Concentric diamond brand mark (◈) with three layers of motion:
  slow rotation (18s), outer-stroke pulse (2.4s), inner-fill breathing
- REASONIX wordmark in the same cyan → fuchsia gradient the TUI uses,
  so the README and the running app share one visual identity
- Tagline underneath for SEO-style context
- Colors (~4.5:1 contrast on both GitHub dark and light) — no
  prefers-color-scheme switching needed

828 tests, lint + typecheck clean.
2026-04-23 09:34:25 -07:00
esengine 9eff2e2cfc feat(0.5.0): Reasonix visual identity + DeepSeek tokenizer + models/pricing/context
Visual redesign — drop the generic vertical bars for a Reasonix-native
design language. The UI should be recognizable as ours at a glance:

- ◈ REASONIX wordmark in truecolor gradient (cyan → violet), with
  breathing animation — slow when idle, faster when the model is
  thinking, so the app's state is readable from the edge of vision.
- Geometric role glyphs replace all text labels: ◇ user · ◆ assistant ·
  ▣ tool · ▥ tool-err · ▲ warn · ✦ error. Consistent geometric family,
  distinct per role, no overlap with Claude / Cursor / Cline.
- Streaming assistant glyph pulses ◆↔◇ at ~480ms — visible heartbeat
  during R1's long (20-90s) pre-first-byte silence.
- Turn separators render "─── ◆ ───" with the Reasonix mark centered.
- Responsive StatsPanel: stacks metrics vertically on <120-col
  terminals (SSH, split-pane); inline when there's room. Context
  cell gains a 10-cell progress bar in the stacked layout.
- Cold-start cache hit ratio (turn ≤ 3) renders dim gray with a
  "(cold start)" hint instead of red — new users stopped reading
  "0% cache on turn 1" as a configuration error.
- Tool results tail-truncate by default (useful signal is usually at
  the end). ERROR-prefixed results keep the first line + a tail.
- Modal footers gain "[↑↓] navigate · [Enter] select · [Esc] cancel"
  hints; Esc actually cancels now (ShellConfirm → deny, PlanConfirm →
  cancel); SingleSelect gained an optional footer slot.
- Wait-phase messaging (pre-first-byte, R1 reasoning, branching,
  tool-call streaming) gets visible yellow italic instead of dim —
  users had been misreading the dim variant as "frozen".

New features:

- Pure-TS port of DeepSeek's V3 tokenizer (vocab + merges + pre_tokenizer
  from the official tokenizer.json). Bundled as data/deepseek-
  tokenizer.json.gz (1.74MB, slimmed + gzipped from 7.5MB). Zero new
  deps — uses built-in zlib. Encodes ~12k tokens of mixed source in
  ~40ms. scripts/prepare-tokenizer.ts regenerates the bundle from
  upstream.
- /context slash — renders a breakdown of the next request's tokens:
  system prompt, tool specs, per-turn log, top 5 heaviest tool results.
  Answers "where is my context going?" directly; closes the gap where
  StatsPanel showed ctx % without saying why.
- /models slash — fetches DeepSeek's live model catalog via
  GET /models. Renders the list with the current model marked.
- /model <id> now soft-validates against the fetched catalog (warn
  but still switch — accommodates newly-released models we haven't
  indexed). DeepSeekClient gains a listModels() method.

Loop + billing correctness:

- Tool results pre-clipped at dispatch time (default 32k chars) via
  ToolRegistry.dispatch({ maxResultChars }). Oversized results no
  longer bloat the AppendOnlyLog or the persisted session file.
- New proactive-compact tier: when promptTokens / ctxMax crosses 60%
  (before the existing 80% reactive guard), shrink oversized tool
  results to 16k chars. Catches slow-growth patterns before they
  compound into a forced summary.
- DEEPSEEK_PRICING updated to the current unified rates (¥0.2 / ¥2 /
  ¥3 per 1M at cache-hit / cache-miss / output; USD 0.028 / 0.28 /
  0.42 at 7.2 CNY/USD). chat and reasoner are now priced identically
  at source. Stats dashboard figures were systematically high under
  the old tiered constants — new sessions bill correctly.
- Context display switches to binary-K (128K) to match DeepSeek's
  marketing label. DEEPSEEK_CONTEXT_TOKENS stays at 131072 — only
  the formatter divisor changed.

OSC 8 clickable hyperlinks in markdown were attempted and reverted:
Ink 5 strips \x1b / \x07 from Text output, so file:// links never
reach the terminal. Documented as a known limit; re-visit with a
future Ink release or raw-stdout approach.

828 tests (14 new: tokenizer golden cases + /context + /models +
listModels + pricing unification + proactive compact). Lint +
typecheck + build clean.
2026-04-23 09:28:40 -07:00
esengine c2f8e9b734 feat(0.4.28): reasonix code defaults harvest OFF — opt in via --harvest
Pillar 2 harvesting fires an extra V3 call per turn to extract a typed
plan state (subgoals/hypotheses/uncertainties/rejectedPaths) from R1's
reasoning_content. Cost ~10-15% per turn. Closer audit of who actually
consumes the output:

- subgoals / hypotheses / rejectedPaths — purely cosmetic, only rendered
  in PlanStateBlock. No programmatic consumer. Can mislead users by
  giving structured-looking output extra perceived authority (today's
  citation work was triggered by hallucinated "hypotheses" that looked
  thoughtful).
- uncertainties.length — single real downstream use, drives self-
  consistency branching when count exceeds threshold. Could be replaced
  with a cheap heuristic on the raw reasoning text.

For coding tasks specifically, branching is rarely on (default budget=1)
and the cosmetic display value doesn't justify the per-turn premium.
Flip the default off; users who genuinely want the plan state surfaced
can pass --harvest. `reasonix chat` is unchanged — preset behaviour
there still controls harvest.

799 tests, lint + build clean.
2026-04-23 05:13:20 -07:00
esengine d52599ec44 feat(0.4.27): citation-first answers — validated [text](path:line) links + broken-citation surface
Anti-hallucination intervention for evaluative tasks. Two real R1 sessions
where the model invented "Resources/Prompts/Progress not implemented" gaps
that had been shipped months ago (v0.4.5, v0.4.8) motivated this — same
hallucination shape both times, across independent prefixes. The fix is
structural: force the model to ground every codebase claim in a clickable
citation, validate them, render broken ones in red so the user sees
fabrications instantly.

- markdown.tsx: parse [text](url) links (was unsupported — rendered as
  literal). External URLs (https://, mailto:, //) → blue underline.
  Citation-shaped URLs (path / path:line / path:start-end / path#L42) →
  validated against projectRoot, valid = cyan underline, broken = red
  strikethrough + ❌. Bottom-of-message BrokenCitationsBlock lists each
  failure with reason ("file not found", "line 999 > 250") so the user
  can challenge the specific claim.
- code/prompt.ts + cli/index.ts: "Cite or shut up — non-negotiable"
  section moved to TOP of system prompt (was at the end and ignored).
  Concrete ✅/❌ examples. Negative-claim rule made imperative — "STOP.
  Call search_content FIRST" instead of "qualify it" — because asserting
  absence without checking is the #1 failure mode.
- App.tsx / EventLog.tsx / PlanConfirm.tsx: thread projectRoot through
  every <Markdown /> callsite (defaults to process.cwd() for safety).

Behavioural validation: same "analyze the project" prompt that produced
5/8 hallucinations pre-fix returned 3/3 verifiable specific claims +
1 auto-detected broken citation post-fix. Citation feature working in
production.

799 tests (17 new in markdown.test.ts: parseCitationUrl, isExternalUrl,
validateCitation, collectCitations dedup + external skip, parseBlocks
no-regression). Lint + typecheck + build clean.
2026-04-23 04:47:10 -07:00
esengine 3c8669577d feat(0.4.26): subagents-via-Skills + search_content + render/shell/sandbox fixes
- Subagents-via-Skills (replaces 0.4.25's spawn_subagent user-facing
  surface; library API kept). Skills frontmatter gains runAs:subagent +
  optional model:deepseek-*. Builtin explore + research skills ship in
  src/skills.ts as constants. spawnSubagent(opts) extracted from
  registerSubagentTool — both surfaces share it via formatSubagentResult.
  registerSkillTools moved into App.tsx with subagentRunner closure;
  reasonix code no longer registers spawn_subagent in the model tool list.
  Pinned Skills index marks subagent skills with a 🧬 prefix so the model
  pattern-matches "user says explore -> use 🧬 explore" instead of
  reasoning about whether a task is "big enough" to delegate.
- search_content: real content grep tool. Skips 18 dependency / build /
  VCS dirs by default + skips binaries by extension (30+ types) and
  by content sniff (NUL byte in first 8KB). Per-file 2 MB cap, output
  capped to maxListBytes. Regex + literal fallback, glob substring
  filter, case_sensitive + include_deps options. Closes the gap that
  made subagents waste their iter budget calling search_files (which
  is filename-only) for content-grep questions.
- markdown renderer: recognizes Unicode box-drawing tables (│ ─ ┼) +
  ┌─┐ │ └─┘ frames as code blocks. Table cells now render through
  InlineMd with padTo so backticks/bold inside cells parse and column
  widths align by visible (post-strip) width. Multi-line table cell
  continuation rows fold back into the previous row's last cell.
- shell on Windows: prepareSpawn injects chcp 65001 prefix into every
  cmd.exe /c payload + injects [Console]::OutputEncoding=UTF8 into
  PowerShell -Command invocations. Fixes mojibake on CJK Windows where
  cmd builtins (dir, findstr, where) and PowerShell emit text in CP936
  / CP932 / CP949 — previously poisoned the next turn's prompt with
  garbled bytes.
- sandbox: filesystem tools' safePath strips leading / and \ so
  POSIX-absolute paths (path: "/" or "/src/foo.ts") resolve to the
  sandbox root instead of the actual filesystem root. Models routinely
  pass these intending the project root; the old behavior failed the
  escape check with a confusing error.
- loop: aborted signal in the API-call catch yields a clean done
  instead of a red error event. The "This operation was aborted" row
  was always a self-inflicted UX bug — App.tsx calls loop.abort() to
  switch turns when the user picks ShellConfirm "always allow" or
  PlanConfirm approve, and the resulting AbortError got rendered as
  a real error. Subagent layer compensates by synthesizing an error
  result when no final answer was produced (so success!=true on abort).
- prompts: dropped the fictional `grep` tool reference from
  CODE_SYSTEM_PROMPT; explicit list of available exploration tools
  (read_file, list_directory, directory_tree, search_files,
  search_content, get_file_info). New "Path conventions" section
  distinguishes filesystem-tool sandbox-relative paths from
  run_command OS-shell paths (don't use leading / in shell args).

781 tests (+26 vs 0.4.24), lint + typecheck + build clean.
2026-04-23 02:30:15 -07:00
esengine 3fee4e6883 feat: reasonix stats — cross-session cost dashboard + /stats slash (0.4.24)
Every turn run through `reasonix chat|code|run` now appends one line
to ~/.reasonix/usage.jsonl carrying tokens + cost + the equivalent
Claude Sonnet 4.6 cost. `reasonix stats` (no arg) rolls that log up
into today / week / month / all-time windows with a "saved vs
Claude" column. Pillar 1's pitch (94–97% cost reduction) becomes a
fact users can check on their own machine.

Same dashboard is available in-session via the new /stats slash,
reading from the same file and rendering through a shared pure
renderer. reasonix stats <transcript> keeps the old per-file
summary (assistant turns + tool calls) for scripts.

Privacy: only tokens, costs, session name. No prompts, completions,
or tool args. Log append is best-effort — disk failure never blocks
a turn.

New files:
  src/usage.ts                 — appendUsage, readUsageLog, aggregateUsage,
                                  bucketCacheHitRatio / SavingsFraction
  tests/usage.test.ts          — 15 tests (round-trip, malformed line,
                                  rolling windows, renderer, zero denom)

Modified:
  src/cli/commands/stats.ts    — dashboard mode + extracted renderDashboard
  src/cli/commands/run.ts      — appendUsage on assistant_final (for CI)
  src/cli/ui/App.tsx           — appendUsage on assistant_final (TUI)
  src/cli/ui/slash.ts          — /stats slash (shared renderer)
  src/cli/index.ts             — `stats <transcript>` → `stats [transcript]`
  src/index.ts                 — re-export usage module

+17 tests (suite 708 → 725). Lint + typecheck + build clean.
2026-04-22 22:24:59 -07:00
esengine 41d21f7cea feat(slash): /update shows current vs latest + shell command (0.4.23)
Adds an in-session `/update` slash that reports the running version
and the last-resolved latest from the App's background npm-registry
check. Deliberately does NOT spawn `npm install` — stdio:inherit
into a running Ink renderer corrupts the display, and on Windows
the currently-running binary can be locked. Users exit and run
`reasonix update` in a fresh shell when they actually want to
install.

Also splits App state: we now track `latestVersion` regardless of
whether it's newer (so the slash can tell "on the latest" apart
from "still fetching") and derive the yellow header badge from
that. Before this, `updateAvailable` was only set on strictly-
newer, so `/update` saw null when the user was already on the
latest — the message misleadingly said "background check in
flight or offline".

`/update` also triggers a fresh `getLatestVersion({force:true})`
when latestVersion is null, so a retry a few seconds later sees
a concrete answer.

4 new tests (suite 704 → 708). All green; lint / typecheck / build
clean.
2026-04-22 22:13:32 -07:00
esengine 715d8b5950 feat: hooks — user-defined automation at PreToolUse / PostToolUse / UserPromptSubmit / Stop (0.4.23)
Same two-scope layout as memory and skills:
  - <project>/.reasonix/settings.json (committable per-project)
  - ~/.reasonix/settings.json         (per-user)

A hook is a shell command. Reasonix invokes it with stdin = a JSON
envelope carrying the event, tool name, tool args, etc. Exit code
drives the decision:
  - 0 = pass; loop continues normally
  - 2 = block (only on PreToolUse / UserPromptSubmit); hook's stderr
    becomes the synthetic tool result the model sees, or the prompt
    is dropped entirely
  - anything else = warn; loop continues, stderr renders inline as a
    yellow row

Project hooks fire before global hooks. `match` is anchored regex on
the tool name (ignored for prompt / Stop events). Default timeouts:
5s for blocking events, 30s for logging events; per-hook `timeout`
overrides. Settings malformed? loadHooks swallows it so a typo
doesn't bring down the whole CLI.

Deliberate non-goals: no workflow DSL, no conditional chaining, no
hook templates. Hooks are shell commands — the user already has a
programming language.

New files:
  - src/hooks.ts                      (loadHooks, runHooks, decideOutcome, matchesTool, formatHookOutcomeMessage)
  - tests/hooks.test.ts               (26 unit tests)
  - tests/loop-hooks.test.ts          (6 smoke tests — loop wiring)

Modified:
  - src/loop.ts          — PreToolUse + PostToolUse dispatch around tool.dispatch
  - src/cli/ui/App.tsx   — load settings on mount, UserPromptSubmit before handleSubmit, Stop after loop.step
  - src/cli/ui/slash.ts  — /hooks list + /hooks reload
  - src/index.ts         — re-exports

+32 tests (suite 672 → 704). Lint / typecheck / build clean.
2026-04-22 22:06:29 -07:00
esengine 911f043db8 feat: version display in TUI header + reasonix update self-upgrade (0.4.22)
Two small quality-of-life additions.

The stats panel now carries the running version (`Reasonix v0.4.22 ·
model …`) so users can tell at a glance whether they're on the latest
build. A 24-hour background check against the npm registry surfaces a
yellow `update: X.Y.Z` nudge on the right side of the same row when a
newer version has been published — 2s timeout, cache at
`~/.reasonix/version-cache.json`, silent on failure.

`reasonix update` is the command form: detects global install vs npx,
spawns `npm install -g reasonix@latest` for the former or prints a
cache-refresh hint for the latter. `--dry-run` prints the plan.

Also fixes a drifted VERSION constant: `src/index.ts` hard-coded
"0.4.20" while package.json was on 0.4.21. Now re-exports from
`src/version.ts`, which walks up from import.meta.url to the
manifest on first access. A regression test pins them together.

New files: `src/version.ts`, `src/cli/commands/update.ts`,
`tests/version.test.ts`, `tests/update-command.test.ts`. +24 tests
(suite 648 → 672). Lint/typecheck/build clean.
2026-04-22 21:34:11 -07:00
esengine ce85319c9b docs(readme): promote reasonix code to the hero section, document skills
- Quick start now leads with `reasonix code` and a real SEARCH/REPLACE
  walkthrough — nobody enters through plain chat.
- New Skills section covers the SKILL.md format, project vs global
  scopes, /skill slash family, autonomous run_skill invocation, and
  the 'not tied to .claude/' stance.
- chat mode demoted to a brief 'also works as' section pointing at MCP.
- Commands table grouped by category (Core / Model / Context & tools /
  Memory & skills / Sessions / Code-mode only) instead of one flat list.
- Benchmarks promoted into their own 'verify yourself' section.
- Non-goals now names workflow DSL / DAG engine and DeepSeek-only
  positioning explicitly.
- Test count 444 → 648, Node requirement 18 → 20.10, added
  REASONIX_UI=plain to the env-var list.
2026-04-22 19:07:44 -07:00
esengine 2a9a9b386b feat: skills — project/global SKILL.md packs pinned into the prefix + shell fixes (0.4.21)
Skills are user-authored prompt packs read from `<project>/.reasonix/skills/`
and `~/.reasonix/skills/`. Pinned index (names + one-liners) lives in
the immutable prefix; bodies load lazily via the new `run_skill` tool
or `/skill <name> [args]`. Project scope wins on name collisions.
Deliberately NOT tied to any other client's dir (.claude/, .glm/) —
Reasonix is model-agnostic at the conversation layer.

No workflow DSL or DAG engine: skills are prose, the model sequences
via the existing tool-use loop. Preserves single-loop + append-only +
cache-first invariants; "no multi-agent orchestration" non-goal stands.

Shell fixes bundled in:
- ShellConfirm "always allow" now takes effect mid-session.
  extraAllowed is re-read on every dispatch via a getter, so a prefix
  saved to ~/.reasonix/config.json applies to the running tool
  without needing /new or a relaunch.
- Windows cmd.exe built-ins (dir, echo, type, ver, ...) no longer
  crash with ENOENT. prepareSpawn routes bare unresolved Windows
  commands through `cmd.exe /d /s /c` with verbatim-args quoting,
  matching the wrapping strategy for .cmd/.bat files.
2026-04-22 18:58:48 -07:00
esengine e3cfbb58dd feat: user memory — ~/.reasonix/memory/ pinned into the immutable prefix · remember/forget/recall tools · prompt cleanup (0.4.20)
- MemoryStore + applyUserMemory + applyMemoryStack (src/user-memory.ts):
  two scopes — global (cross-project) and project (per sandbox-root sha1).
  Each scope keeps a MEMORY.md index pinned into ImmutablePrefix.system;
  detail files loaded on demand via recall_memory. Byte-stable rewrite
  so identical file sets produce identical prefix hashes.
- remember / forget / recall_memory tools (src/tools/memory.ts) — chat
  mode gets global-only; reasonix code gets both scopes. remember's
  return text is imperative so R1 treats the fact as authoritative on
  the same turn.
- /memory slash extended: list | show <name> | forget <name> |
  clear <scope> confirm. Bare /memory renders REASONIX.md + both
  MEMORY.md blocks together.
- Prompt cleanup: dropped hardcoded dir enumerations, bun/npm examples,
  "待确认" CJK fallback, DSML-hallucination historical note, and
  Linear/Slack type-hint specifics. Principle-only wording + reference
  to the pinned .gitignore block. Net -tokens on every turn.
- README: new "User memory" subsection under REASONIX.md.
- scripts/smoke-memory.mts: 30-assertion end-to-end regression script.
- REASONIX_MEMORY=off now disables every memory source (REASONIX.md +
  user memory) — previous semantics was REASONIX.md only.

Tests: 542 → 624 (+82 incl. 36 memory-layer unit tests). Lint / tsc /
build clean.
2026-04-22 17:30:26 -07:00
esengine becaf487e8 fix(shell): use path.win32.join so CI tests with platform:win32 pass on Linux
CI runs on Linux, where pathMod.join defaults to POSIX (`/`). The
PATHEXT resolver mocks its isFile predicate with back-slashed keys
(`C:\tools\npm.CMD`), so join with POSIX produced `C:\tools/npm.CMD`
and lookups missed, failing 8 tests at origin. The runtime call path
is unaffected either way since the win32 branch is only active when
platform === "win32" anyway — but making the join explicitly win32
also hardens against weird PATHs on Windows where forward slashes
have historically crept in.
2026-04-22 06:38:41 -07:00
esengine 6111d8f621 fix(loop): surface StormBreaker suppression as a visible warning + reset on user turn
A silent storm-break was indistinguishable from a stalled turn — the
model would look like it gave up when really we'd suppressed its
repeat tool call. Now `step()` emits a dedicated warning event when
`report.stormsBroken > 0`, with distinct messages for the two cases:

- All calls suppressed (stuck retry): tell the user the model is
  looping on the same (tool, args) and point them at /retry or
  rewording the instruction. This is the case that used to dead-end
  the turn with nothing on screen.
- Some calls suppressed (one redundant): the rest of the turn
  proceeds; the warning is informational.

Also reset the StormBreaker's sliding window at the top of every
`step()` so a new user message doesn't inherit last turn's repeat
patterns (false-positive blocks on legitimate "try again" flows).

Part of the 0.4.19 batch — tag will be moved to this commit.
2026-04-22 06:35:13 -07:00
esengine d8ba9f9669 fix(shell): Windows — PATHEXT resolution + cmd.exe wrapping for .cmd/.bat (0.4.19)
Two layered fixes so `run_command` actually runs npm/npx/tsc/yarn/
pnpm/bun/pytest and every other Node-ecosystem wrapper on Windows:

1. resolveExecutable() walks PATH × PATHEXT manually — spawn
   with shell:false uses CreateProcess, which ignores PATHEXT, so
   bare `npm` missed `npm.cmd` and ENOENT'd.

2. prepareSpawn() wraps .cmd/.bat via `cmd.exe /d /s /c` with
   windowsVerbatimArguments + per-arg quoteForCmdExe — Node 21.7.3+/
   24 (CVE-2024-27980) refuses direct spawn of .cmd/.bat even with
   shell:false, throwing EINVAL. cmd.exe wrapping with manual
   safe-quoting keeps shell metacharacters (&, |, <, >, etc.) in
   arguments literal so the previous security posture holds.

Unix path unchanged. Suite 566 → 587.
2026-04-22 06:09:11 -07:00
esengine e409e9d8d9 feat: Plan Mode — autonomous plan proposals + /plan gate + answer-questions flow (0.4.18)
submit_plan tool: model proposes a markdown plan for large tasks
(multi-file refactors, ambiguous requests, risky changes). Picker
shows Approve / Refine / Cancel with the plan rendered as live
Markdown, not raw text. Open-questions sections ("Open questions",
"待确认", "Risks", etc.) are detected; default selection flips to
Refine and a yellow hint surfaces.

Both Approve and Refine take an inline text input afterward so the
user can answer the model's open questions or attach last-minute
instructions before the loop resumes. Empty Enter on Approve skips
the extras; empty Enter on Refine tells the model to ask concrete
clarifying questions.

/plan slash flips a dispatch-level read-only gate on the
ToolRegistry — writes + non-allowlisted shell bounce with a refusal
the model reads. Read tools, web_search/fetch, and allowlisted shell
(git status / cargo check / npm test etc.) still work during
exploration. Tool specs stay pinned across the toggle so the DeepSeek
prefix cache doesn't break.

/apply-plan is a fallback that force-approves without the picker,
for cases where the model wrote the plan in assistant text instead
of calling submit_plan.

Suite 542 → 566.
2026-04-22 05:50:28 -07:00
esengine 4d21ca4c4c feat: project memory — REASONIX.md pinned into the immutable prefix (0.4.17)
Drop a REASONIX.md in the project root and its contents are pinned
into the system prompt every session that opens there. Cache-first:
read once, hashed into the prefix fingerprint, no per-turn budget.
/memory prints what's currently pinned; REASONIX_MEMORY=off opts out.

Suite 517 → 542. Re-exported applyProjectMemory / readProjectMemory /
memoryEnabled + PROJECT_MEMORY_FILE / PROJECT_MEMORY_MAX_CHARS for
library consumers that build their own system prompt.
2026-04-22 04:55:06 -07:00
esengine 1ccc1d7e67 feat: run_command shell tool · session picker · ShellConfirm picker · backspace/markdown fixes (0.4.16) 2026-04-22 04:43:17 -07:00
esengine fd344986e8 feat: web_search via Mojeek · cursor editing in prompt · REASONIX_UI=plain · ticker consolidation (0.4.15) 2026-04-22 04:05:25 -07:00
esengine 6ceb73d367 fix(ui): consolidate timers · patchConsole:false · REASONIX_UI=plain opt-out (0.4.14) 2026-04-22 02:35:02 -07:00
esengine dee96f66a2 fix(ui): tool_call_delta progress · reset streamRef per iter · expanded README (0.4.13) 2026-04-22 01:59:44 -07:00
esengine 6b4d8652e4 fix(loop): full tool_calls↔tool pairing validator + auto-compact on context-guard (0.4.12)
Two DeepSeek 400s users hit in succession:
- "insufficient tool messages following tool_calls" on forced
  summary: context-guard appended assistant.tool_calls then bailed
  before dispatching. Fix: strip the tail before forceSummary.
- "tool must be a response to a preceding tool_calls" on the next
  message: partial heals left stray tool messages in the log.

Root fix: healLoadedMessages now runs a full tool_calls↔tool pairing
validator. Any assistant.tool_calls with an incomplete response set
is dropped (with its partial responses); any stray tool message is
dropped. Runs on session load (rewrites the file so damage doesn't
re-surface) AND on every buildMessages call (defensive).

Context-guard now auto-compacts before forcing summary. Previously
80% context meant you lost a turn immediately. Now: try shrinking
oversized tool payloads first; only fall back to forced summary
when nothing's compactable.

Split shrinkOversizedToolResults from healLoadedMessages so
`/compact` (mid-turn) doesn't strip legitimate structural state.

443 tests (+5 new, 4 reshaped).
2026-04-22 01:07:07 -07:00
esengine 5f7d8f238a feat: git-diff edit_file · /new clears context · clearer phase labels (0.4.11)
edit_file now produces a real git-diff-style output:
- LCS line-level diff (unchanged lines as ` ` context, `-/+` only
  for actual changes). Fixes the user-reported case where a one-line
  search with a multi-line replace showed the unchanged line as both
  `-` and `+`.
- Git-style @@ -start,count +start,count @@ hunk header pointing at
  the real starting line in the file.
- EventLog no longer truncates edit_file results — other tools keep
  the 400-char clip, but edit diffs always show full.

Context management:
- /new (alias /reset) drops the in-memory log AND empties the
  session file. Fresh conversation, same session/model/config.
- /clear now advertises that it only clears visible scrollback;
  users kept expecting it to clear context. Info line points at
  /new for the real clear.
- CacheFirstLoop.clearLog() is the public API.

Streaming row:
- Replaced "streaming · 391 + think 4506 chars" with explicit
  phase labels: yellow "request sent · waiting for server" pre-
  first-byte, cyan "R1 reasoning · N chars of thought" during
  reasoning-only, green "writing response · N chars · after M
  chars of reasoning" in content phase.

436 tests (+8).
2026-04-22 00:52:13 -07:00
esengine dc38c765e8 feat: status indicators · live stats · balance · in/out cost split · edit_file diff · GFM tables (0.4.10)
Major batch of UX fixes based on user reports:

Silent-wait elimination:
- New "status" loop event + StatusRow component. Fills silent
  phases with explicit magenta spinner text: "tool result uploaded
  · model thinking before next response…" between iters,
  "extracting plan state from reasoning…" before harvest,
  "summarizing what was gathered…" before forced summary. Auto-
  clears on the next primary event.
- Belt-and-suspenders "processing…" fallback when busy but none of
  streaming/ongoingTool/statusLine is visible — catches any
  micro-gap the targeted statuses don't cover.
- Strengthened pre-first-byte messaging: "(request sent · waiting
  for server)" instead of "(streaming · 0 chars)".

Stats panel:
- Live per-iter refresh — previously frozen at prior turn's
  numbers for 30-60s during multi-iter chains.
- Account balance cell. New DeepSeekClient.getBalance() hits
  /user/balance (separate endpoint, no billing impact). Refreshed
  after each turn, hidden on failure.
- In/out cost split. Panel now shows "cost $X (in $Y · out $Z)"
  so users can see where spend lands. SessionSummary gains
  totalInputCostUsd + totalOutputCostUsd; inputCostUsd() and
  outputCostUsd() exposed as library utilities.
- Dropped "vs Claude / saving" cells — the synthetic ratio looked
  like marketing, not measurement. Fields kept in summary for
  benchmark/replay compat but deprecated.

Esc coverage:
- harvest() now takes an AbortSignal and fast-paths to emptyPlanState
  when already aborted. Was the last un-signaled API call path.

edit_file visibility:
- Tool result now returns a unified-style `- search / + replace`
  inline diff in addition to the header. Long blocks are truncated
  with "… (N more lines)" marker in the middle; /tool N still shows
  the full thing.

Markdown:
- GFM tables (|col|col| + separator) render as aligned columns
  with │ dividers. CJK-width-aware padding for mixed-lang tables.
  Alignment colons, pipe-less headers, escaped \| in cells all
  handled. Stray | in prose no longer false-triggers the table
  path.

427 tests (+11).
2026-04-22 00:39:07 -07:00
esengine 59bd38b1aa feat: Esc cancels immediately · native fs tools · cursor fix · slow_count demo (0.4.9)
Three reported issues rolled into one release:

1. Esc now truly cancels in-flight work. AbortController threaded
   through every I/O path:
   - DeepSeekClient.chat/.stream signal wired at every call site
   - ToolRegistry.dispatch gets a ToolCallContext { signal }
   - McpClient.callTool({ signal }) fires notifications/cancelled
     AND rejects the pending promise immediately — no waiting on
     subprocess for a graceful finish
   - bridgeMcpTools forwards ctx.signal down

2. Built-in filesystem tools replace the
   @modelcontextprotocol/server-filesystem subprocess inside
   `reasonix code`. 10 native tools, sandboxed, R1-friendly schemas.
   The new edit_file takes a flat SEARCH/REPLACE shape instead of
   the JSON-in-string array that was the single biggest driver of
   R1 DSML hallucinations in 0.4.x. Per-call latency drops from
   ~500ms–2s (Windows subprocess IPC) to <10ms (direct fs).

3. PromptInput placeholder cursor now renders at position 0
   (before the hint text), not after it.

4. Bonus: slow_count demo tool in examples/mcp-server-demo.ts
   emits real notifications/progress frames so the progress-bar
   plumbing from 0.4.8 is testable end-to-end.

ChatOptions grows `seedTools: ToolRegistry` so callers can
pre-register tools and still layer MCP on top. ToolCallContext
is re-exported for library users writing abortable tools.

416 tests (+29: filesystem-tools +26, mcp abort +3).
2026-04-22 00:14:56 -07:00
esengine 3484c04133 feat(mcp): progress notifications — live progress bar in spinner (0.4.8)
MCP notifications/progress now route to per-call onProgress handlers.
Long-running tool calls can stream incremental progress; the spinner
row renders an ASCII bar + n/total + pct when the server reports a
total, or free-form progress+message otherwise.

- McpClient.callTool(name, args, { onProgress }) mints a fresh
  _meta.progressToken and routes progress frames back. Handler is
  dropped on completion — late frames are swallowed silently.
- bridgeMcpTools({ onProgress }) pipes per-call progress through
  with the registered (prefix-applied) tool name.
- chatCommand creates a shared progressSink ref; App.tsx wires its
  setState handler through on mount.

Other server-initiated notifications (list_changed) still dropped
— no use case yet.

387 tests (+5).
2026-04-21 23:54:11 -07:00
esengine 7075608ddc feat(ux): multi-line prompt input — Ctrl+J · Shift+Enter · '\<Enter>' (0.4.7)
Replaces ink-text-input in the main chat prompt with a custom
multi-line composer. Three newline-insertion paths in reliability
order: Ctrl+J (universal), Shift+Enter (modern terminals), trailing
"\" + Enter (portable fallback). Pasted multi-line content lands
intact instead of submitting on the first '\r'.

Pure processMultilineKey reducer keeps the keyboard semantics
testable; the React component is a thin wrapper. Parent-owned keys
(Tab, arrows, Esc) are no-ops in the reducer so the buffer never
eats a stray control sequence when both useInput listeners fire on
the same event.

Cursor-at-end model (no mid-string edits) — simple, predictable,
and doesn't collide with parent's arrow-key slash-nav + history.
ink-text-input still used by Wizard/Select/Setup — fine for
single-line forms.

382 tests (+18).
2026-04-21 23:47:04 -07:00
esengine 27a32b7b94 feat(ux+mcp): slash autocomplete · drop footer · /mcp rich view · mcp inspect CLI (0.4.6)
UX overhaul:
- Typing `/` pops an IntelliSense-style suggestion list with name +
  args hint + summary. ↑/↓ navigate, Tab completes, Enter picks +
  runs. Registry-driven (SLASH_COMMANDS) with code-mode gating.
- Static command-strip footer under the input is gone — superseded
  by the on-demand slash popup.

MCP discovery:
- /mcp in chat is now a rich per-server view: server info + spec +
  tool count + resources list + prompts list. Unsupported sections
  render "(not supported)" cleanly. Inspection runs once at
  startup and flows through SlashContext.mcpServers.
- New `reasonix mcp inspect <spec>` CLI for running the same
  discovery outside chat (CI, scripting, "does this work?"). --json
  emits the full InspectionReport.
- inspectMcpServer() + InspectionReport are public APIs; McpClient
  gains serverInfo / protocolVersion / serverInstructions getters.

364 tests (+11).
2026-04-21 23:39:48 -07:00
esengine 1391534f6c feat(repair+mcp): DSML scavenge + MCP resources/prompts (0.4.5)
Two protocol-level completions bundled:

1. DSML tool-call recovery. scavengeToolCalls gains a DSML invoke
   parser (<|DSML|invoke>/<|DSML|parameter string="true|false">).
   ToolCallRepair.process now scans both reasoning AND content
   channels — before, DSML in a regular turn was stripped from
   display but the tool never actually ran.

2. MCP resources + prompts. McpClient gains resources/list,
   resources/read, prompts/list, prompts/get with full types and
   cursor pagination. Initialize now advertises all three
   capability families.

353 tests (+13: scavenge +5, pipeline +2, mcp +6).
2026-04-21 22:13:43 -07:00
esengine 169d66d46a feat(ux): /tool slash — inspect untruncated tool output (0.4.4)
EventLog clips tool results at 400 chars for display; /tool [N]
now lets users read the full text. `/tool` lists the 10 most
recent with previews and char counts; `/tool N` dumps the
Nth-most-recent in full. Wired via new SlashContext.toolHistory
callback — pure handleSlash stays stateless.

340 tests (+8 /tool cases).
2026-04-21 21:41:30 -07:00
esengine 2836b5d406 fix(loop): Esc abort no longer blocks for 30-90s + bump to 0.4.3
User feedback: after pressing Esc, the warning fired instantly but
then the TUI blocked for the duration of a full reasoner call
(30-90s) to produce a "summary" the user hadn't asked for. Esc in a
terminal means stop. Stopping and then forcing the expensive
reasoner to wrap up is the opposite of what the user signaled.

Abort path now:
  - Emits a short warning "aborted at iter N/M — stopped without
    producing a summary (press ↑ + Enter or /retry to resume)"
  - Appends a synthetic assistant message "[aborted by user (Esc)
    — no summary produced. Ask again or /retry when ready; prior
    tool output is still in the log.]"
  - Yields assistant_final (tagged forcedSummary so edit applier
    ignores) + done
  - No API call. Takes milliseconds.

Budget and context-guard paths still call forceSummaryAfterIterLimit
because in those cases the loop stopped, not the user — leaving
them staring at nothing would be worse than one extra call. Only
user-initiated abort gets the fast path.

Test rewritten to confirm no extra API call is made (previously
asserted a "partial findings" summary from the never-needed
follow-up). Suite: 332 still passing.

Also bumps to 0.4.3 because v0.4.2 tag is already on origin at
cb2f2a5 with partial content. This release consolidates the full
0.4.2 batch + the Esc fix under one tag.
2026-04-21 21:31:59 -07:00
esengine d0bd6852c1 feat(ux): /retry · /status rich · /think · ↑↓ history · y/n · red errors · tool-row elapsed · reasoning tail · DSML strip (0.4.2)
Nine UX improvements in one batch, all surfaced from real-session
feedback while testing reasonix code against a live filesystem
project.

Added slash commands:
  - /retry — truncate log back before the last user message, resend
    it, get a fresh sample from the model. SlashResult gains a
    resubmit field the TUI honors after displaying info.
  - /status — now a labeled situation-report: model, flags
    (harvest/branch/stream), ctx ratio (42k/131k (32%)) from last
    turn's promptTokens, MCP server + tool counts, session name +
    log length + resumed count, pending edits count. One command
    shows everything.
  - /think (alias /reasoning) — dumps full R1 reasoning from
    loop.scratch.reasoning. For when the 260-char tail preview
    isn't enough. Graceful "no reasoning cached" when using
    deepseek-chat.

Added interactions:
  - ↑/↓ shell-style prompt history. App.tsx owns a ref array, cursor
    advances on arrow keys while idle. Process-scoped, no cross-run
    persistence.
  - y/n fast-path when edits are pending. Typing 'y'+Enter = /apply,
    'n'+Enter = /discard. Scoped: only when pendingEdits.length > 0,
    so plain "y" as a normal message still works when nothing's
    waiting. Preview line advertises the shortcut.

Changed:
  - Tool-running row surfaces elapsed seconds + per-tool argument
    summary. Before: ⠋ tool<filesystem_edit_file> running… {raw
    JSON}. Now: ⠋ tool<filesystem_edit_file> running… 3s / path:
    F:\... (2 edits). Summarizers for read_file, write_file,
    edit_file, list_directory, directory_tree, search_files,
    move_file, get_file_info. Matches suffix so namespaced and
    anonymous servers both work.
  - Reasoning preview shows tail (~260 chars), not head. R1 opens
    every turn with the same scaffolding that hid the actual
    decision in the (+N chars) elision; users reported reasoning
    looked identical across turns. The tail is where the model
    commits to an action.
  - Tool errors render red with ✗ marker instead of yellow with →.
    ERROR: prefix from flattenMcpResult (on isError) is detected.
    A failure needs different attention than a listing.

Fixed:
  - Forced-summary path no longer leaks DSML tool-call markup as
    prose. Passing tools: undefined wasn't enough — R1 primed for
    tool use would still emit <|DSML|function_calls>...</|DSML|
    function_calls> as plain text in content. Two layers: (1)
    inject an explicit user-role instruction at the end of the
    forced-summary message list telling the model to produce prose
    with no tool markup; (2) post-hoc strip known envelopes (DSML
    full-width/ASCII, Anthropic <function_calls>, and truncated
    un-closed DSML openers) from the model's response before
    yielding. stripHallucinatedToolMarkup exported for library
    callers. Fallback message when stripping leaves nothing points
    at /retry and /think.

Tests: +13, suite 319 -> 332.
  - tests/slash.test.ts (+8): /think empty/populated/help,
    /retry happy/empty-log/help, /status new format, /status
    pending-edit suppression at 0.
  - tests/loop-error.test.ts (+5): stripHallucinatedToolMarkup
    against live R1 DSML shape, Anthropic-style, truncated
    un-closed opener, plain prose, all-markup edge case.

Bumps to 0.4.2.
2026-04-21 21:26:42 -07:00
esengine cb2f2a550b feat(ux): tool-row elapsed + args · reasoning tail · /think (0.4.2)
Three small improvements surfaced from real-session feedback:

1. Tool-running row was just a spinner + raw-JSON args; user said
   "看不到任何的输出,就只知道再转圈". Added elapsed seconds counter
   and per-tool argument summarizer. Instead of
     tool<filesystem_edit_file> running... {"path":"..."...}
   you now see
     tool<filesystem_edit_file> running... 3s
       path: F:\testtest\index.html (2 edits)
   Summarizers for read_file / write_file / edit_file /
   list_directory / directory_tree / search_files / move_file /
   get_file_info, matching by suffix so bridgeMcpTools name prefix
   (e.g. "filesystem_") works too. Unknown tools fall back to a
   truncated raw preview.

2. ReasoningBlock showed the first 220 chars with "(+N chars)"
   elided at the end. R1 opens every turn with the same scaffolding
   ("let me look at the structure...") so the preview looked
   identical across turns and hid the actual decision in the
   truncated tail. Switched to showing the LAST ~260 chars —
   which is where R1 commits to an action.

3. /think slash command dumps the full reasoning text from
   loop.scratch.reasoning when the tail preview isn't enough.
   Alias: /reasoning. Graceful "no reasoning cached" message when
   the current model is deepseek-chat (no reasoning_content) or a
   turn hasn't completed yet.

Tests: +3 in slash.test.ts (/think empty + populated + help).
Suite: 319 -> 322.

Bumps to 0.4.2.
2026-04-21 21:05:44 -07:00
esengine e472f4cb79 feat(code): /apply gate + /undo + /commit + .gitignore + better UX signals (0.4.1)
A real-session bug report — "I asked the model to analyze the project
and it silently edited a file" — forced a rethink of v0.4.0's
auto-apply default. This release fixes the root cause plus a stack of
adjacent UX gaps surfaced during the fix.

WHY (behavior change): auto-apply was wrong because it conflated two
distinct events — "the model proposed a change" and "the user wants
to make the change." v0.4.0 treated every SEARCH/REPLACE block in
assistant output as permission to write. Analysis drifted into edits.
Preview-by-default + explicit /apply is Aider's model and it's honest.

Added (code mode):
  - /apply: writes pending edit blocks to disk, snapshots for /undo,
    reports per-block status
  - /discard: drops pending edits, no disk writes
  - /undo: rolls back the last applied edit batch (restores modified
    files, deletes ones created by the batch)
  - /commit "msg": git add -A && git commit -m "..." in code rootDir;
    surfaces git stderr on hook failure / nothing-staged / etc.
  - .gitignore awareness: reasonix code reads rootDir/.gitignore on
    launch and appends it to the system prompt as "don't traverse
    these paths unless asked"; hard-coded baseline (node_modules,
    dist, .git, .venv, __pycache__, target, ...) baked into the base
    prompt for projects without a .gitignore

Fixed:
  - Edits no longer auto-write. Each assistant turn's blocks are
    parsed and shown as a preview (filename + -N/+M line-count). No
    disk write until /apply. Pending persists across messages.
  - LoopEvent.forcedSummary flag on assistant_final events from the
    no-tools fallback (budget/aborted/context-guard). Code-mode
    applier skips tagged events — a wrap-up summary is not a plan.
  - Token-context guard replaces iter count as primary stop
    condition. promptTokens > 80% of ctx window -> yellow warning +
    skip tool exec + divert to summary (reason: "context-guard").
    Iter cap 24 -> 64 as last-resort backstop.
  - CODE_SYSTEM_PROMPT tightened: explicit rule that edits only fire
    on change/fix/add/remove/refactor intents; analyze/explain stay
    read-only.
  - Stray EditSummary/summarizeEdit reverted from edit-blocks.ts (a
    0.4.0 forced-summary run auto-wrote it; dead code).
  - SEARCH/REPLACE blocks now render as a proper diff (red -/green +)
    instead of going through the markdown paragraph path, which was
    joining lines with spaces and letting the bold/italic regex eat
    `*` chars inside JSDoc `/** ... */` comments. New parseBlocks
    exports an "edit-block" block kind.
  - R1 reasoning UX no longer looks frozen. Cyan braille-spinner
    heartbeat (500ms) + "reasoning" vs "streaming" label + explicit
    "R1 is thinking before it speaks — body text starts when
    reasoning completes (typically 20-90s)" message while body is
    empty. Replaces the misleading "(waiting for first token...)".
  - New "tool_start" event yielded immediately before
    tools.dispatch(). TUI renders a spinner row "⠋ tool<X> running…"
    with args preview while the Promise is pending — fixes the
    dead-air window between assistant_final (streaming cleared) and
    the tool result event, during which a multi-KB
    filesystem_edit_file could hang the UI visibly for 100ms-1s.

Tests: +36, suite 292 -> 319.
  - tests/edit-blocks.test.ts (+5): snapshot/restore round-trip,
    delete on undo-of-create, per-path dedup, path-escape defense.
  - tests/code-prompt.test.ts (+4, new file): .gitignore injection
    happy/absent/truncated paths, base-prompt ignore hints.
  - tests/slash.test.ts (+13): /apply /discard /undo /commit inside
    and outside code mode, usage hint on empty, double-quote
    stripping, help listing.
  - tests/loop.test.ts (+2): context-guard warning + forcedSummary
    flag when prompt > 80% of window, tool_start precedes tool.
  - tests/markdown.test.ts (+5): parseBlocks recognizes SEARCH/
    REPLACE into edit-block blocks, preserves multi-line JSDoc
    verbatim, handles new-file empty-SEARCH, rejects stray markers
    without close, multi-block + prose interleaving.

Bumps to 0.4.1.
2026-04-21 20:53:53 -07:00
esengine 14887264bb feat(code): reasonix code — SEARCH/REPLACE editing as a first-class mode (0.4.0)
A new opinionated subcommand that turns Reasonix into a coding
assistant, realizing the "cheap Claude Code" pitch. Layers on top of
the existing chat + MCP machinery rather than forking it.

What `reasonix code [dir]` does:
  - Auto-bridges @modelcontextprotocol/server-filesystem at [dir]
    (default CWD). No wizard, no config merge.
  - Uses a coding-focused system prompt that teaches Aider-style
    SEARCH/REPLACE blocks and forbids write_file for existing files.
  - Forces reasoner + harvest (coding repays R1 thinking).
  - Scopes the session name to the directory basename so projects
    don't cross-pollute.
  - Hooks codeMode into App.tsx — after each assistant_final, parses
    SEARCH/REPLACE blocks from the response and applies them to disk,
    reporting per-block results as info lines.

SEARCH/REPLACE semantics (src/code/edit-blocks.ts):
  - SEARCH must match byte-for-byte. No fuzzy matching — a silent
    wrong edit is worse than a loud rejection.
  - Empty SEARCH creates a new file (Aider convention).
  - First occurrence only; duplicate SEARCH text requires a new
    block with more surrounding context.
  - Path-escape defense: resolve + startsWith on the normalized
    rootDir, refuses paths climbing above the sandbox.

Library surface: parseEditBlocks, applyEditBlock, applyEditBlocks,
CODE_SYSTEM_PROMPT, and EditBlock/ApplyResult/ApplyStatus types.
Compose them yourself for custom UIs.

Out of scope for v1: /commit, /undo, diff preview, .gitignore
filtering. User's `git diff` + `git checkout` is the review/undo
surface; we run inside a git repo by convention.

Tests: +13 in edit-blocks.test.ts (parse: single/multi/multiline/
empty-search/stray-markers; apply: happy/new-file/not-found/
file-missing/path-escape/first-occurrence; batch: independent
results). Suite 279 -> 292.

Bumps to 0.4.0 (minor — new user-facing primitive + library surface
additions; no breaking changes for 0.3.x users).
2026-04-21 20:05:45 -07:00
esengine 63ced2fa5b feat: Esc to abort + 70% budget warning + README refresh (0.3.2)
0.3.1 gave the loop a safety net (forced summary at maxToolIters);
this release turns that safety net into an interactive budget. Users
no longer have to wait for the ceiling to hear from the model.

- Yellow warning event fires once per step when tool-iter count hits
  70% of maxToolIters. TUI renders it in the event log with an
  "Press Esc to force a summary now" hint; the command strip under
  the prompt also shows the Esc shortcut.
- CacheFirstLoop.abort() method + TUI Esc handler (useInput, guarded
  by busy state and a once-per-turn flag). On abort, the current tool
  call is allowed to finish, then the loop diverts to the 0.3.1
  no-tools summary path with a different prefix:
  "[aborted by user (Esc) - summarizing what I found so far]".
- New EventRole "warning" + DisplayRole "warning"; EventLog renders
  them yellow. Wired through App.tsx's event dispatcher.

README rewrite: hero leads with `npx reasonix` (no flags), wizard
story in prose. --mcp and --preset examples moved to "Advanced".
What-you-get table gains Setup wizard, Context safety net row, and
merges stdio + SSE into one MCP row. Non-goals and Configuration
trimmed to match.

Tests: +2 in loop.test.ts (warning fires exactly once at threshold;
abort() diverts to summary with "aborted" prefix). Suite: 277 -> 279.

Bumps to 0.3.2.
2026-04-21 19:50:52 -07:00
esengine 461e736cbc fix(loop): force summary when maxToolIters is reached (0.3.1)
Problem (reproduced live): user asked the reasoner to explore a Flutter
project via filesystem MCP. The model chained 8 list_directory /
read_file calls, the loop hit the default maxToolIters=8, quietly
yielded a "done" event with content "[max_tool_iters reached]", and
exited. The App.tsx doesn't render `done` content anywhere, so the
user saw a blank assistant reply after 8 tool calls — as if Reasonix
just stopped for no reason.

Fix:
  - When the tool-call loop exhausts its budget with tool_calls still
    pending, make one final request to DeepSeek with tools omitted.
    Forces a text-only answer based on everything in history. Yield
    as a normal assistant_final event, prefixed with
    "[tool-call budget (N) reached - forcing summary from what I found]"
    so the user knows why they got a summary instead of more drilling.
  - Default maxToolIters 8 -> 24. Eight was below the floor for any
    real filesystem exploration; 24 still caps a confused model's
    damage.

Tests: +1 in loop.test.ts with maxToolIters=2, every response wanting
tools, proving the summary call fires and assistant_final carries the
budget annotation. Suite: 276 -> 277.

Bumps to 0.3.1.
2026-04-21 19:40:15 -07:00
esengine d932c50ab3 release: v0.3.0 — context gauge + /compact + stable graduation
Drops the prerelease tag and ships 0.3.0 stable. Since 0.2.2 this
includes: MCP (stdio + SSE, multi-server, curated catalog), the
first-run wizard that replaces the --mcp flag maze, config-backed
defaults, and a three-layer context-safety net (per-tool cap +
auto-heal on session load + manual /compact).

Added this commit:
  - StatsPanel context gauge: "ctx 42k/131k (32%)" with yellow at
    50% and red + "/compact" nudge at 80%+. Reads SessionSummary's
    new lastPromptTokens field; model max comes from
    DEEPSEEK_CONTEXT_TOKENS (131072 for chat/reasoner).
  - /compact [cap] slash: re-applies truncation with a tighter 4k
    char cap (or user-supplied), rewrites the session file on disk
    so the next launch doesn't re-inherit a fat file. Reports chars
    and approximate tokens saved.
  - SessionSummary.lastPromptTokens, AppendOnlyLog.compactInPlace(),
    session.rewriteSession(), loop.compact() — all new exports.

Tests: +5 (slash /compact x4, telemetry lastPromptTokens x1).
Suite: 276 passing (up from 241 in alpha.4).

Migration note: one silent behaviour change — sessions built with
pre-alpha.6 clients auto-heal on load (oversized tool results get
truncated). The conversation is preserved; only the bloat shrinks.
2026-04-21 19:35:36 -07:00
esengine b4c461c6ad fix(mcp): cap tool-result size + annotate context-overflow errors
Problem: a single `read_file` on a big file returned ~3 MB of text
through flattenMcpResult; it landed in session history verbatim and
every subsequent turn 400'd with DeepSeek's "maximum context length
is 131072 tokens. However, you requested 929,452 tokens." The user
had no way to recover short of deleting the session file by hand.

Fix, at both ends:
  - Prevention: bridgeMcpTools now caps each result at 32k chars by
    default. truncateForModel keeps head + 1KB tail with a clear
    "[...truncated N chars...]" marker, so the model sees both
    "what the tool started returning" and "how it ended" (important
    for error messages appended at the bottom of stack traces).
    Override: bridgeMcpTools(client, { maxResultChars: N }).
  - Diagnosis: formatLoopError() detects "maximum context length"
    in the raw API error, pretty-prints the requested-token figure,
    and tells the user exactly what to do — /forget to wipe the
    session file, /clear for display-only. Other errors pass through.

Exports: DEFAULT_MAX_RESULT_CHARS, truncateForModel, FlattenOptions,
formatLoopError — so library callers get the same protection.

Tests: +3 for truncation (head+tail preserved, no-op below cap,
end-to-end dispatch), +3 for error annotation (token figure,
passthrough, figure-less overflow). Suite 262 -> 268.

Bumps to 0.3.0-alpha.6.
2026-04-21 19:22:58 -07:00
esengine 2f4e28b7cb feat(ux): setup wizard + config defaults — reasonix with no args just works
The previous UX required users to memorize a pile of flags
(`--mcp "name=npx -y @scope/pkg /path"`, `--harvest`, `--branch N`,
`--session`) before they could use any of Reasonix's power features.
That was wrong: the target audience is ordinary users, not CLI
archaeologists.

New flow:
  - `npx reasonix` — on first run opens an Ink wizard (API key →
    preset pick → MCP multi-select → per-server args → save). On
    subsequent runs launches chat with the saved defaults.
  - `reasonix setup` re-runs the wizard any time; existing selections
    are pre-checked via package-name matching against the catalog.
  - `~/.reasonix/config.json` now stores preset + mcp + session +
    setupCompleted alongside apiKey. Precedence: explicit CLI flag
    wins, then --preset, then config.preset, then hardcoded fast
    defaults. `--no-config` is the escape hatch for CI.
  - `--preset <fast|smart|max>` new on both chat and run so power
    users get the bundled settings too.
  - `/mcp` slash — lists attached servers + tool registry mid-chat.
  - `/setup` slash — prints instructions to exit and re-run
    `reasonix setup`. Live reconfig is out of scope: swapping tools
    mid-session would invalidate the byte-stable prefix.

Fixes two real bugs found during manual testing:
  - `@modelcontextprotocol/server-fetch` and `server-sqlite` were in
    the catalog but don't exist on npm (Python-only reference
    implementations). Picking either one produced a 404 that killed
    the chat. Removed.
  - One broken MCP server took down the whole chat via
    `process.exit(1)`. Now each failure prints `▸ MCP setup SKIPPED`
    pointing at `reasonix setup` and the session continues with the
    servers that worked.

Tests (+21, suite 241→262):
  - tests/resolve.test.ts (+11) — flag/preset/config precedence, cap
    and off paths, --no-config, --no-session isolation.
  - tests/config.test.ts (+2) — extended schema round-trip,
    session:null meaning ephemeral.
  - tests/slash.test.ts (+4) — /mcp empty + populated, /setup hint,
    help coverage.
  - tests/wizard.test.ts (+4) — buildSpec → parseMcpSpec round-trip
    for filesystem / memory / spaces-in-path / unknown-entry fallback.

Bumps to 0.3.0-alpha.5.
2026-04-21 19:14:59 -07:00
esengine 5f715d05ee feat(mcp): SSE transport — remote/hosted servers via --mcp "https://…"
Implements the MCP 2024-11-05 HTTP+SSE wire: GET the SSE URL, wait for
event: endpoint, POST every outgoing JSON-RPC frame to that URL, read
responses off the SSE channel. Headers (Authorization, etc.) pass
through to both the GET and POSTs so hosted servers behind auth work.

--mcp now routes anything starting with http:// or https:// to
SseTransport; everything else stays stdio. McpSpec becomes a
discriminated union { transport: "stdio" | "sse", … } — callers that
inspected spec.command/args must branch on spec.transport first.

Tests: in-process http.Server fake implementing the SSE wire —
relative endpoint resolution, absolute endpoints, a full McpClient
initialize → listTools round-trip, handshake failure propagation.
Plus parseMcpSpec SSE cases (case-insensitive scheme; ws:// stays
routed to stdio as there's no ws transport yet). Suite: 241 passing.

Bumps version to 0.3.0-alpha.4.
2026-04-21 18:55:06 -07:00
esengine b662c63894 data(mcp): multi-server live run — 2 subprocesses, 1 prefix hash,
Cache-First holds

Third MCP live data point, the ecosystem proof. Run against two MCP
servers concurrently:

  --mcp "demo=node --import tsx examples/mcp-server-demo.ts"
  --mcp "fs=npx -y @modelcontextprotocol/server-filesystem <dir>"

The model used tools from both in one conversation — computed 17+25
via demo_add, then wrote "42" to a real file on disk via
fs_write_file (with a graceful permission-denied recovery in
between).

  turns: 5, tool calls: 4
  cache: 81.1%, cost $0.00185, 95.9% cheaper than Claude
  prefix hashes: ONE across all 5 turns — byte-stable prefix
  survives two concurrent MCP subprocesses

Reference: benchmarks/tau-bench/transcripts/mcp-multi-server.jsonl
(replay offline to verify — no API key needed).

Also adds .claude/settings.local.json to .gitignore (local Claude Code
settings are personal and shouldn't be committed).
2026-04-21 18:41:29 -07:00
esengineandClaude Opus 4.7 e793c7d59d chore(release): v0.3.0-alpha.3 — multi-server MCP + mcp list discovery
Adds the last bit of UX I'd actually hand to a new user: a way to
discover what MCP servers they can try.

New:
- reasonix mcp list            curated catalog of popular official MCP
                               servers, each with a copy-pasteable
                               --mcp command. filesystem / fetch /
                               github / memory / sqlite / puppeteer /
                               everything. --json for machine output.
- --mcp repeatable             multi-server support (already in main,
                               now released on npm @alpha)
- "name=cmd args..." spec      per-server namespace prefix, tools land
                               as fs_read_file, mem_set, etc.

Packages 7cd8621 (multi-server) + new mcp list command as alpha.3.

Discovery is hardcoded not fetched: the list changes slowly, offline
users shouldn't have to wait on a network fetch to see what exists.
Updating it = one file edit + patch release.

Suite 233/233; no functional changes to the existing tested paths.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 18:31:33 -07:00
esengineandClaude Opus 4.7 7cd862194a feat(mcp): multi-server support — repeatable --mcp with per-server names
`--mcp` is now a collect-style option; pass it multiple times to attach
multiple servers to the same chat / run. Each spec can optionally name
its namespace:

  reasonix chat \
    --mcp "fs=npx -y @modelcontextprotocol/server-filesystem /tmp/safe" \
    --mcp "demo=node --import tsx examples/mcp-server-demo.ts"

Tools land in a shared ToolRegistry with the prefix baked in
(fs_read_file, demo_add, …). The model sees the flat namespace; the
registry dispatches to the right subprocess.

Spec syntax (new src/mcp/spec.ts::parseMcpSpec):
- "name=command args..."  → namespaced; `[a-zA-Z_][a-zA-Z0-9_]*` name
- "command args..."       → anonymous; tools keep their native names

The identifier regex is deliberately narrow so Windows drive letters
(`C:\...`) never accidentally look like a namespace prefix.

--mcp-prefix still exists as a global fallback, but only applies when
exactly one anonymous spec is given. With named specs, each server
brings its own name.

Also fixes a shellSplit bug: backslashes outside quotes were being
treated as POSIX escapes, which mangled every Windows path. Now they
pass through literally outside quotes (use quotes to group args with
spaces). Matches user expectation on Windows; POSIX users who want
escape-a-space can quote the arg.

+9 tests: parseMcpSpec (8 cases including Windows drive letters,
identifier-name validation, empty/malformed input) + an integration
test spawning two demo subprocesses concurrently with different
prefixes, verifying the shared registry dispatches to each correctly.
Suite: 233 passing (was 224).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 18:22:53 -07:00
esengineandClaude Opus 4.7 407793c99e chore(release): v0.3.0-alpha.2
Packages 5e124ce's Windows fix + second live MCP data point as an
alpha. v0.3.0-alpha.1 is technically broken on Windows (--mcp "npx ..."
can't find npx.cmd), so this supersedes it on the @alpha npm tag.

No functional changes since 5e124ce — just version bump + CHANGELOG.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 18:08:27 -07:00
esengineandClaude Opus 4.7 5e124cec36 feat(mcp): cross-platform shell fix + second live data point via
official @modelcontextprotocol/server-filesystem

Two things together — the fix is what unlocked the data.

1. StdioTransport now handles Windows .cmd/.bat shims (npx.cmd,
   pnpm.cmd) without triggering Node's DEP0190 deprecation warning.
   On win32, shell defaults to true; we build a quoted command line
   ourselves (command bare so PATH lookup works, args quoted) and
   pass it as a single string, dodging the shell:true + args[]
   anti-pattern. POSIX path unchanged. New `shell?: boolean` option
   lets callers override the platform default (e.g. tests spawning
   node.exe directly).

2. Second live MCP run, this time against the *external*,
   production @modelcontextprotocol/server-filesystem:

     5 turns, 4 tool calls, cache **96.7%**, cost $0.00124,
     97% cheaper than Claude at equivalent tokens.

   The model tried list_directory on the wrong path, got an access-
   denied, self-recovered by calling list_allowed_directories, then
   list_directory + read_text_file. Messy realistic run. Byte-stable
   prefix held across every turn.

   This matters because the first MCP run (v0.3.0-alpha.1,
   mcp-demo.add.jsonl) was against our own bundled demo server.
   Someone could reasonably argue "of course it caches — you wrote
   the server". This one answers that: cache-first works on code
   we don't control.

Reference transcripts:
- benchmarks/tau-bench/transcripts/mcp-demo.add.jsonl       (own server)
- benchmarks/tau-bench/transcripts/mcp-filesystem.jsonl     (official)

README gains a two-row table with both numbers + a no-API-key
reproduction block pointing at both committed transcripts.

Tests still 224/224 green. Integration tests explicitly set
shell: false since they spawn node.exe by absolute path.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 18:04:09 -07:00
esengineandClaude Opus 4.7 7fce6e650c chore(release): v0.3.0-alpha.1 — MCP client + first live run
End-to-end MCP integration verified on live DeepSeek. Recorded run at
benchmarks/tau-bench/transcripts/mcp-demo.add.jsonl:

  ▸ spawned bundled demo MCP server (3 tools bridged)
  ▸ model chose the add tool, received the result via MCP stdio
  ▸ follow-up turn hit 96.6% cache (byte-stable prefix held across
    the tool-call round-trip)
  ▸ total cost $0.000254 — 94% cheaper than Claude at same tokens

This is the v0.1 Cache-First claim extending verbatim to arbitrary MCP
tools. The mechanism wasn't altered; the registry just serves MCP tools
as if they were native. That extension *is* the v0.3 headline.

Shipping as alpha because:
  - one real run is proof-of-concept, not proof-at-scale
  - SSE transport, resources, prompts, and progress notifications are
    still deferred
  - official external MCP servers (filesystem, github, etc.) haven't
    been exercised in CI yet

Suite: 224 passing (10 fake-transport unit, 9 shell-split, 2 real-
subprocess integration, plus the existing 203).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 17:52:54 -07:00
esengineandClaude Opus 4.7 5941043489 feat(mcp): CLI --mcp flag + bundled demo server + subprocess integration test
End-to-end MCP integration — any MCP server's tools flow through
Reasonix's Cache-First loop now, from one CLI flag.

CLI:
  reasonix chat --mcp "<command args...>"        interactive TUI
  reasonix run "<task>" --mcp "<command args...>" one-shot
  optional: --mcp-prefix <str>                   namespace tool names

The flag takes a shell-style command. shellSplit() parses it
(respecting single/double quotes, backslash escapes, tab-space
runs). Unterminated quotes throw with a clear error instead of
silently mangling argv. chat / run both spawn + bridge before
looping, tear down on exit.

App.tsx accepts an optional `tools?: ToolRegistry` prop. When
present, its specs get folded into ImmutablePrefix and dispatch
goes through it — so MCP tools are indistinguishable from native
tools to the loop.

Bundled demo server: examples/mcp-server-demo.ts
~160 lines, no dependencies beyond what's already installed.
Exposes echo / add / get_time. Two uses:
  - users can try the whole integration with no external install:
      reasonix chat --mcp "node --import tsx examples/mcp-server-demo.ts"
  - gives the integration test a real subprocess target

Integration test: tests/mcp-integration.test.ts
Spawns the demo server (`node --import tsx ...` — cross-platform,
avoids Windows `.cmd` resolution issues), walks the full handshake,
bridges tools, dispatches through the registry. Kept in a
separate file from the fake-transport unit tests so subprocess
flakiness doesn't hide unit-test regressions.

+11 tests (9 shellSplit + 2 integration). Suite: 224 passing (was
213). src/mcp/README.md updated with CLI usage + status of what's
shipped vs deferred.

Still no version bump — next is v0.3.0-alpha, once we've seen a
real LLM call go through an MCP tool end-to-end. Everything's in
place for that now; remaining is one live run.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 17:30:33 -07:00
esengineandClaude Opus 4.7 f142f8874d feat(mcp): v0.3 foundation — stdio client + ToolRegistry bridge
Minimal MCP (Model Context Protocol) client, hand-rolled, zero
runtime deps. Lets Reasonix consume tools from any MCP server while
keeping Cache-First + repair applied to the whole thing.

Why roll-our-own instead of @modelcontextprotocol/sdk:
- zero dep cost, consistent with how we wrote the DeepSeek client
- surface tuning — only initialize / tools/list / tools/call for now
- insulation from SDK breaking changes
See src/mcp/README.md for the full reasoning.

Shipped in this pass:
- src/mcp/types.ts      JSON-RPC 2.0 + MCP message types
- src/mcp/stdio.ts      McpTransport interface + NDJSON stdio impl
- src/mcp/client.ts     connect / listTools / callTool with timeouts
                        + id correlation
- src/mcp/registry.ts   bridgeMcpTools(): MCP → Reasonix ToolRegistry,
                        so MCP tools inherit Cache-First + repair
                        automatically
- src/mcp/README.md     design choices + usage example + what's next

Deferred (each is its own follow-up commit):
- CLI wiring: `reasonix chat --mcp <cmd>` — thin layer on top of
  bridgeMcpTools + ImmutablePrefix
- resources/* and prompts/* methods — Reasonix doesn't surface those
  today
- SSE transport — stdio covers common case
- Progress notifications / streaming tool results

+10 tests using an in-process FakeMcpTransport (no child processes in
unit tests — flaky). Covers initialize handshake, pre-init refusal,
tools/list, tools/call roundtrip, server errors, bridge registration,
name prefixing, and result flattening (text / image / error cases).
Suite: 213 passing (was 203).

Public surface: McpClient / StdioTransport / bridgeMcpTools /
flattenMcpResult / MCP_PROTOCOL_VERSION + all relevant types exported
from the library barrel. No version bump — foundation, not release.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 17:04:16 -07:00
esengineandClaude Opus 4.7 fb5977743c data(harvest-bench): 18-run set + honest findings — harvest doesn't
lift accuracy on math/logic; pivot Pillar 2 positioning

Second harvest eval run, 6 tasks × 3 modes × 1 repeat = 18 runs. This
time the task set included three hard tasks chosen specifically for
known V3 failure modes (base-2 Fermat pseudoprime → 341,
derangements of 7 → 1854, Euler polynomial first-fail → n=40).

  mode              pass  cache   cost        harvest signal
  baseline          6/6   39.5%   $0.00137    —
  reasoner          6/6   74.2%   $0.00417    —
  reasoner-harvest  5/6*  61.6%   $0.00330    2.8 sg / 1.3 un

  (* one 300s timeout on pseudoprime_base2)

Honest headline: **V3 passed all six.** Including the hard ones. The
checkers specifically reject the common V3 wrong-answers (561 for
pseudoprime, 265/1855 for D_7, 41/1681 for Euler) — none of those
fired. These problems are well-enough known that V3 has them in
training and R1 has no accuracy headroom to win back.

What this means for v0.3 positioning:

- We cannot ship a "harvest improves answer quality" claim off this
  data — twice now. That's not a framework bug; it's a signal that
  Pillar 2's value is NOT in the "make math more right" story.
- Plausible actual value surfaces: dev-facing introspection of R1's
  planning, or steering tool-call sequences under uncertainty. Neither
  is exercised by this harness.
- Cache-First story DOES extend to reasoner mode (74% mean cache even
  on R1 turns). That's a Pillar 1 finding reinforcing the v0.1 data,
  not a Pillar 2 finding.

findings section updated inside report.ts's renderFindings() so future
regens preserve the analysis. Committed results.json is the full
artifact for anyone who wants to reasonix replay / diff individual
runs.

Recommendation in-report: next release is better served by MCP client
(Pillar 1 leverage across the ecosystem) than by a third harvest-bench
data push. Pillar 2 needs a reframe — likely "debug visibility" or
"tool-sequence planning", not "accuracy multiplier".

Unexpected positive signal worth noting: cross-session prompt cache.
Baseline mean cache hit was 39.5% even on mode A — the same system
prompt across many runs warmed DeepSeek's server-side cache, showing
Cache-First's value isn't purely per-session.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 09:47:01 -07:00
esengineandClaude Opus 4.7 26b50e9242 feat(harvest-bench): 3 hard tasks + --timeout flag
Post-first-run adjustments informed by 7233edd's data:

- Seed tasks bottomed out at V3 chat (3/3 pass on all easy ones), so
  harvest couldn't differentiate. Add three hard tasks picked for
  known V3 failure modes:
  - pseudoprime_base2       (341; V3 commonly says 561 — Carmichael)
  - derangements_d7         (1854; V3 hits n!/e rounding errors)
  - euler_quadratic_break   (40; V3 confuses with n²−n+41 first-fail)
  Each is a single-integer answer → reuse a new checkSingleInt helper.
  Easy tasks stay for floor reference.

- `--timeout <seconds>` flag (default 300s, was 120s client default).
  Prior run hit the 120s cap on three_hats/reasoner-harvest because R1
  alone took ~100s. 300s gives headroom without encouraging runaway
  loops.

+9 tests on new checkers and the common wrong answers (e.g., checker
rejects 561 for pseudoprime_base2, rejects 265/1855 for D_7, rejects
41/1681 for euler_quadratic). Suite: 203 passing.

CI --dry step still covers the runner. No API calls in this commit —
next run uses the expanded task set.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 09:16:18 -07:00
esengineandClaude Opus 4.7 7233eddced data(harvest-bench): first 9-run live data + honest findings
First real data from the v0.3 harvest eval harness (3 tasks × 3 modes,
1 repeat). Findings are not the marketing-friendly "harvest +N% quality"
we wanted — but they're honest, and they sharpen what v0.3 actually
needs.

Headline numbers (per-run means):

  mode              pass  cache   cost        harvest signal
  baseline          3/3   0.0%    $0.00142    —
  reasoner          3/3   79.0%   $0.00355    —
  reasoner-harvest  2/3*  59.7%   $0.00184    3.3 sg / 1.3 un

  (* one timeout, see known issues)

Three honest findings, committed to report.md:

1. V3 chat already solves all three seed tasks. The task set bottoms
   out — baseline's 3/3 pass rate means there's no headroom for R1,
   let alone R1+harvest, to win on quality.
2. Reasoner costs ~2.5× chat on these problems with identical verdicts.
   On this task set, there is no quality argument for R1. (The
   cache-hit story DOES extend — reasoner mode still gets 79% mean
   cache through the Cache-First loop, so Pillar 1 generalizes.)
3. Harvest produces real signal (3-5 subgoals, 1-2 uncertainties per
   run) AND real latency — one run hit the 120s client timeout because
   the harvest V3 call pushed past R1's own ~100s budget.

What this changes for v0.3:

- We cannot ship a "harvest pays for itself" claim off this data.
- The harness is fine; the task set is the bottleneck.
- Next iteration needs problems where V3 demonstrably fails, so R1
  gains real headroom and harvest's uncertainty signal has something
  to correlate with.

report.ts gains a renderFindings() helper so future runs can preserve
the hand-written interpretation alongside the auto-generated tables.

No release tag — this is data collection, not a version bump.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 09:09:34 -07:00
esengineandClaude Opus 4.7 3a92ba2787 feat(bench): harvest eval harness — Pillar 2 scaffold
New benchmarks/harvest/ directory alongside tau-bench/. Measures
Pillar 2 (R1 Thought Harvesting) the same way tau-bench-lite measures
Pillar 1 — isolate one variable, produce reproducible numbers.

Three modes per task, each isolates one variable:
- baseline          deepseek-chat, no Reasonix tricks — V3 floor
- reasoner          deepseek-reasoner, no harvest — raw R1 gain
- reasoner-harvest  deepseek-reasoner + harvest — incremental cost /
                    quality from the extra V3 harvest call

Seed tasks (v0.3):
- mod7_list           number theory, 29-element set — expansive plan state
- flips_until_3heads  probability, single integer — derive vs recall
- three_hats          logic puzzle, one-word answer — deduction chain

All checkers are deterministic (regex + set/value compare). No LLM
judge. Failing checker in CI catches reality drift without needing an
API key — sanity verdict is exercised on every dry-run.

Runner supports --task, --mode, --repeats, --transcripts-dir, --dry.
Transcripts reuse the same TranscriptRecord format as tau-bench, so
reasonix replay / reasonix diff work unchanged.

CI now runs the harvest harness's --dry in addition to tau-bench's,
so bench regressions get caught before a real run.

+16 tests covering checker verdicts for all three tasks, empty-input
robustness, determinism, and task-set invariants. Suite: 194 passing.

No API calls yet — next step is a live run to produce the first
harvest-bench/report.md. Expected cost for 3 tasks × 3 modes × 1
repeat: ~$0.10-0.30 (dominated by the reasoner calls).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:53:01 -07:00
esengineandClaude Opus 4.7 6307b92af2 feat(cli): reasonix sessions — list + inspect saved chats
Promotes the existing /sessions slash command into a top-level CLI
command so users can audit their stored sessions without launching
the TUI. Two modes:

  reasonix sessions                list every session under
                                   ~/.reasonix/sessions/
  reasonix sessions <name>         dump messages from one session
  reasonix sessions <name> -v      include system prompts + tool-call
                                   args

Reuses listSessions / loadSessionMessages / sessionPath from
src/session.ts — no new library surface. Zero API calls; filesystem
reads only.

Use case: quickly checking "what have I been asking the assistant?"
without running chat, or piping one session's content into a tool
chain for batch analysis.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:39:14 -07:00
esengineandClaude Opus 4.7 2e42ae53aa feat(diff): show harvest-signal deltas in summary + markdown
When at least one side of a transcript diff has plan state (Pillar 2
harvest output), the summary now includes three extra rows: harvest
turns, subgoals, and uncertainties. Lets a harvest-on run be compared
head-to-head with its harvest-off twin — which is exactly the
comparison v0.3's eval harness will need to produce.

Rows only appear when at least one side carries planState. No-harvest
diffs render identically to v0.2.2 — zero visual noise, zero surprise
for existing callers.

+2 tests confirming the row appears when harvest is present AND
omits entirely when both sides are clean. Suite: 178 passing.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:36:38 -07:00
esengineandClaude Opus 4.7 5ff0ef4535 chore(ci+examples): bench dry-run in CI + programmatic replay/diff example
Two small adds that make the existing v0.2 infrastructure easier to
pick up:

1. CI now runs `npx tsx benchmarks/tau-bench/runner.ts --dry` on every
   push and PR. Catches bench harness regressions (task factories, CLI
   parsing, file IO, per-sub-call transcript emission) without needing
   a DEEPSEEK_API_KEY in CI.

2. examples/replay-and-diff.ts demonstrates the library surface
   programmatically — readTranscript, computeReplayStats,
   diffTranscripts, renderDiffSummary, plus direct report.pairs
   inspection. Runs with no API key against the committed reference
   transcripts; verifies the v0.1 numbers (94% cache, −20% cost, 1
   byte-stable prefix) fall out of the JSONL alone.

Useful for anyone wiring a CI gate or eval dashboard on top of Reasonix
— which is the main use case that justifies shipping transcripts in
the package in the first place.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:32:51 -07:00
esengineandClaude Opus 4.7 ce963be2e2 fix(ui): plan state colors — semantic + readable on dark terminals
The old PlanStateBlock rendered all four fields in the same magenta
text. On terminals with dark themes (which is most of them), magenta
is notoriously low-contrast — users reported not being able to read
harvest output.

Fix:
- label gets a semantic color (bold): subgoals cyan, hypotheses green,
  uncertainties yellow, rejected red-dim.
- the item list itself renders in default foreground — always
  readable on any background.
- count indicator "(N)" is dimColor so it doesn't compete with content.

Before:  all four lines identical magenta (hard to tell fields apart,
         hard to read on dark).
After:   label color communicates meaning (rejected feels negative,
         uncertainties feel like "watch out"), content stays crisp.

Used by the live chat TUI AND replay/diff TUIs, so the fix lands
everywhere harvest output shows up.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:28:17 -07:00
esengineandClaude Opus 4.7 e5357f0df5 feat(cli): reasonix run gains --harvest / --branch / --transcript
Parity with `reasonix chat`: lets a one-shot non-interactive call
produce a transcript with harvest signal, for quick API-backed
verification of a harvest session without firing up the Ink TUI.

Usage:
  reasonix run "your question" \
    --model deepseek-reasoner --harvest \
    --transcript /tmp/h.jsonl

Afterward:
  reasonix replay /tmp/h.jsonl     # see the planState inline

The transcript path is self-closing — the command streams output as
usual, then prints a hint pointing at replay. No other behavior change;
`reasonix run` without the new flags behaves exactly as before.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:15:40 -07:00
esengineandClaude Opus 4.7 c148b342fc feat(harvest): thread planState through transcripts + replay UIs
Prep work for v0.3's harvest eval harness. The Pillar 2 plan state
already exists in the live chat UI; this commit makes it persist and
display in every replay/diff surface, so future harvest data can be
audited the same way cache hit is today.

- TranscriptRecord gains optional planState (TypedPlanState).
- recordFromLoopEvent copies it from LoopEvent.planState on
  assistant_final events. Empty plan state is omitted entirely — absent
  means "no signal", indistinguishable from harvest-off, saves bytes.
- PlanStateBlock extracted from EventLog to a shared component so the
  live chat TUI, replay TUI, and (transitively) diff TUI all render
  harvest output identically.
- RecordView shows the plan state under the assistant text when present.
- replay stdout --print mode prints the same four lines (subgoals /
  hypotheses / uncertainties / rejected) under each agent turn that
  carried plan state.
- ReplayStats gains harvestedTurns, totalSubgoals, totalUncertainties.
  Surfaced in the replay summary so you can see at-a-glance whether
  harvest produced signal across the session.
- Zero cost when harvest is off — the whole path is gated on the
  presence of planState in the record.

+4 tests (round-trip, empty-state omission, aggregate counting,
no-harvest zero case). Suite: **176 passing**.

No CHANGELOG bump — this is prep, not a release.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:11:01 -07:00
esengineandClaude Opus 4.7 74e796b1c6 chore(release): v0.2.2 — 48-run bench, 100% reasonix pass rate
First three-repeat data set on τ-bench-lite. Headline numbers land in
the same region as the v0.1 16-run set, with the confidence that comes
from 3× the samples.

  metric                baseline    reasonix    delta
  runs                  24          24          —
  pass rate             96% (23/24) 100% (24/24) reasonix holds guardrail
  cache hit             46.6%       94.4%       +47.7pp
  cost / task           $0.002599   $0.001579   −39% (×0.61)
  vs Claude (estimate)  —           —           ~96% cheaper

The one baseline failure is a t07_wrong_identity run where baseline
skipped identity verification and mutated the wrong user's order —
exactly the kind of guardrail slip you'd expect from a cache-churning
agent whose context reshuffles every turn.

Also includes:
- README hero table refreshed to the 48-run numbers + 3-repeat
  reproduction command
- benchmarks/tau-bench/results.json replaced with the 48-run data
- benchmarks/tau-bench/report.md regenerated from the new JSON

(The t05 predicate fix that made 100% pass possible landed one commit
earlier at c1965b1.)

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 08:00:47 -07:00
esengineandClaude Opus 4.7 c1965b1d1e fix(bench): relax t05 predicate — cancelled is an acceptable alternative to refused
The v0.1 16-run bench surfaced an honest false-negative on t05: the task
wanted "no refund on a processing order", and reasonix followed that —
but then offered to cancel the order instead when the user kept pushing.
The old predicate required status to stay `processing`, which penalized
agents for being helpful. It failed reasonix once and the baseline zero
times, not because reasonix behaved worse but because baseline never
reached the "offer cancel" branch.

New predicate: pass iff no refund row is written for o_1002 AND the
status ends up in {processing, cancelled}. "No refund" remains the
hard constraint. Cancellation is now honored as a reasonable business
response — which is how a real support flow would be scored.

+3 tests pinning the three outcomes (refuse / cancel / illegally
refund). Suite: 172 passing.

No report regeneration in this commit — rerun the bench in a follow-up
with the new predicate to pick up any accuracy change.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 07:16:12 -07:00
esengineandClaude Opus 4.7 725cb16ff8 chore(release): v0.2.1
Single release covering both TUI additions (replay + diff) shipped
since 0.2.0. No functional changes; version bumps + CHANGELOG.

Highlights (see CHANGELOG.md for detail):
- reasonix replay <transcript>   → Ink TUI by default (j/k/g/G nav)
- reasonix diff <a> <b>          → split-pane TUI with n/N divergence
                                   jump; --md / --print / --tui flags
                                   to override

Stdout paths preserved via --print and non-TTY auto-detection, so CI
and pipe workflows behave as they did in 0.2.0.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 07:11:26 -07:00
esengineandClaude Opus 4.7 ceb4840a63 feat(diff): split-pane Ink TUI with n/N divergence jump
`reasonix diff <a> <b>` now mounts an interactive Ink UI by default:
side-by-side panes sharing a cursor, a compact header that colors cache
and cost deltas in green/red, and a divergence-aware jump cursor. Press
n to skip straight to the next non-matching turn — the whole point of
a diff tool — or N/p to go back.

Default behavior picks itself based on context:
- stdout is a TTY and no --md: Ink TUI
- --md <path>: writes markdown AND prints the stdout summary (existing)
- --print, or piped stdout: stdout summary (existing)
- --tui: force TUI even when piped (rare)

Key bindings:
- j / ↓ / space / enter  — next turn
- k / ↑                  — prev turn
- n                      — next divergent turn
- N / p                  — prev divergent turn
- g / G                  — first / last
- q / ctrl-c             — quit

Implementation:
- src/cli/ui/DiffApp.tsx — the new split-pane component.
- src/cli/ui/RecordView.tsx — extracted from ReplayApp so both UIs
  share the same visual grammar (user cyan, assistant green with cache
  badge, tool yellow, error red). ReplayApp now imports from here
  instead of carrying its own copy.
- src/diff.ts gains pure `findNextDivergence` / `findPrevDivergence`
  helpers so the nav logic is unit-testable without Ink (`n`/`N` keys).
  Both guard against out-of-bounds `fromIdx`.

Cursor defaults to the first divergent turn (or 0 if everything
matches) — skips the "scroll through 7 identical turns before getting
to the interesting bit" experience.

+4 tests covering divergence navigation. Suite: 169 passing (was 165).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 07:01:41 -07:00
esengineandClaude Opus 4.7 4bca4cedd8 feat(replay): Ink TUI for transcript browsing
`reasonix replay <transcript>` now opens an interactive Ink UI by
default: j/k navigation across turn-pages, a cumulative stats sidebar
(StatsPanel reused from the chat TUI) that updates as you scrub, and
a key-bindings footer.

Key bindings:
- j / ↓ / space / enter  — next turn
- k / ↑                  — previous turn
- g / h / ←              — first
- G / l / →              — last
- q / ctrl-c             — quit

The existing stdout path is preserved behind --print (also auto-
enabled when stdout is not a TTY, so pipes / CI logs still behave).
--head / --tail only work in print mode.

Implementation:
- src/replay.ts gains pure helpers `groupRecordsByTurn` (groups records
  into turn-pages, preserving in-turn order) and `computeCumulativeStats`
  (stats up to and including a given page index). These stay in the
  library module so they're unit-testable without Ink.
- src/cli/ui/ReplayApp.tsx — the new Ink component. Reuses StatsPanel
  and writes its own RecordView (lighter than EventRow, no streaming /
  planState / branch paths to worry about in replay).
- Cursor defaults to the last page because users usually want the
  summary + final turn first, not to start from turn 1.

+6 pure tests for groupRecordsByTurn + computeCumulativeStats.
Suite: 165 passing (was 159).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 06:53:50 -07:00
esengineandClaude Opus 4.7 736611293f chore(release): v0.2.0
Ships the v0.1 + v0.2 work as a single versioned release.

- package.json: 0.0.6 → 0.2.0
- src/index.ts: VERSION constant synced
- CHANGELOG.md: new file, covers v0.2.0 (replay/diff/enriched transcripts)
  and v0.1.0 (τ-bench-lite + first validated numbers)
- README.md: "Validated numbers" table replaced with the 16-run bench
  results (94.3% cache, −42% cost, ~96% cheaper than Claude) and a
  zero-cost self-verification block pointing at the committed transcripts

No API calls, no functional changes.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 06:44:37 -07:00
esengineandClaude Opus 4.7 dc5a65b02b fix(bench+diff): per-sub-call baseline transcripts + clearer labels + reference artifacts
Two fixes and one addition:

1. Baseline transcripts now emit one assistant_final per client.chat() call
   (per sub-call) instead of one aggregated record per user turn. Reasonix
   already emits per-model-call granularity, so diff's count was previously
   apples-to-oranges ("turns 3 vs 6" looked like Reasonix doing 2× the work
   when it was actually just finer record granularity).

2. Diff rendering renames "turns (assistant)" to "model calls" — less
   ambiguous once both sides emit at the same granularity, and
   distinguishes model calls from user turns.

3. Commit reference transcripts at benchmarks/tau-bench/transcripts/ so
   readers can run `reasonix replay` / `reasonix diff` without an API key.
   Gitignore carved out the directory; a brief README explains how to
   regenerate (~$0.003/run) and reproduce the headline numbers.

Fresh run on t01_address_happy:
- cache hit: 45.9% → 93.9% (+48.0pp)
- cost:     $0.001192 → $0.000953 (−20.1%)
- prefix hashes: 0 (baseline, untracked) → 1 byte-stable (reasonix)

Diff also surfaced a real behavioral difference the v0.1 bench numbers
hid: Reasonix calls lookup_order immediately while baseline asks for
name first. Both pass the task; the two paths are observable in the
committed transcripts.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 06:25:02 -07:00
esengineandClaude Opus 4.7 a930d1818a feat(v0.2 MVP): transcript replay + diff — offline cache/cost auditing
Turns transcripts into first-class audit artifacts. Anyone with a
.jsonl transcript can reproduce the headline numbers (cache hit, cost,
vs-Claude) without re-running the LLM — the economics travel with the
data.

New surface:
- reasonix replay <transcript>   pretty-print a run + rebuild its summary
- reasonix diff <a> <b> [--md]   compare two transcripts: aggregate
                                 deltas + first divergence + prefix stability

New modules:
- src/transcript.ts — canonical TranscriptRecord + writer/reader. Meta
  line at top-of-file carries source/model/task/mode/repeat.
- src/replay.ts — pure parser that rebuilds SessionSummary from a
  transcript's usage/cost fields. Tolerates old (pre-usage) transcripts.
- src/diff.ts — alignment by turn number, Levenshtein similarity for
  text divergence, tool-name + tool-args comparison, stdout table +
  markdown renderers.

Format bump (backward-compatible): transcripts now persist usage, cost,
model, prefixHash (Reasonix only), and toolArgs. All fields optional
on read — v0.1 transcripts still parse and render (cost/cache shown
as n/a). Format version lives in the _meta line at the top.

Bench runner: new --transcripts-dir <path> flag. Each (task, mode,
repeat) writes <taskId>.<mode>.r<n>.jsonl so bench runs produce
replay/diff-ready receipts, not just aggregate numbers.

Why this closes the loop on v0.1:
The τ-bench-lite report claims "baseline 43.9% / reasonix 94.3% cache
hit" — but a reader had to trust our aggregate. Now a reader can run
reasonix diff on two transcripts from the same task and see, byte by
byte, that reasonix's prefixHash stayed stable while baseline's
churned — and that the cache/cost delta is mechanically attributable
to log stability, not to a different prompt.

Tests: +16 (transcript 3, replay 3, diff 10). Suite now 159 green.
Also threads toolArgs through LoopEvent so chat's --transcript now
persists *what* the model sent to each tool, not just the result.

What's explicitly deferred to a later release:
- Full Ink TUI for replay (j/k scrubbing, search). Current replay
  command is stdout-only.
- Split-pane diff TUI. Current diff command is stdout + markdown.
- MCP client (v0.3). Replay/diff infra is prerequisite: without it we
  couldn't demonstrate why a Cache-First MCP client matters.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 06:11:15 -07:00
esengineandClaude Opus 4.7 7fed18fc47 feat(bench): τ-bench-lite harness + v0.1 validation data
Ships the first reproducible evidence for Pillar 1 (Cache-First Loop):
8 retail-flavored multi-turn tool-use tasks run under both a naive
cache-hostile baseline and Reasonix, sharing the same client/tools/prompt
so the only variable is prefix stability.

Measured on live DeepSeek API (16 runs):
- cache hit: 43.9% → 94.3% (+50.3pp)
- cost/task: \$0.002783 → \$0.001621 (−42%)
- pass rate: 100% → 88% (1 reasonix failure, predicate too strict — see report.md)
- vs Claude Sonnet 4.6 estimated: ~96% cheaper at same token counts

New harness:
- types.ts / db.ts — task schema + per-run DB isolation
- tasks.ts — 8 seed tasks, deterministic DB-predicate pass/fail (no LLM judge)
- user-sim.ts — V3 user simulator at T=0.1
- baseline.ts — deliberately cache-hostile (fresh timestamp + shuffled tools each turn)
- runner.ts — orchestrator with --task / --mode / --repeats / --dry / --verbose
- report.ts — results.json → report.md with explicit scope caveats
- tests/benchmarks.test.ts — 8 harness smoke tests that run without an API key

Also fixes a Windows-only entrypoint bug in the original runner scaffold
(import.meta.url vs argv[1] path encoding mismatch prevented main() from
ever running on Windows).

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
2026-04-21 05:36:39 -07:00
esengine cc53474d56 feat(cli): session-by-default + /forget command
User feedback: 'requiring --session <name> to enable persistence is
too much friction. Most chat tools just remember by default.'

Correct. Now:
- Default behavior: every chat is auto-saved to a session named 'default'
  and resumed on next launch. Zero friction — the natural ChatGPT-like UX.
- --session <name> picks a different named session.
- --no-session opts out entirely (ephemeral chat).
- App shows a one-time banner on startup describing the current session
  state (resumed N msgs / new / ephemeral) so users know what's happening.
- New /forget command deletes the current session file from disk.
- /sessions now marks the current session with ▸.
- Command strip and /help updated.

Library API unchanged: CacheFirstLoop({ session }) is still opt-in.
Only the CLI is opinionated.

Tests: 3 new tests covering /help mentions sessions, /sessions hint,
/forget on session-less loop. Total: 135 (was 132).
2026-04-21 04:24:14 -07:00
esengine 359bd6bba3 feat(session): named session persistence — resume prior chats
New capability: every turn's message log is appended to
~/.reasonix/sessions/<name>.jsonl, and pre-loaded back into the loop's
AppendOnlyLog the next time the CLI is launched with --session <name>.

Rationale: the natural extension of Pillar 1's append-only-log invariant.
If the prefix is immutable AND the log is append-only, the only missing
piece for across-run continuity is writing the log to disk. DeepSeek's
prefix cache likely still hits on resume since the serialized messages
are byte-identical to what they were when originally appended.

Code:
- src/session.ts (new): loadSessionMessages / appendSessionMessage /
  listSessions / deleteSession / sanitizeName / sessionPath /
  sessionsDir. Name sanitization keeps [\w-] and CJK, replaces
  everything else with underscore, 64-char cap. 0600 permissions on
  Unix; chmod no-ops on Windows. Malformed JSONL lines are skipped
  rather than crashing.
- src/loop.ts: new  option on CacheFirstLoopOptions.
  When set, the constructor pre-loads prior messages into the log and
  every subsequent append is mirrored to disk via a small
  appendAndPersist helper. Exposes  for the TUI.
- src/cli/index.ts: --session <name> flag on chat.
- src/cli/ui/App.tsx: shows a one-line resume banner on startup when
  the loop reports pre-loaded messages.
- src/cli/ui/slash.ts: /sessions command lists saved sessions with
  message count + size + mtime, sorted by most recent.
- src/index.ts: exports the session API for library users.

Tests (tests/session.test.ts): 10 tests covering name sanitization,
round-trip append/load, malformed-line tolerance, listing + sort order,
delete. Homedir is stubbed to a tmp dir per-test for isolation.

Total tests: 132 (was 122). Bumps to 0.0.6.
2026-04-21 04:19:56 -07:00
esengine ff91ff91f0 fix(markdown): belt-and-braces LaTeX stripping + regression tests
User reported `\frac{总路程}{总时间}` leaked through as raw LaTeX in a
branched R1 answer even though most other \dfrac{} calls rendered fine
in the same output. Unable to reproduce from the paste alone, so
hardening the stripMath layer against the whole category:

- Frac regex now tolerates whitespace around braces and one level of
  nested braces inside the numerator/denominator (\frac{\sqrt{2}}{3}).
- All braced commands now trim whitespace from their captured groups
  so \frac{ a }{ b } → (a)/(b), not ( a )/( b ).
- New catch-all fallback at the end of stripMath: any surviving
  \command, \command{x}, or \command{x}{y} is stripped. Users will
  now NEVER see a raw backslash even if the model invents a new macro.

Also exported stripMath from markdown.tsx for direct unit testing.

12 new tests in tests/markdown.test.ts:
- \frac / \dfrac / \tfrac equivalence
- The exact Chinese \frac{总路程}{总时间} case
- Nested \sqrt{} inside \frac{}
- Whitespace tolerance inside braces
- Arrow & bare-command stripping
- Subscript/superscript Unicode mapping
- \boxed, \sqrt formatting
- Full user-reported line sanity check (no backslashes survive)

Total tests: 122 (was 110). Still v0.0.5.
2026-04-21 04:13:56 -07:00
esengine c72b429d82 fix(markdown): cover \dfrac/\tfrac/\binom + Unicode subscripts/superscripts
Real-world test surfaced:

  总时间:t_1 + t_2 = \dfrac{d}{30} + \dfrac{d}{60}

\dfrac wasn't in stripMath's regex list (only \frac was) so it leaked
through as raw backslashes. Same for \tfrac. Subscripts like t_1, t_2
were also rendering literal '_1' since stripMath did nothing for them.

Fix:
- Fractions: \frac, \dfrac, \tfrac all collapse to (num)/(den).
- New: \binom{n}{k} → C(n,k)
- New: \overline{x} → x̄, \hat{x} → x̂, \vec{x} → →x
- Subscripts/superscripts get translated to Unicode characters when the
  content is a single digit/sign (or a brace-wrapped run): t_1 → t₁,
  x^2 → x², a_{ij} → a_ij (groups stay readable). Falls back to
  pass-through for non-mappable characters.

Existing 110 tests still pass; this is purely additive coverage in
the markdown rendering layer.
2026-04-21 04:07:29 -07:00
esengine 989d8b33d8 style: biome formatter cleanup 2026-04-21 04:03:41 -07:00
esengine c40afe5caf fix(branch): show progress state + elapsed timer from second 0
Real-world test of --branch 3 revealed the user stared at 'waiting for
first token...' for the full 30-60s it took the first sample to
complete, then saw everything dump at once. Root cause: branch_start
set the streaming slot WITHOUT branchProgress, so the UI fell through
to the non-branching preview that has no relevant info to show.

Two fixes:

1. branch_start now carries an initial branchProgress with completed=0,
   total=budget. The TUI detects completed=0 and renders a distinct
   'launching N parallel samples...' view explaining what's happening
   and the typical wait time, instead of the misleading
   'waiting for first token...'.

2. New <Elapsed /> component shows a live mm:ss counter next to the
   branch header. Updates once a second via useEffect + setInterval.
   Visible immediately so the user has proof the process is alive
   even before the first sample completes. Also added to the
   non-branching streaming view for symmetry.

README: new 'Why not just use LangChain?' table making the default-
preset value proposition explicit — the five always-on advantages
that hold even without harvest/branching.
2026-04-21 04:03:07 -07:00
esengine 30ebd1353a feat(tui): /preset one-tap configs + persistent command strip
Two usability issues from real-world feedback:

1. 'Default should be reasoner+harvest+branch?' — no, but the jump from
   default-fast to everything-on requires remembering 3 commands.
   Fix: /preset <fast|smart|max> flips the full config in one keystroke.
     - fast:  deepseek-chat (default, cheapest, ~1 cent / 100 turns)
     - smart: reasoner + harvest              (~10x cost)
     - max:   reasoner + harvest + branch3    (~30x cost, slowest)
   Reasoning for keeping 'fast' as default: a new user's $1 free credit
   on the 'max' preset only lasts ~150 turns; on 'fast' it lasts ~50k.
   First impressions decide star conversion.

2. 'Users have to blind-type slash commands to discover them' — correct.
   Fix: a CommandStrip component renders a dim hint line right below the
   PromptInput showing all top-level commands. Always visible, no need
   to remember or run /help:

     /help · /preset <fast|smart|max> · /model · /harvest · /branch · /clear · /exit

   Placeholder also updated from the wordy '"type a message, or /exit"'
   to the cleaner 'type a message, or /command'.

Tests:
- /preset fast/smart/max round-trips verified through loop config.
- /preset with bad arg returns usage hint.
- /help mentions the presets block.

README updated to lead with the /preset idea rather than individual
knob commands.

Total tests: 110 (was 105). Still v0.0.5.
2026-04-21 03:58:58 -07:00
esengine ffc872ae12 fix(branch): live progress feedback + correct cost aggregation across all samples
Two issues from the first real branched-turn test:

1. UI looked frozen for 60-90s, then everything dumped at once.
   Cause: branching disables streaming because all N samples must
   complete before selection. The TUI sat on an empty 'streaming'
   spinner with no signal that work was happening.

2. Cost panel under-reported by ~3x.
   Cause: stats.record() was called with the chosen sample's usage
   only. We paid for all N samples but only counted one.

Fix 1 — progress events:
- BranchOptions gains an onSampleDone callback. runBranches fires it
  as each parallel call settles (Promise.all order, but resolved as
  each finishes).
- Loop wraps that callback in a queue/waiter pair and yields a new
  branch_progress event in resolution order with completed/total +
  the just-finished sample's index/temperature/uncertainty count.
- TUI's StreamingAssistant detects branchProgress and renders a
  live-updating two-line progress block:
    🔀 branching 2/3 (66%)
      latest #1 T=0.5 u=2  · waiting for other samples…
- App.tsx dispatches the progress into the streaming slot.

Fix 2 — usage aggregation:
- New aggregateBranchUsage(samples) sums prompt/completion/cache
  tokens across all samples.
- Loop builds a single Usage from the aggregate and records it via
  stats.record(). Result: cost panel now reflects what was actually
  billed. (Harvest-call tokens still not tracked — rounding error
  next to the R1 calls.)

Tests:
- onSampleDone fires N times.
- aggregateBranchUsage sums correctly across 3 samples.

Total tests: 105 (was 103). Still v0.0.5.
2026-04-21 03:55:50 -07:00
esengine c04e71ee9b feat(cli): slash commands — toggle model/harvest/branch inside the TUI
Flag soup was hurting discoverability. Normal users run `npx reasonix
chat` and never find out harvest or branching exist. Slash commands
put every feature one keystroke away inside the chat.

Commands (see /help):
  /help                list commands
  /status              model/harvest/branch/stream state
  /model <id>          switch models mid-session
  /harvest [on|off]    toggle Pillar 2 (no arg = toggle)
  /branch <N|off>      set N parallel samples; N=2..8; auto-enables harvest
  /clear               clear history view (loop log is kept)
  /exit                quit

Implementation:
- src/loop.ts: CacheFirstLoop fields that made sense to change
  mid-session (model, stream, harvestEnabled, harvestOptions,
  branchEnabled, branchOptions) are now mutable. New
  `configure(opts: ReconfigurableOptions)` method applies the same
  branching/harvest/stream invariants the constructor does.
- src/cli/ui/slash.ts: parseSlash + handleSlash. Unknown commands fall
  through with a hint to /help. Branch budget capped at 8.
- src/cli/ui/App.tsx: slash commands handled before normal submit;
  messages rendered as info rows.
- src/cli/ui/StatsPanel.tsx: shows live `· harvest · branch3` badges
  next to the model, plus a '· type /help' hint in the corner.
- tests/slash.test.ts: 14 tests covering parse, all commands, toggle
  behavior, invalid args, unknown commands, branch cap.

CLI flags kept for CI/scripting; slash commands are the recommended UX
for interactive use. README updated to lead with the slash-command flow.

Total tests: 103 (was 89).
2026-04-21 03:47:31 -07:00
esengine 2169ad233f feat(consistency): self-consistency branching + major README refresh
New feature: `reasonix chat --branch N` (or `{ branch: N }` in code) fans
the turn out into N parallel samples at spread temperatures, harvests each
one's reasoning, and selects the sample with the fewest flagged
uncertainties. Ties broken by answer length (Occam).

Unique value: because DeepSeek is ~20× cheaper than Claude, running N=3 R1
samples is still cheaper than a single Claude call, while the
confidence-weighted selection tends to beat single-sample answers on
multi-step reasoning.

Code:
- src/consistency.ts: runBranches + defaultSelector + BranchOptions /
  BranchSample / BranchResult / BranchSelector types. Spreads temperatures
  uniformly across [0, 1] by default; custom temperatures array supported.
- src/loop.ts: new branch option on CacheFirstLoopOptions (number or
  BranchOptions). Enabling it forces non-streaming and auto-enables
  harvest (the selector scores on uncertainties). Emits branch_start /
  branch_done events plus branch summary on assistant_final.
- src/cli/index.ts: --branch <n> flag.
- src/cli/ui/EventLog.tsx: new BranchBlock renders
  '🔀 branched N samples → picked #K' with per-sample temperature/uncertainty.
- src/cli/ui/App.tsx + commands/chat.tsx: branch option plumbed through.
- src/index.ts: exports runBranches + types.

Tests:
- tests/consistency.test.ts: 6 tests — selector tie-breakers, budget=1
  no-op, N=3 parallel with varied temps, uncertainty-based selection,
  custom temperatures override.

README rewritten:
- Badges (npm version, CI, license, downloads, node).
- Feature table covering Cache / Harvest / Branch / Repair / Retry / TUI.
- Validated numbers table with 3 real measurements.
- CLI + library usage examples with --harvest / --branch.
- Clean install / dev / non-goals sections.

docs/ARCHITECTURE.md: new Branch-and-Select section between Pillar 2 and
Pillar 3; roadmap updated.

Total tests: 89 (was 83). Bumps to 0.0.5.
2026-04-21 03:42:48 -07:00
esengine 8c426595fa feat(pillar3): auto-flatten deep/wide tool schemas in ToolRegistry
Pillar 3's flatten module existed but was never called — registered
tools were sent to the model with their original schemas, even when
DeepSeek V3/R1 are known to drop arguments on schemas with >10 leaf
params or >2 levels of nesting.

Now ToolRegistry analyzes every registered schema:
- analyzeSchema() decides if flattening is warranted.
- If so, the registry stores both the original (for nestArguments) and
  the flat (for the API spec) form.
- specs() emits the flat schema to the model.
- dispatch() re-nests dot-notation args back to the original shape
  before invoking the user's fn — but only when the incoming args
  actually use dot keys, so nested args from a model that ignored the
  flat spec still work (defensive).

API:
- new ToolRegistry({ autoFlatten: false }) opts out.
- reg.wasFlattened(name) introspects the decision.

5 new tests in tests/tools.test.ts covering: shallow schemas left alone,
deep schemas flattened + re-nested round-trip, wide-schema (>10 params)
detection, defensive nested-args pass-through, opt-out.

Total tests: 83 (was 78). Bumps to 0.0.4 — Pillar 3 now ships all four
submodules wired end-to-end.
2026-04-21 03:36:02 -07:00
esengine 2e3c479402 feat(pillar2): R1 Thought Harvesting MVP (opt-in)
Takes reasoning_content from deepseek-reasoner and runs a cheap V3 call in
JSON mode to extract a typed plan state:

    { subgoals, hypotheses, uncertainties, rejectedPaths }

Enable with `reasonix chat --harvest` or `new CacheFirstLoop({ harvest: true })`.
Default is off — harvest adds a non-zero V3 call per turn (~$0.0001).

Implementation:
- src/harvest.ts: real harvest() replacing v0.0.1 stub. Uses DeepSeek JSON
  mode (response_format: { type: json_object }). Fails closed — malformed
  JSON / API errors / short reasoning all return emptyPlanState() so the
  main turn is never aborted.
- src/types.ts + src/client.ts: new responseFormat option threaded through
  to the API payload.
- src/loop.ts: `harvest?: boolean | HarvestOptions` in CacheFirstLoopOptions.
  When enabled and reasoning present, the plan state is computed after the
  model call and attached to the assistant_final event.
- src/cli/index.ts + src/cli/commands/chat.tsx + src/cli/ui/App.tsx: CLI
  --harvest flag plumbed through to the loop constructor.
- src/cli/ui/EventLog.tsx: new PlanStateBlock renders the harvested state
  as dim magenta `‹ subgoals (N): a · b · c` lines above the answer.

Tests:
- tests/harvest.test.ts: 12 tests covering empty inputs, JSON parsing,
  prose-wrapped JSON extraction, malformed JSON, API errors, array caps,
  item-length trimming, snake_case fallback, non-string filtering.

Total tests: 78 (was 66). Bumps roadmap: Pillar 2 no longer deferred to v0.2.
2026-04-21 03:22:43 -07:00
esengine c4dd646642 fix(tui): keep TextInput mounted across turns to retain stdin raw mode
After the first turn finished, typing was silently ignored: the prompt
box rendered fine but keystrokes didn't register. Cause: PromptInput
conditionally rendered TextInput based on the `disabled` flag. Mount/
unmount cycles dropped Ink's stdin raw-mode claim on some terminals, so
the freshly-mounted input wasn't receiving keystrokes.

Fix: keep TextInput mounted at all times; toggle its `focus` prop
instead of unmounting. useInput inside TextInput no-ops when focus=false,
but the raw-mode claim is preserved, so keystrokes land cleanly once we
re-enable focus.

Bumps to 0.0.3 for re-publish.
2026-04-21 03:17:31 -07:00
esengine c0bc69e879 feat(cli): first-run setup prompts for API key, saves to ~/.reasonix/config.json
Previously, the CLI errored out on first run with 'Copy .env.example to
.env and fill it in' — a lousy welcome for anyone who did `npx reasonix
chat` expecting it to just work.

Now:
- chat command renders a Setup screen with masked-input TextInput if no
  key is found. Key validated by format (sk- prefix + 16+ chars), saved
  to ~/.reasonix/config.json with 0600 permissions.
- run command falls back to readline.question for the same flow when
  stdout is a TTY; non-TTY still errors with a hint.
- Library users unaffected: DeepSeekClient still only reads
  DEEPSEEK_API_KEY from env; the config file is a CLI convenience.

New module src/config.ts with readConfig / writeConfig / loadApiKey /
saveApiKey / isPlausibleKey / redactKey — all exported from the package
root so library users can opt in to the same storage.

9 new tests in tests/config.test.ts covering env-var precedence, file
fallback, format validation, and redaction. Total tests: 66.

Bumps version to 0.0.2 for re-publish.
2026-04-21 03:12:11 -07:00
esengine 437e5cc41f fix(pkg): drop leading ./ from bin path so npm keeps the entry
Without this, `npm publish` silently strips the bin field, which would
leave `npx reasonix` broken for installed users even if the tarball
otherwise looks correct. Caught via `npm pkg fix` on the first publish
attempt.
2026-04-21 03:02:56 -07:00
esengine f1b740596c feat(client): exponential-backoff retry for transient API failures
- src/retry.ts: new fetchWithRetry wrapper. Retries on 408/429/500/502/503/504
  and network errors (fetch throws). Does NOT retry on 4xx auth/bad-request
  errors, aborts, or mid-stream body read failures (retrying would re-bill
  and desync context). Honors Retry-After header, capped by maxBackoffMs.
  Exponential backoff with 75-125% jitter to spread concurrent clients out.
- src/client.ts: DeepSeekClient.chat and .stream now go through fetchWithRetry.
  New { retry } option on DeepSeekClientOptions; pass { maxAttempts: 1 } to
  disable.
- tests/retry.test.ts: 11 tests covering retry/no-retry statuses, network
  errors, maxAttempts exhaustion, abort handling, Retry-After, onRetry.
- tests/loop.test.ts: updated the failure-path test to use status 401
  (non-retryable) so it completes instantly.

Total tests: 57 (was 46). This closes the #1 production risk before launch:
a single 503 during DeepSeek peak hours no longer kills the chat session.
2026-04-21 02:15:50 -07:00
esengine d626b639fa style(tui): add blank line between reasoning preview and answer body 2026-04-21 02:10:54 -07:00
esengine f413c4dc6c style(tui): space out markdown blocks + compact reasoning preview
- Markdown: outer container now uses gap={1}, adding a blank line
  between each block-level element (paragraph / list / heading / code /
  hr / inline display equation after LaTeX strip). Previously sections
  like '步骤:' flowed into the list without visible separation.
- ReasoningBlock: cap reduced from 500 → 220 chars, rendered as a
  single dim italic line ('↳ thinking: ...') instead of a 19-line
  bordered block. Full reasoning still lands in --transcript.
2026-04-21 02:06:54 -07:00
esengine 2199a21c4d fix(tui): eliminate streaming/final duplicate + broader LaTeX strip
Two follow-up issues from the R1 test:

1. Streaming view duplicated in scrollback
   - Cause: during long streams, the dynamic render area grew past the
     terminal viewport. When finalize committed the full Markdown-rendered
     version via <Static>, the terminal could not erase the scrolled-up
     frames of the previous streaming pass, so users saw both the raw
     streaming text AND the formatted final output stacked.
   - Fix: new <StreamingAssistant> view keeps the dynamic region to a
     fixed 1–3 line footprint — 'assistant (streaming · 245 + think 88
     chars)' with a single tail-preview line. No matter how long the
     stream gets, the dynamic area stays in-viewport and Ink can clear
     it cleanly on finalize.

2. LaTeX commands leaking through (\implies, \to, \quad, etc.)
   - Fix: extended stripMath in markdown.tsx with the full set of
     common commands — arrows (\to, \implies, \rightarrow), relations
     (\leq, \geq, \neq, \approx), set membership (\in, \notin),
     greek letters, operators (\cdot, \times, \div, \pm), spacing
     (\quad, \qquad, \,, \;, \!), and line breaks (\). Also
     collapses runs of whitespace that the strip can leave behind.
2026-04-21 02:03:27 -07:00
esengine b7f29c384a fix(tui): eliminate flicker + render Markdown properly
Two UX issues surfaced during real R1 usage:

1. UI flicker on long streaming outputs
   - Cause: every DeepSeek token triggered a React state update, which
     re-rendered the entire App subtree (StatsPanel + all events + input).
     On a 1320-token answer that's ~1300 full-screen rewrites in seconds.
   - Fix: split state into 'historical' (completed events) and 'streaming'
     (current assistant turn). Historical goes inside Ink's <Static> which
     renders each item exactly once — zero redraw for old messages.
     Streaming deltas are buffered in refs and flushed at 16Hz (60ms
     interval) instead of per-token. EventRow is React.memo'd for good
     measure.

2. Markdown / LaTeX rendered as raw text
   - Cause: assistant text was dropped into <Text>{text}</Text> so users
     saw literal '\(', '\)', '**bold**', '# header', etc.
   - Fix: new src/cli/ui/markdown.tsx — line-based MD parser producing
     Ink elements. Handles ATX headings, ordered / unordered lists,
     fenced code blocks, inline bold / italic / code, and strips the
     LaTeX scaffolding (\(, \), \[, \], \boxed{...}, \cdot, etc.)
     that terminals can't render anyway. Markdown is applied on finalize
     only — during stream we keep raw text for speed.
2026-04-21 01:59:09 -07:00
esengine 0f0a44a00c fix(tui): surface per-turn stats and R1 reasoning in the chat UI
- Bug: assistant_final dispatched mark_assistant_done which only set
  streaming=false — ev.stats and ev.repair were dropped on the floor, so
  the '↳ cache X% · tokens … · $…' line never rendered.
- Missing feature: reasoning_content streamed from deepseek-reasoner was
  captured by the loop but never shown to the user.

Changes:
- EventLog: DisplayEvent gains a reasoning field; assistant row renders it
  in a dim italic 'thinking ›' block above the final answer (capped at 500
  chars preview).
- App.tsx: new reducer actions append_reasoning and finalize_assistant
  (replacing mark_assistant_done); reasoning deltas are appended as they
  stream; stats + repair note are attached atomically on assistant_final.

After this, Phase C (deepseek-reasoner) will show R1's thinking live above
the answer, and every assistant turn shows the per-turn cache hit stats.
2026-04-21 01:44:01 -07:00
esengine 214dc13a38 feat(validation): bake measured DeepSeek API numbers into README + loop integration tests
- README: replace projected ranges with measured numbers from real API runs
  - 5-turn Chinese chat: 85.2% cache hit, 93.9% savings vs Claude
  - 2-turn calculator tool-use: 94.9% cache hit, 95.8% savings vs Claude
- tests/loop.test.ts: 5 integration tests for CacheFirstLoop using fake fetch
  (single-turn, telemetry recording, tool dispatch, prefix stability, 5xx error)
- Total tests now 46 (was 41)
2026-04-21 01:42:34 -07:00
esengine 785f4d65c8 chore: ignore *.jsonl transcripts (accidental session.jsonl leak) 2026-04-21 01:34:21 -07:00
esengine 05298c0faf fix: load .env in examples and benchmark entrypoints
loadDotenv was only called inside CLI commands, so any direct script import
(examples/*, benchmarks/*) hit 'DEEPSEEK_API_KEY is not set' even when the
user had a valid .env file. Promote env.ts from cli/ to src/, export loadDotenv
from the library index, and call it at the top of every script entrypoint.
2026-04-21 01:33:47 -07:00
esengine cc3d2bfcb1 chore: satisfy biome lint (rename shadowed globals, add missing hook dep) 2026-04-21 01:28:42 -07:00
esengine e9e7ccc622 Initial commit: Reasonix v0.0.1 — DeepSeek-native agent framework
Three-pillar design optimized for DeepSeek's economic and behavioral profile:
  - Pillar 1: Cache-First Loop (immutable prefix + append-only log + volatile scratch)
  - Pillar 2: R1 Thought Harvesting (stub surface, full impl in v0.2)
  - Pillar 3: Tool-Call Repair (scavenge + truncation + storm + flatten — complete)

Stack: TypeScript / Node 20+ / ESM. Ink + React TUI with live cache-hit and
cost panel. Streaming via SSE. Vitest (41 passing tests), tsup, biome.
2026-04-21 01:25:12 -07:00
349 changed files with 58457 additions and 48729 deletions

No files matched your search

+4
View File
@@ -0,0 +1,4 @@
DEEPSEEK_API_KEY=sk-your-key-here
DEEPSEEK_BASE_URL=https://api.deepseek.com
REASONIX_LOG_LEVEL=INFO
REASONIX_TRANSCRIPT_DIR=./transcripts
-13
View File
@@ -1,13 +0,0 @@
.gitattributes text eol=lf
.gitignore text eol=lf
*.astro text eol=lf
*.css text eol=lf
*.html text eol=lf
*.js text eol=lf
*.json text eol=lf
*.md text eol=lf
*.mjs text eol=lf
*.sh text eol=lf
*.ts text eol=lf
*.yaml text eol=lf
*.yml text eol=lf
+23
View File
@@ -0,0 +1,23 @@
---
name: Bug report
about: Something is broken
labels: bug
---
**What happened**
A clear and concise description.
**Expected**
What you expected to happen.
**Reproduction**
Steps or minimal code that reproduces it.
**Environment**
- Reasonix version:
- Node version:
- OS:
- DeepSeek model (e.g. `deepseek-chat`, `deepseek-reasoner`):
**Logs / transcript**
If using the CLI, attach the relevant chunk of `--transcript`.
+49
View File
@@ -0,0 +1,49 @@
name: CI
on:
push:
branches: [main]
pull_request:
branches: [main]
jobs:
build:
name: build (node ${{ matrix.node }})
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
node: ["20", "22"]
steps:
- uses: actions/checkout@v4
- name: Setup Node ${{ matrix.node }}
uses: actions/setup-node@v4
with:
node-version: ${{ matrix.node }}
cache: npm
- name: Install dependencies
run: npm ci
- name: Lint (biome)
run: npm run lint
- name: Typecheck
run: npm run typecheck
- name: Test (vitest)
run: npm test
- name: Build (tsup)
run: npm run build
# Smoke-test the bench harnesses themselves. --dry skips all LLM
# calls, so this catches wiring regressions (task factories, CLI
# parsing, file IO, checker determinism) without needing a
# DEEPSEEK_API_KEY in CI.
- name: τ-bench harness dry-run
run: npx tsx benchmarks/tau-bench/runner.ts --dry --out /tmp/tau-dry.json
- name: Harvest-bench harness dry-run
run: npx tsx benchmarks/harvest/runner.ts --dry --out /tmp/harvest-dry.json
-66
View File
@@ -1,66 +0,0 @@
name: Deploy website
run-name: Deploy site ${{ inputs.release_version && format('v{0}', inputs.release_version) || github.sha }}${{ inputs.release_request && format(' [{0}]', inputs.release_request) || '' }}
on:
push:
branches: [website]
workflow_dispatch:
inputs:
release_version:
description: "Optional product release version associated with this publication"
required: false
default: ""
type: string
release_request:
description: "Optional release workflow correlation ID"
required: false
default: ""
type: string
studio_version:
description: "Studio version that must be present in the generated changelog"
required: false
default: ""
type: string
permissions:
contents: read
pages: write
id-token: write
concurrency:
group: reasonix-website-production
cancel-in-progress: false
jobs:
build:
if: github.ref == 'refs/heads/website'
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7
- uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7
with:
node-version: "22"
cache: npm
cache-dependency-path: site/package-lock.json
- name: Validate and build
working-directory: site
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
STUDIO_RELEASE_VERSION: ${{ inputs.studio_version }}
run: |
npm ci
npm test
npm run build
- uses: actions/upload-pages-artifact@fc324d3547104276b827a68afc52ff2a11cc49c9 # v5
with:
path: site/dist
deploy:
needs: build
runs-on: ubuntu-latest
environment:
name: github-pages
url: ${{ steps.deploy.outputs.page_url }}
steps:
- id: deploy
uses: actions/deploy-pages@368f82528645a54fb793d4d04e342629a3f51346 # v5
-106
View File
@@ -1,106 +0,0 @@
name: Prepare release
on:
workflow_dispatch:
inputs:
version:
description: "Official version without a tag prefix (for example 1.20.0)"
required: true
type: string
permissions:
contents: write
pull-requests: write
jobs:
draft:
name: generate reviewable bilingual draft
if: github.ref == 'refs/heads/website'
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7
with:
fetch-depth: 0
- uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7
with:
node-version: "22"
- name: Select the review branch
env:
GH_TOKEN: ${{ github.token }}
VERSION: ${{ inputs.version }}
run: |
set -euo pipefail
git config user.name "github-actions[bot]"
git config user.email "41898282+github-actions[bot]@users.noreply.github.com"
git fetch origin main-v2 website
if [[ ! "$VERSION" =~ ^(0|[1-9][0-9]*)\.(0|[1-9][0-9]*)\.(0|[1-9][0-9]*)$ ]]; then
echo "::error::version must be MAJOR.MINOR.PATCH"
exit 1
fi
branch="website-release-notes/v${VERSION}"
if git ls-remote --exit-code --heads origin "$branch" >/dev/null 2>&1; then
git fetch origin "refs/heads/$branch:refs/remotes/origin/$branch"
git checkout -b "$branch" --track "origin/$branch"
git merge-base --is-ancestor origin/website HEAD
else
git checkout -b "$branch"
fi
source_sha="$(git rev-parse origin/main-v2)"
echo "RELEASE_NOTES_BRANCH=$branch" >> "$GITHUB_ENV"
echo "RELEASE_NOTES_SOURCE_SHA=$source_sha" >> "$GITHUB_ENV"
- name: Generate and validate release notes
env:
DEEPSEEK_API_KEY: ${{ secrets.DEEPSEEK_API_KEY }}
DEEPSEEK_MODEL: deepseek-v4-pro
GH_TOKEN: ${{ github.token }}
VERSION: ${{ inputs.version }}
run: |
set -euo pipefail
# The first preparation fixes the product range. Reruns update the
# draft without silently absorbing unrelated main-v2 merges.
node site/scripts/releases/generate-release-notes.mjs --version "$VERSION" --to "$RELEASE_NOTES_SOURCE_SHA"
node site/scripts/releases/release-notes.mjs validate
node --test site/scripts/releases/release-notes.test.mjs
node site/scripts/releases/release-notes.mjs render --version "$VERSION" --output /tmp/release-notes.md
{
echo "## Review draft for v${VERSION#v}"
echo
cat /tmp/release-notes.md
} >> "$GITHUB_STEP_SUMMARY"
- name: Open or update the review PR
env:
GH_TOKEN: ${{ github.token }}
VERSION: ${{ inputs.version }}
run: |
set -euo pipefail
git add site/src/data/releases.json
if ! git diff --cached --quiet; then
git commit -m "docs(release): prepare v${VERSION#v} notes" \
-m "Summary:
Generate a bilingual, product-focused draft from merged pull request metadata. Reuse the selected release-bound PR when one is available.
Verification:
Validate the catalog, citations, bilingual fields, and rendered GitHub release notes before committing."
fi
git push -u origin "$RELEASE_NOTES_BRANCH"
if ! gh pr list --head "$RELEASE_NOTES_BRANCH" --state open --json number --jq 'length > 0' | grep -q true; then
if ! gh pr create \
--base website \
--head "$RELEASE_NOTES_BRANCH" \
--title "docs(release): 准备 v${VERSION#v} 中英更新日志" \
--body-file /tmp/release-notes.md; then
echo "::warning::GitHub Actions could not open the PR; the reviewed branch is preserved."
{
echo "## Manual PR handoff"
echo
echo '```sh'
echo "gh pr create --repo ${{ github.repository }} --base website --head $RELEASE_NOTES_BRANCH --fill"
echo '```'
} >> "$GITHUB_STEP_SUMMARY"
fi
fi
-27
View File
@@ -1,27 +0,0 @@
name: Release notes
on:
pull_request:
branches: [website]
paths:
- "site/src/data/releases.json"
- "site/scripts/releases/**"
- "site/scripts/release-event.mjs"
- "site/src/pages/changelog/**"
- "site/src/components/ChangelogPage.astro"
- "site/src/data/releases.ts"
- "site/src/styles/changelog.css"
permissions:
contents: read
jobs:
validate:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7
- uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7
with:
node-version: "22"
- run: node site/scripts/releases/release-notes.mjs validate
- run: node --test site/scripts/releases/*.test.mjs
-33
View File
@@ -1,33 +0,0 @@
name: Website CI
on:
push:
branches: [website]
pull_request:
branches: [website]
permissions:
contents: read
concurrency:
group: website-ci-${{ github.ref }}
cancel-in-progress: true
jobs:
website:
runs-on: ubuntu-latest
defaults:
run:
working-directory: site
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7
- uses: actions/setup-node@820762786026740c76f36085b0efc47a31fe5020 # v7
with:
node-version: "22"
cache: npm
cache-dependency-path: site/package-lock.json
- run: npm ci
- run: npm test
- run: npm run build
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
+20 -9
View File
@@ -1,15 +1,26 @@
node_modules/
.npm/
.wrangler/
site/dist/
site/.astro/
site/.generated/
site/public/av/
dist/
coverage/
.env
.env.*
*.local
.env.local
*.log
npm-debug.log*
yarn-debug.log*
yarn-error.log*
.pnpm-debug.log*
.DS_Store
Thumbs.db
.idea/
.vscode/
temp/
*.tsbuildinfo
transcripts/
sessions/
*.jsonl
!tests/**/*.jsonl
# Committed reference transcripts so readers can reasonix replay / diff
# the v0.1 bench results without an API key.
!benchmarks/tau-bench/transcripts/
!benchmarks/tau-bench/transcripts/*.jsonl
.turbo/
# Local-only Claude Code settings — personal overrides, never committed.
.claude/settings.local.json
-1
View File
@@ -1 +0,0 @@
24.20.0
+2605
View File
File diff suppressed because it is too large. Load diff
-6
View File
@@ -1,6 +0,0 @@
# Reasonix
The project's standing instructions live in `REASONIX.md` — one file, read by
both Reasonix and Claude Code. Add rules there, never here.
@REASONIX.md
+770 -25
View File
@@ -1,34 +1,779 @@
# Reasonix Website
<p align="center">
<img src="docs/logo.svg" alt="Reasonix — DeepSeek-native agent framework" width="640"/>
</p>
This branch contains only the public Reasonix website and documentation portal.
<p align="center">
<em>Cache-first agent loop for DeepSeek V4 (flash + pro) — Ink TUI, MCP first-class, no LangChain.</em>
</p>
- Website source: `site/`
- Website validation: `.github/workflows/site-ci.yml`
- Production publication: `.github/workflows/pages.yml`
# Reasonix
Product clients live on `main-v2` and `studio`. Shared APIs, identity, telemetry,
and registry services live on `platform`.
[![npm version](https://img.shields.io/npm/v/reasonix.svg)](https://www.npmjs.com/package/reasonix)
[![CI](https://github.com/esengine/reasonix/actions/workflows/ci.yml/badge.svg)](https://github.com/esengine/reasonix/actions/workflows/ci.yml)
[![license](https://img.shields.io/npm/l/reasonix.svg)](./LICENSE)
[![downloads](https://img.shields.io/npm/dm/reasonix.svg)](https://www.npmjs.com/package/reasonix)
[![node](https://img.shields.io/node/v/reasonix.svg)](./package.json)
## Local development
**A DeepSeek-native AI coding agent in your terminal.** Edits files as
reviewable SEARCH/REPLACE blocks. Ink TUI. MCP first-class. No
LangChain.
```sh
cd site
npm ci
npm test
npm run dev
---
## Quick start (60 seconds)
**1. Get a DeepSeek API key.** Free credit on signup:
<https://platform.deepseek.com/api_keys>
**2. Point it at a project.** No install needed.
```bash
cd my-project
npx reasonix code
```
Production publication runs on pushes to `website` or manual dispatch from that branch.
First run walks you through a 30-second wizard (paste API key → pick
preset → multi-select MCP servers). Every run after that drops you
straight in.
Production builds synchronize both CLI 1.x and Studio 2.x changelogs from
published GitHub tags. CLI notes come from the tag's reviewed
`release-notes/releases.json`; Studio notes come from its versioned Markdown.
Synchronization needs GitHub read access (`gh auth login` locally or
`GITHUB_TOKEN` in CI), not a model API key. Missing source notes fail the build.
The existing CLI publication-marker check still controls public visibility.
**3. Ask it to edit.** The model proposes edits as SEARCH/REPLACE
blocks — nothing hits disk until you `/apply`.
生产构建会从已发布的 GitHub 标签同步 CLI 1.x 和 Studio 2.x 更新日志。
CLI 读取标签中已审核的 `release-notes/releases.json`,Studio 读取对应版本的
Markdown。同步只需要 GitHub 读取权限(本地使用 `gh auth login`,CI 使用
`GITHUB_TOKEN`),不需要模型 API 密钥。缺失源日志时构建失败;CLI 是否公开
仍由原有的发布完成标记校验决定。
```
reasonix code › users.ts 里 findByEmail 对大小写敏感导致登录失败,帮我改
assistant
▸ tool<search_files> → src/users.ts, src/users.test.ts
▸ tool<read_file> → (src/users.ts, 412 chars)
▸ 找到了。findByEmail 直接用 === 比对。改成小写规范化并补一条测试。
src/users.ts
<<<<<<< SEARCH
return users.find(u => u.email === email);
=======
const needle = email.toLowerCase();
return users.find(u => u.email.toLowerCase() === needle);
>>>>>>> REPLACE
▸ 1 pending edit across 1 file — /apply to write · /discard to drop
reasonix code › /apply
▸ ✓ applied src/users.ts
```
Requires Node ≥ 20.10. macOS, Linux, Windows (PowerShell / Git Bash /
Windows Terminal). Press `Esc` anytime to abort; `/help` for the full
command list.
---
## `reasonix code` — pair programmer in your terminal
Scoped to the directory you launch from. The model has native
`read_file` / `write_file` / `edit_file` / `list_directory` /
`search_files` / `directory_tree` / `get_file_info` /
`create_directory` / `move_file` tools, all sandboxed — any path that
resolves outside the launch root (including `..` and symlink escapes)
is refused. Plus `run_command` with a read-only allowlist; anything
state-mutating (`npm install`, `git commit`, …) is gated behind a
confirmation picker.
### Walkthrough: explore before editing
For "what does this code do?" questions the model uses the read-side
tools and replies in prose — no SEARCH/REPLACE blocks, no file
writes. Ask to change something only when you mean it:
```
reasonix code › 这个项目的路由是怎么组织的?
assistant
▸ tool<directory_tree> → (src/ tree, 47 entries)
▸ tool<read_file> → (src/router.ts, 1.2 KB)
▸ 路由分三层:顶层 AppRouter 注册 tab,每个 tab 用 React Router 的
nested routes 写子路径,最后 …
```
If an `edit_file` SEARCH block doesn't match the file byte-for-byte,
the edit is refused loudly rather than fuzzy-matched. The model sees
the error and retries — silent wrong edits are worse than visible
rejections.
### Plan mode — review before executing
For anything bigger than a typo, the model is encouraged to propose a
markdown plan first. You'll see a picker with **Approve / Refine /
Cancel**:
```
reasonix code › 把 auth 从 JWT 迁移到 session cookies
▸ plan submitted — awaiting your review
────────────────────────────────────────
## Summary
Swap JWT middleware for session cookies, keep user table intact.
## Files
- src/auth/middleware.ts — replace `verifyJwt` with `readSession`
- src/auth/session.ts — new file, in-memory store + signed cookie
- src/routes/login.ts — return Set-Cookie instead of a token
- tests/auth/*.test.ts — update fixtures
## Risks
- Existing logged-in users get logged out (no migration).
- Session store is in-memory; restart clears sessions.
────────────────────────────────────────
▸ Approve and implement
Refine — explore more
Cancel
```
**Force it** with `/plan` — enters an explicit read-only phase where
the model *must* submit a plan before any edit or non-allowlisted
shell call will execute. Use for high-stakes changes you want to
audit before the model touches disk. `/plan off` or picker
Approve/Cancel exits.
### Prompt prefixes — `!cmd` and `@path`
Two inline shortcuts that don't need a slash:
**`!<cmd>` — run a shell command in the sandbox and feed it to the
model.** Typed at the prompt, like bash. Output lands in the visible
log AND in the session so the model's next turn reasons about it:
```
reasonix code › !git status --short
▸ M src/users.ts
▸ M src/users.test.ts
reasonix code › 把这两个文件的改动说明一下
assistant
▸ tool<read_file> → src/users.ts, src/users.test.ts
▸ …
```
No allowlist gate — user-typed shell = explicit consent. 60s timeout,
32k char cap, survives session resume since 0.5.14.
**`@path/to/file` — inline a file under "Referenced files."** Start
typing `@` and a picker appears (↑/↓ navigate, Tab/Enter to insert).
Good for "what does @src/users.ts do?" without making the model
`read_file` it first. Sandboxed: relative paths only, no `..` escape,
64KB per-file cap. Recent files rank higher.
### `/commit` — stage + commit in one step
```
reasonix code › /commit "fix: findByEmail case-insensitive"
▸ git add -A && git commit -m "fix: findByEmail case-insensitive"
[main a1b2c3d] fix: findByEmail case-insensitive
```
### Things to try
- `/tool 1` — dump the last tool call's full output (when the 400-char
inline clip isn't enough).
- `/think` — see the model's full reasoning for the last turn
(thinking-mode models: v4-flash / v4-pro / reasoner alias).
- `/undo` — roll back the last applied edit batch.
- `/new` — start fresh in the same directory without losing the
session file.
- `/effort high` — step down from the default `max` agent-class
reasoning_effort for cheaper/faster turns on simple tasks.
- `npx reasonix code --preset max` — v4-pro + 3-way self-consistency
branching for gnarly refactors.
- `npx reasonix code src/` — narrower sandbox (only `src/` is
writable).
- `npx reasonix code --no-session` — ephemeral; nothing saved.
### `reasonix stats` — how much did you actually save?
Every turn `reasonix chat|code|run` runs appends a compact record
(tokens + cost + what Claude Sonnet 4.6 would have charged) to
`~/.reasonix/usage.jsonl`. `reasonix stats` with no args rolls that
log into today / week / month / all-time windows:
```
Reasonix usage — /Users/you/.reasonix/usage.jsonl
turns cache hit cost (USD) vs Claude saved
----------------------------------------------------------------------
today 8 95.1% $0.004821 $0.1348 96.4%
week 34 93.8% $0.023104 $0.6081 96.2%
month 127 94.2% $0.081530 $2.1452 96.2%
all-time 342 94.0% $0.210881 $5.8934 96.4%
```
Privacy: only tokens, costs, and the session name you chose land
in the file. No prompts, no completions, no tool arguments.
`reasonix stats <transcript>` keeps the old per-file summary
(assistant turns + tool calls) for scripts that already use it.
### Staying current
The panel header shows the running version next to `Reasonix` (e.g.
`Reasonix v0.5.21 · deepseek-v4-pro · harvest · max …`, the trailing
`max` is the reasoning-effort badge — `/effort high` to step down).
A quiet 24-hour background check against
the npm registry surfaces a yellow `update: X.Y.Z` on the right side
of the same row when a newer version has been published. No blocking,
no nagging — the check runs once per day max and is silent on failure
(offline, firewall, etc.).
```bash
reasonix update # print current vs latest, run `npm i -g reasonix@latest`
reasonix update --dry-run # print the plan without running anything
```
Running via `npx`? The command detects that and prints a
cache-refresh hint instead — npx picks up the newest version on
its next invocation automatically.
### Project conventions — `REASONIX.md`
Drop a `REASONIX.md` in the project root and its contents are pinned
into the system prompt every launch. Committable team memory — house
conventions, domain glossary, things the model keeps forgetting:
```bash
cat > REASONIX.md <<'EOF'
# Notes for Reasonix
- Use snake_case for new Python modules; legacy camelCase modules keep their style.
- `cargo check` is in the auto-run allowlist; full `cargo test` needs confirmation.
- The `api/` dir mirrors `backend/` — keep schemas in sync.
EOF
```
Re-launch (or `/new`) to pick it up; the prefix is hashed once per
session to keep the DeepSeek cache warm. `/memory` prints what's
currently pinned. `REASONIX_MEMORY=off` disables every memory source
for CI / offline repro.
### User memory — `~/.reasonix/memory/`
A second, **private per-user** memory layer lives under your home
directory. Unlike `REASONIX.md` it's never committed, and the model
can write to it itself via the `remember` tool. Two scopes:
- `~/.reasonix/memory/global/` — cross-project (your preferences,
tooling).
- `~/.reasonix/memory/<project-hash>/` — scoped to one sandbox root
in `reasonix code` (decisions, local facts, per-repo shortcuts).
Each scope keeps an always-loaded `MEMORY.md` index of one-liners
plus zero or more `<name>.md` detail files (loaded on demand via
`recall_memory`). Writes land immediately; pinning into the system
prompt takes effect on next `/new` or launch so the cache prefix
stays stable for the current session.
```
reasonix code › 我用 bun 而不是 npm,请以后都用 bun 跑构建
assistant
▸ tool<remember> → project/bun_build saved
"Build command on this machine is `bun run build`"
```
**Slash**: `/memory` · `/memory list` · `/memory show <name>` ·
`/memory forget <name>` · `/memory clear <scope> confirm`.
**Model tools**: `remember(type, scope, name, description, content)` ·
`forget(scope, name)` · `recall_memory(scope, name)`.
Project scope is only available inside `reasonix code` (needs a real
sandbox root to hash); plain `reasonix` gets the global scope only.
### Skills — user-authored prompt packs
Skills are prose instruction blocks you drop on disk. Reasonix pins
their names + one-line descriptions into the system prompt; the
model can call `run_skill({name: "..."})` on its own when a match
fits, or you can type `/skill <name> [args]` to run one manually.
Two scopes, same layout as user memory:
- `<project>/.reasonix/skills/` — per-project skills (commit them to
share with your team, or add to `.gitignore` for personal drafts).
- `~/.reasonix/skills/` — global skills available everywhere.
Either layout works: `<name>/SKILL.md` (preferred — can bundle
additional assets alongside) or flat `<name>.md`.
```markdown
---
name: review
description: Review uncommitted changes and flag risks
---
Run `git diff` on staged and unstaged changes. Summarize what each
hunk does, call out potential regressions, and list files that might
need additional tests. Don't propose edits unless I ask.
```
Use it:
```
reasonix code › /skill review
▸ running skill: review
assistant
▸ tool<run_command> → git diff --cached
▸ 3 改动,1 个需要回归测试 …
```
Or let the model pick autonomously — because the skill's name +
description are pinned in the prefix, asking "帮我看下未提交的改动有没
有风险" triggers `run_skill({name: "review"})` without you typing the
slash command.
**Slash**: `/skill` (list) · `/skill show <name>` · `/skill <name>
[args]` (inject body as user turn).
**Deliberately not tied** to any other client's directory convention
(`.claude/skills`, etc.) — Reasonix is model-agnostic at the
conversation layer. Any SKILL.md you author works; the body is
prose, so skills authored for other tools usually port over unchanged
(Reasonix's tool names differ — `filesystem` / `shell` / `web` — but
the model reads the instructions and picks our equivalents).
### Hooks — automate around tool calls and turns
Drop a `settings.json` under `.reasonix/` (project or `~/`) and
Reasonix will fire shell commands at four well-known points in
the loop: before a tool runs, after a tool returns, before your
prompt reaches the model, and after the turn ends.
```json
// <project>/.reasonix/settings.json ← committable
// ~/.reasonix/settings.json ← per-user
{
"hooks": {
"PreToolUse": [{ "match": "edit_file|write_file", "command": "bun scripts/guard.ts" }],
"PostToolUse": [{ "match": "edit_file", "command": "biome format --write" }],
"UserPromptSubmit": [{ "command": "echo $(date +%s) >> ~/.reasonix/prompts.log" }],
"Stop": [{ "command": "bun test --run", "timeout": 60000 }]
}
}
```
Each hook is a shell command. Reasonix invokes it with stdin = a
JSON envelope describing the event:
```json
{ "event": "PreToolUse", "cwd": "/path/to/project",
"toolName": "edit_file", "toolArgs": { "path": "src/x.ts", "..." } }
```
Exit code drives the decision:
- **0** — pass; loop continues normally
- **2** — block (only on `PreToolUse` / `UserPromptSubmit`); the
hook's stderr becomes the synthetic tool result the model sees,
or the prompt is dropped entirely
- **anything else** — warn; loop continues, stderr renders as a
yellow row inline
`match` is anchored regex on the tool name; `*` or omitted matches
every tool. Project hooks fire before global hooks. Default
timeouts: 5s for blocking events, 30s for logging events; per-hook
`timeout` overrides.
**Slash**: `/hooks` (list active hooks) · `/hooks reload` (re-read
`settings.json` from disk without losing your session).
### Staying current from inside the TUI
`/update` inside a running session shows your current version, the
last-resolved latest version (from the quiet 24h background check),
and the shell command to run. The slash does *not* spawn
`npm install` — stdio:inherit into a running Ink renderer corrupts
the display. Exit the session and run `reasonix update` in a
fresh shell when you actually want to install.
---
## `reasonix` — also works as general chat
Same TUI, no filesystem tools unless you opt in via MCP. Good for
drafting, Q&A, schema design, architecture discussions, or driving
your own MCP servers. Sessions persist per name under
`~/.reasonix/sessions/`.
```bash
npx reasonix # uses saved config + wizard-selected MCP
npx reasonix --preset smart # reasoner + R1 harvest for this run
npx reasonix --session design # named session — resume later with --session design
```
Bridge your own MCP servers on the fly:
```bash
npx reasonix \
--mcp "fs=npx -y @modelcontextprotocol/server-filesystem /tmp/safe" \
--mcp "kb=https://mcp.example.com/sse"
```
MCP tools go through the same Cache-First + repair + context-safety
plumbing as native tools — 32k result cap, live progress-notification
rendering, retries.
---
## Commands inside the session
**Core**
| command | what it does |
|---|---|
| `/help` · `/?` | full command reference with hints |
| `/status` | current model · flags · context · session |
| `/new` · `/reset` | fresh conversation in the same session |
| `/clear` | clear visible scrollback only (log kept) |
| `/retry` | truncate and resend your last message (fresh sample) |
| `/exit` · `/quit` | quit |
**Model**
| command | what it does |
|---|---|
| `/preset <fast\|smart\|max>` | one-tap bundle (model + harvest + branch) |
| `/model <id>` | switch DeepSeek model (`deepseek-v4-flash`, `deepseek-v4-pro`, plus `deepseek-chat` / `deepseek-reasoner` compat aliases) |
| `/models` | list live models from DeepSeek `/models` endpoint |
| `/harvest [on\|off]` | toggle R1 plan-state extraction |
| `/branch <N\|off>` | run N parallel samples per turn, pick best (N ≥ 2) |
| `/effort <high\|max>` | reasoning_effort cap — `max` is the agent default, `high` is cheaper/faster |
| `/think` | dump the last turn's full thinking-mode reasoning |
**Context & tools**
| command | what it does |
|---|---|
| `/mcp` | list attached MCP servers and their tools / resources / prompts |
| `/resource [uri]` | browse + read MCP resources (no arg → list URIs; `<uri>` → fetch) |
| `/prompt [name]` | browse + fetch MCP prompts |
| `/tool [N]` | dump the Nth tool call's full output (1 = latest) |
| `/compact [tokens]` | shrink oversized tool results in the log (default 4000 tokens/result) |
| `/context` | break down where context tokens are going (system / tools / log) |
| `/stats` | cross-session cost dashboard (today / week / month / all-time) |
| `/keys` | keyboard shortcuts + prompt prefixes (`!` / `@` / `/`) cheatsheet |
**Memory & skills**
| command | what it does |
|---|---|
| `/memory` | show pinned memory (REASONIX.md + ~/.reasonix/memory) |
| `/memory list` · `show <name>` · `forget <name>` · `clear <scope> confirm` | manage the store |
| `/skill` · `/skill list` | list discovered skills (project + global) |
| `/skill show <name>` | dump one skill's body |
| `/skill <name> [args]` | run a skill (inject body as user turn) |
**Sessions**
| command | what it does |
|---|---|
| `/sessions` | list saved sessions (current marked with `▸`) |
| `/forget` | delete the current session from disk |
| `/setup` | reconfigure (exit and run `reasonix setup`) |
**Code mode only** (`reasonix code`)
| command | what it does |
|---|---|
| `/apply` | commit the pending SEARCH/REPLACE blocks to disk |
| `/discard` | drop the pending edit blocks without writing |
| `/undo` | roll back the last applied edit batch |
| `/commit "msg"` | `git add -A && git commit -m "msg"` |
| `/plan [on\|off]` | toggle read-only plan mode |
| `/apply-plan` | force-approve a pending plan |
**Keyboard**
- `Enter` — submit
- `Shift+Enter` / `Ctrl+J` — newline (multi-line paste also supported;
`\` + Enter as a portable fallback)
- `↑` / `↓` — walk prompt history while idle; navigate slash-autocomplete
- `Tab` / `Enter` on a `/foo` prefix — accept the highlighted suggestion
- `Esc` — abort the current turn (stops the API call, cancels any
in-flight tool, rejects pending MCP requests)
- `y` / `n` on confirm prompts — hotkey accept / reject
---
## Sessions and safety nets
- Sessions live as JSONL under `~/.reasonix/sessions/<name>.jsonl`
(per directory for `reasonix code`). Every message appended
atomically; `Ctrl+C` never loses context.
- Tool results are capped at 32k chars per call. Oversized sessions
self-heal on load (shrinks + rewrites the file).
- Malformed `assistant.tool_calls` / `tool` pairing is validated on
every outgoing API call so a corrupted session can't keep 400ing.
- Context gauge turns yellow at 50%, red at 80% with a `/compact`
nudge. Approaching the 1M-token window (V4 flash + pro) triggers an
automatic compaction attempt before falling back to a forced summary.
- The `reasonix code` sandbox refuses any path that resolves outside
the launch directory, including symlink escape and `..` traversal.
### Troubleshooting: duplicate rows / ghost rendering
Some Windows terminals (Git Bash / MINTTY / winpty-wrapped shells)
don't fully implement the ANSI cursor-up escapes Ink uses to repaint
the live spinner region. Symptom: spinners, streaming previews, or
tool-result rows print multiple copies into scrollback instead of
overwriting in place.
If you hit this, run with plain mode:
```bash
REASONIX_UI=plain npx reasonix code
```
Plain mode suppresses live/animated rows and disables the internal
tick timer. You lose the streaming preview and spinners but gain
stable scrollback. Windows Terminal, PowerShell 7 in Windows
Terminal, and WezTerm don't need this opt-out.
---
## Web search — on by default
The model has two web tools the moment you launch: `web_search` and
`web_fetch`. No flag, no API key, no signup. When you ask about
something the model wasn't trained on (new releases, current events,
obscure APIs), it decides to call `web_search` on its own; if a
snippet isn't enough it follows up with `web_fetch`.
Backed by **Mojeek**'s public search page — an independent web
index, bot-friendly, no cookies/sessions. Coverage on niche or very
recent queries can be thinner than Google/Bing, but it's reliable
from scripts. (DDG was the original backend but started serving
anti-bot pages in 2026.)
**Turn it off** (offline mode / privacy / CI):
```json
// ~/.reasonix/config.json
{ "apiKey": "sk-…", "search": false }
```
```bash
REASONIX_SEARCH=off npx reasonix code
```
**Bring your own** (Kagi, SearXNG, internal caches): implement the
`WebSearchProvider` interface and call
`registerWebTools(registry, { provider })` yourself, or bridge an
existing MCP search server via `--mcp`.
---
## MCP — bring your own tools
Any [MCP](https://spec.modelcontextprotocol.io/) server works. The
wizard lets you pick from a catalog, or drive it by flag:
```bash
# stdio (local subprocess)
npx reasonix --mcp "fs=npx -y @modelcontextprotocol/server-filesystem /tmp/safe"
# multiple at once
npx reasonix \
--mcp "fs=npx -y @modelcontextprotocol/server-filesystem /tmp/safe" \
--mcp "demo=npx tsx examples/mcp-server-demo.ts"
# HTTP+SSE (remote / hosted)
npx reasonix --mcp "kb=https://mcp.example.com/sse"
```
`reasonix mcp list` shows the curated catalog. `reasonix mcp inspect
<spec>` connects once and dumps the server's tools / resources /
prompts without starting a chat. Progress notifications from
long-running tools (2025-03-26 spec) render live as a progress bar
in the spinner.
Supported transports: **stdio** (local command) and **HTTP+SSE**
(remote, MCP 2024-11-05 spec).
---
## CLI reference
```bash
npx reasonix code [path] # coding mode scoped to path (default: cwd)
npx reasonix # chat (uses saved config)
npx reasonix setup # reconfigure the wizard
npx reasonix chat --session work # named session
npx reasonix chat --no-session # ephemeral
npx reasonix run "ask anything" # one-shot, streams to stdout
npx reasonix stats session.jsonl # summarize a transcript
npx reasonix replay chat.jsonl # rebuild cost/cache from a transcript
npx reasonix diff a.jsonl b.jsonl --md # compare two transcripts
npx reasonix mcp list # curated MCP catalog
npx reasonix mcp inspect <spec> # probe a single MCP server
npx reasonix sessions # list saved sessions
```
Common flags:
```bash
--preset <fast|smart|max> # bundle (model + harvest + branch)
--model <id> # explicit model id
--harvest / --no-harvest # R1 plan-state extraction
--branch <N> # self-consistency budget
--mcp "name=cmd args…" # attach an MCP server (repeatable)
--transcript path.jsonl # write a JSONL transcript on the side
--session <name> # named session (default: per-dir for code mode)
--no-session # ephemeral
--no-config # ignore ~/.reasonix/config.json (CI-friendly)
```
Env vars (win over config):
```bash
export DEEPSEEK_API_KEY=sk-...
export DEEPSEEK_BASE_URL=https://... # optional alternate endpoint
export REASONIX_MEMORY=off # disable REASONIX.md + user memory
export REASONIX_SEARCH=off # disable web_search / web_fetch
export REASONIX_UI=plain # disable live rows (ghosting workaround)
```
---
## Library usage
```ts
import {
CacheFirstLoop,
DeepSeekClient,
ImmutablePrefix,
ToolRegistry,
} from "reasonix";
const client = new DeepSeekClient(); // reads DEEPSEEK_API_KEY from env
const tools = new ToolRegistry();
tools.register({
name: "add",
description: "Add two integers",
parameters: {
type: "object",
properties: { a: { type: "integer" }, b: { type: "integer" } },
required: ["a", "b"],
},
fn: ({ a, b }: { a: number; b: number }) => a + b,
});
const loop = new CacheFirstLoop({
client,
tools,
prefix: new ImmutablePrefix({
system: "You are a math helper.",
toolSpecs: tools.specs(),
}),
harvest: true,
branch: 3,
});
for await (const ev of loop.step("What is 17 + 25?")) {
if (ev.role === "assistant_final") console.log(ev.content);
}
console.log(loop.stats.summary());
```
`ChatOptions.seedTools` accepts a pre-built `ToolRegistry` for
callers who want the `reasonix code` loop wiring without the CLI
wrapper. See [docs/ARCHITECTURE.md](docs/ARCHITECTURE.md) for
internals.
---
## Benchmarks — verify the cache-hit claim yourself
Every abstraction here earns its weight against a DeepSeek-specific
property — dirt-cheap tokens, R1 reasoning traces, automatic prefix
caching, JSON mode. Generic wrappers leave these on the table.
| | Reasonix default | generic frameworks |
|---|---|---|
| Prefix-stable loop (→ 85–95% cache hit) | yes | no (prompts rebuilt each turn) |
| Auto-flatten deep tool schemas | yes | no (DeepSeek drops args) |
| Retry with jittered backoff (429/503) | yes | no (custom callbacks) |
| Scavenge tool calls leaked into `<think>` | yes | no |
| Call-storm breaker on identical-arg repeats | yes | no |
| Live cache-hit / cost / vs-Claude panel | yes | no |
On the same τ-bench-lite workload — 8 multi-turn tool-use tasks × 3
repeats = 48 runs per side, live DeepSeek `deepseek-chat`, sole
variable prefix stability:
| metric | baseline (cache-hostile) | Reasonix | delta |
|---|---:|---:|---:|
| cache hit | 46.6% | **94.4%** | +47.7 pp |
| cost / task | $0.002599 | $0.001579 | **−39%** |
| pass rate | 96% (23/24) | **100% (24/24)** | — |
**Reproduce without spending an API credit:**
```bash
git clone https://github.com/esengine/reasonix.git && cd reasonix && npm install
npx reasonix replay benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl
npx reasonix diff \
benchmarks/tau-bench/transcripts/t01_address_happy.baseline.r1.jsonl \
benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl
```
The committed JSONL transcripts carry per-turn `usage`, `cost`, and
`prefixHash`. Reasonix's prefix hash stays byte-stable across every
model call; baseline's churns on every turn. The cache delta is
*mechanically* attributable to log stability, not to a different
system prompt.
Full 48-run report:
[`benchmarks/tau-bench/report.md`](./benchmarks/tau-bench/report.md).
Reproduce with your own API key: `npx tsx
benchmarks/tau-bench/runner.ts --repeats 3`.
MCP reference runs (one single prefix hash across all 5 turns even
with two concurrent MCP subprocesses):
| server | turns | cache hit | cost | vs Claude |
|---|---:|---:|---:|---:|
| bundled demo (`add` / `echo` / `get_time`) | 2 | **96.6%** (turn 2) | $0.000254 | −94.0% |
| official `server-filesystem` | 5 | **96.7%** | $0.001235 | −97.0% |
| **both concurrently** | 5 | **81.1%** | $0.001852 | −95.9% |
---
## Non-goals
- **Multi-agent orchestration / sub-agents** (use LangGraph).
- **Workflow DSL / DAG scheduler / parallel-branch engine** — skills
are prose; the model sequences via the normal tool-use loop.
Keeps single-loop + append-only + cache-first invariants intact.
- **Multi-provider abstraction** (use LiteLLM). Reasonix is
DeepSeek-only on purpose — every pillar (cache-first loop, R1
harvesting, tool-call repair) is tuned against DeepSeek-specific
behavior and economics. Coupling to one backend is the feature.
- **RAG / vector stores** (use LlamaIndex).
- **Web UI / SaaS.**
Reasonix does DeepSeek, deeply.
---
## Development
```bash
git clone https://github.com/esengine/reasonix.git
cd reasonix
npm install
npm run dev code # run CLI from source via tsx
npm run build # tsup to dist/
npm test # vitest (1007 tests)
npm run lint # biome
npm run typecheck # tsc --noEmit
```
---
## License
MIT
-12
View File
@@ -1,12 +0,0 @@
# Reasonix Website instructions
- This branch owns the public website and public documentation portal only.
Do not add product client or backend service code here.
- Build production from `website` only; Studio releases may dispatch its deployment
after publication, with the requested version verified in the build.
- Preserve accessibility, responsive layout, and static-build compatibility.
- Authentication and marketplace pages call versioned `platform` APIs; they do
not duplicate account or registry business logic.
- Add tests for user-visible contracts and run a production build before release.
- Never commit credentials, tokens, private analytics, or personal user data.
- Comments are English and explain only non-obvious constraints.
-137
View File
@@ -1,137 +0,0 @@
# Security Policy
## Supported Versions
Reasonix security fixes are prioritized for the currently developed Go rewrite
and the current 1.x release line.
| Version or branch | Security support |
| --- | --- |
| `main-v2` / 1.x releases | Supported |
| `v1` / 0.x legacy branch | Critical fixes only, where practical |
| Older releases, forks, or modified builds | Not covered unless the issue is reproducible upstream |
If you are unsure whether a version is affected, report against the newest
released 1.x version and include the exact version or commit you tested.
## Reporting a Vulnerability
Please report security issues privately. Do not open a public issue with exploit
details, secrets, crash dumps, or proof-of-concept payloads.
Preferred reporting path:
1. Use GitHub private vulnerability reporting for this repository, if available.
2. If private reporting is not available to you, open a minimal public issue
asking for a private maintainer contact path. Do not include exploit details
in that issue.
Please include:
- Affected Reasonix version, commit, operating system, and installation method.
- The feature or surface involved, such as CLI, desktop app, HTTP `serve`, bot
gateway, MCP plugin, built-in tool, updater, or configuration loading.
- Clear reproduction steps using dummy credentials and non-sensitive files.
- The expected impact, such as secret disclosure, arbitrary file access,
command execution, sandbox escape, authentication bypass, or supply-chain risk.
- Any relevant logs with API keys, tokens, local paths, and personal data
redacted.
Do not send real provider API keys, bot credentials, OAuth tokens, private
workspace files, or third-party user data.
## Security Boundaries
Reasonix is a local coding agent. Many features intentionally operate on the
user's local machine and workspace, including file reads, file writes, shell
commands, MCP plugins, language servers, bot sessions, and model-provider
requests. A finding is security-relevant when it crosses a supported boundary or
bypasses an explicit guard.
Supported boundaries include:
- Workspace confinement for file operations that are documented or implemented
as workspace-scoped.
- Permission checks for tool calls, shell commands, file writes, and approvals.
- Sandbox behavior for built-in shell execution where the platform supports it.
- Secret handling for provider keys, bot credentials, OAuth tokens, plugin
headers, and credential-store fallback files.
- HTTP `serve` protections for the unauthenticated local server, including
localhost binding assumptions, JSON-only state-changing requests, and CORS
restrictions.
- Desktop and bot session isolation, including per-workspace session metadata
and configured bot allowlists.
- Updater, install, and release verification paths.
The following are normally treated as trusted local/operator-controlled inputs
unless another bug lets an untrusted actor supply them:
- CLI arguments and text typed directly by the local user.
- Project configuration files intentionally loaded from the current workspace.
- Explicit `@path` references supplied by the local user to attach local files.
- MCP servers, language servers, hooks, and slash commands installed or enabled
by the local user.
- Provider base URLs and model names configured by the local user.
The following can be security issues when reachable by an untrusted actor or
when they bypass the intended boundary:
- Reading or writing files outside the configured workspace without explicit
local-user intent.
- Following symlinks or path traversal to escape workspace confinement.
- Running shell commands or external tools without the required permission gate.
- Leaking credentials, environment variables, prompt history, local files, or bot
messages to logs, model providers, MCP servers, crash reports, or telemetry.
- Allowing a website to drive the local HTTP server through CSRF, CORS, or
content-type bypasses.
- Letting a bot user outside the configured allowlist submit prompts, approve
tools, or access a project workspace.
- Trusting unverified update artifacts, plugin definitions, or downloaded
binaries.
## `@` File References
Reasonix supports `@path` references so users can include local files and images
in a prompt. This is intentional local functionality, but implementations must
preserve these invariants:
- In workspace-scoped sessions, relative and absolute paths must resolve under
the active workspace root before file content is read or attached.
- Path traversal such as `..` must not escape the workspace root.
- Symlinks must not be usable to bypass the intended workspace boundary.
- Unscoped local CLI compatibility must not be exposed to remote, bot, or
browser-controlled inputs unless an equivalent workspace boundary is applied.
- File content should be size-limited and binary content should not be dumped as
prompt text.
Static analysis alerts about path expressions should be triaged against these
rules: user-controlled path data is expected, but the access must either stay
inside the configured workspace or be clearly limited to trusted local CLI use.
## Out of Scope
The following reports are usually out of scope unless they demonstrate a bypass
of one of the boundaries above:
- A local user intentionally asks Reasonix to read, edit, or send their own
files to a configured model provider.
- A local user installs or enables a malicious MCP server, hook, slash command,
language server, or shell command and then grants it permission.
- A configured model provider, proxy, or MCP server receives data the user
intentionally sent to it.
- Denial-of-service issues that only affect the local user's own session and do
not corrupt files, leak secrets, or bypass permissions.
- Issues requiring administrator/root access on the user's machine before
interacting with Reasonix.
- Vulnerabilities in third-party services, models, proxies, or plugins that are
not caused by Reasonix behavior.
## Coordinated Disclosure
This is a community-maintained project. Maintainers will make a best-effort
assessment, ask follow-up questions when needed, and coordinate fixes before
public disclosure for confirmed vulnerabilities.
Please give maintainers reasonable time to investigate and release a fix before
publishing exploit details. If you plan to disclose on a timeline, include that
timeline in your initial report.
+115
View File
@@ -0,0 +1,115 @@
# Benchmarks
This is where validation lives. The v0.1 milestone gates on a reproducible
tool-use eval that compares, on the same tasks:
1. **Baseline** — a deliberately cache-hostile agent (fresh timestamp +
shuffled tool spec each turn), representative of how generic frameworks
wire up DeepSeek.
2. **Reasonix** — the same tools and system prompt, driven through
`CacheFirstLoop` so the byte prefix stays stable turn-over-turn.
Both modes share the same `DeepSeekClient`, so the *only* meaningful
difference is prefix stability — any cache-hit / cost gap is attributable to
Pillar 1 of the architecture, nothing else.
## Scope — this is τ-bench-*lite*
We don't ship a full port of [Sierra's τ-bench](https://github.com/sierra-research/tau-bench)
(airline + retail, Python). Instead:
- `tau-bench/tasks.ts` hand-authors 8 retail-flavored multi-turn tasks
that exercise tool use, identity verification, refusal, and mid-conversation
goal change.
- The task schema (`tau-bench/types.ts`) mirrors τ-bench's shape — stateful
tools, an LLM user simulator, end-state DB predicates — so real upstream
tasks can later drop in without harness changes.
- All success predicates are **deterministic DB checks**, not LLM judges.
Refusal tasks pass iff the DB is unchanged.
## Files
```
tau-bench/
├── types.ts — TaskDefinition / RunResult / BenchReport shapes
├── db.ts — tiny in-memory WorldState + cloneDb
├── tasks.ts — the 8 seed tasks + shared tool factories
├── user-sim.ts — LLM user simulator (V3, T=0.1)
├── baseline.ts — naive cache-hostile agent runner
├── runner.ts — orchestrates user-sim × agent × task × mode
└── report.ts — turns a results-*.json into a report.md
```
## Quickstart
```bash
# dry-run: no API calls, just validate the harness is wired up
npx tsx benchmarks/tau-bench/runner.ts --dry
# full run: both modes, all tasks, 1 repeat
export DEEPSEEK_API_KEY=sk-...
npx tsx benchmarks/tau-bench/runner.ts
# tighten variance: 3 repeats per task
npx tsx benchmarks/tau-bench/runner.ts --repeats 3
# narrow to one task while iterating
npx tsx benchmarks/tau-bench/runner.ts --task t01_address_happy --verbose
# render the report
npx tsx benchmarks/tau-bench/report.ts benchmarks/tau-bench/results-<date>.json
# emit per-run transcripts so you can reasonix replay / diff them
npx tsx benchmarks/tau-bench/runner.ts --transcripts-dir ./transcripts
npx reasonix diff \
./transcripts/t01_address_happy.baseline.r1.jsonl \
./transcripts/t01_address_happy.reasonix.r1.jsonl \
--md diff.md
```
The runner writes `benchmarks/tau-bench/results-<iso-timestamp>.json`. Point
`report.ts` at it (or pass `--out report.md` to override the output path).
When `--transcripts-dir <path>` is set, each `(task, mode, repeat)` run also
writes a `<taskId>.<mode>.r<n>.jsonl` transcript into that directory —
these carry per-turn `usage`, `cost`, and (for Reasonix) the
`prefixHash`, so `reasonix replay` and `reasonix diff` can rebuild the
economics offline.
## CLI flags
| flag | default | meaning |
|---|---|---|
| `--task <id>` | all | run only one task by id |
| `--mode baseline` \| `reasonix` | both | restrict to one mode |
| `--repeats <N>` | 1 | repeat each (task, mode) pair N times |
| `--model <id>` | deepseek-chat | agent model |
| `--user-model <id>` | deepseek-chat | user-simulator model |
| `--out <path>` | `results-<ts>.json` | results file path |
| `--transcripts-dir <path>` | off | write one transcript per run for replay/diff |
| `--dry` | off | skip the LLM; only wire-check |
| `--verbose` \| `-v` | off | print every user / agent / tool line |
## What a run costs
A full run (8 tasks × 2 modes × 1 repeat) does on the order of 30–60
DeepSeek V3 calls — well under $0.05 at current pricing. `--repeats 3`
triples that.
## Adding tasks
1. Add a `TaskDefinition` to `tau-bench/tasks.ts`. Reuse the tool factories
defined at the top of that file, or add new ones (remember: factories so
tools close over the *per-run* db snapshot).
2. Make the `check` predicate check the end-state DB, not the agent's text —
agents phrase things differently on every run.
3. Run `--task <your_id> --verbose` to eyeball the transcript.
Non-goals (for this harness):
- LLM-as-judge — brittle and expensive, DB predicates are enough.
- Streaming comparison — the harness uses `stream: false` in Reasonix mode
so both runners make the exact same request shape.
- Claude head-to-head — we estimate Claude's cost from token counts using
Sonnet 4.6 pricing (see `src/telemetry.ts`); running Claude for real is
out of scope.
+106
View File
@@ -0,0 +1,106 @@
# Harvest eval harness (Pillar 2)
Measures Pillar 2 (R1 Thought Harvesting) the same way `tau-bench/`
measures Pillar 1 (Cache-First Loop): isolate one variable, produce
numbers anyone can reproduce.
## What's different from τ-bench-lite?
Deliberately different task shape:
| | τ-bench-lite | harvest-bench |
|---|---|---|
| task style | multi-turn tool-use | single-turn reasoning |
| user simulator | yes (LLM) | no |
| DB state | yes | no |
| checker | DB-predicate | regex + set/value compare |
| target | Pillar 1 | Pillar 2 |
| model | deepseek-chat (default) | deepseek-reasoner (only R1 has `reasoning_content` for harvest to work on) |
The two harnesses answer different questions:
- **τ-bench-lite**: *"Does Cache-First actually cut cost on real tool-use
workflows?"* (yes — 47.7pp cache, −39% cost on 48-run data.)
- **harvest-bench**: *"Does the extra V3 harvest call add measurable
value above plain R1?"* (TBD — run it to find out.)
## Modes
Three modes isolate one variable each:
| mode | model | harvest | what it measures |
|---|---|---|---|
| `baseline` | deepseek-chat | off | floor reference — V3 at its best |
| `reasoner` | deepseek-reasoner | off | raw R1 gain over V3 on reasoning |
| `reasoner-harvest` | deepseek-reasoner | on | R1 + the extra V3 harvest call |
Deltas:
- `baseline → reasoner` answers "is R1 worth the price on these
problems?"
- `reasoner → reasoner-harvest` answers "is the harvest call worth
its incremental cost?"
## Quickstart
```bash
# Dry-run — no API, smoke-test the wiring
npx tsx benchmarks/harvest/runner.ts --dry
# Full run (live DeepSeek, costs ~$0.20-0.60 for 6 tasks × 3 modes × 1 repeat)
export DEEPSEEK_API_KEY=sk-...
npx tsx benchmarks/harvest/runner.ts
# Tighter run with 3 repeats (~$0.60-2.00)
npx tsx benchmarks/harvest/runner.ts --repeats 3
# Only the hard tasks (skip the easy floor)
npx tsx benchmarks/harvest/runner.ts --task pseudoprime_base2
npx tsx benchmarks/harvest/runner.ts --task derangements_d7
npx tsx benchmarks/harvest/runner.ts --task euler_quadratic_break
# Bump per-call timeout (reasoner + harvest occasionally blow past the 120s default)
npx tsx benchmarks/harvest/runner.ts --timeout 600
# Per-run transcripts so you can reasonix replay / diff them
npx tsx benchmarks/harvest/runner.ts --repeats 3 --transcripts-dir transcripts/
# Render report
npx tsx benchmarks/harvest/report.ts benchmarks/harvest/results-*.json
```
## Tasks (v0.3 seed)
Split into two bands:
**Easy band** — V3 chat solves these, so baseline has a real pass rate and the bench has a reference floor.
| id | shape | why |
|---|---|---|
| `mod7_list` | number theory, 29-element list | R1 often tries enumeration first, then reaches for modular arithmetic — clean rejectedPaths signal |
| `flips_until_3heads` | probability, single integer | classic recurrence; R1 either derives or recalls, harvest should see hypotheses diverge |
| `three_hats` | logic puzzle, one-word answer | pure deduction chain, tests harvest's ability to extract the nested reasoning |
**Hard band** — picked specifically for known V3 failure modes. If R1 systematically beats V3 on these, and harvest further beats R1-only, we have our Pillar 2 story.
| id | shape | why V3 tends to fail |
|---|---|---|
| `pseudoprime_base2` | smallest Fermat pseudoprime to base 2 = **341** | V3 often answers 561 (Carmichael) or some other composite it remembers — R1 actually checks 2^n mod n |
| `derangements_d7` | D_7 = **1854** | V3 approximates via n!/e and rounds wrong, or recalls D_6/D_8; R1 uses the recurrence D_n=(n−1)(D_{n−1}+D_{n−2}) |
| `euler_quadratic_break` | smallest n where n²+n+41 is composite = **40** | V3 frequently confuses with n²−n+41 (first fails at 41); R1 checks small n systematically |
Adding a new task: see `tasks.ts`. Any checker that's deterministic is
fair game — extract numeric/list/text with regex, compare with set
equality or string matching.
## Non-goals
- **No LLM-as-judge.** Brittle and expensive; defeats the point of a
reproducible bench. If a checker is too hard to write deterministically,
the task doesn't belong here.
- **No tool-use tasks.** Those live in `tau-bench/`. Different story.
- **No multi-turn.** v0.3 harness is single-turn Q/A. Multi-turn reasoning
eval is separate scope.
- **No benchmark-data cherry-picking.** When results come in, we publish
them whether they validate Pillar 2 or not. "harvest didn't help on
these 3 tasks" is still useful information.
+82
View File
@@ -0,0 +1,82 @@
# Reasonix harvest eval (Pillar 2)
**Date:** 2026-04-21T16:44:21.011Z
**Tasks:** 6 · repeats × 1 · modes: baseline, reasoner, reasoner-harvest
**Reasonix version:** 0.2.2
## Summary by mode
| mode | runs | pass rate | cache hit | cost / run | harvest turns | subgoals | uncertainties |
|---|---:|---:|---:|---:|---:|---:|---:|
| baseline | 6 | 100% | 39.5% | $0.001371 | 0.0 | 0.0 | 0.0 |
| reasoner | 6 | 100% | 74.2% | $0.004170 | 0.0 | 0.0 | 0.0 |
| reasoner-harvest | 6 | 83% | 61.6% | $0.003304 | 0.8 | 2.8 | 1.3 |
## Deltas
- **baseline → reasoner**
- pass rate: 0pp
- cost: ×3.04 (each run costs more)
- harvest signal / run: 0.0 subgoals, 0.0 uncertainties
- **baseline → reasoner-harvest**
- pass rate: -17pp
- cost: ×2.41 (each run costs more)
- harvest signal / run: 2.8 subgoals, 1.3 uncertainties
## Per-task breakdown
| task | mode | rep | verdict | cache | cost | sg | un | note |
|---|---|---:|:---:|---:|---:|---:|---:|---|
| mod7_list | baseline | 1 | ✅ | 86.5% | $0.001361 | 0 | 0 | |
| mod7_list | reasoner | 1 | ✅ | 86.5% | $0.004797 | 0 | 0 | |
| mod7_list | reasoner-harvest | 1 | ✅ | 86.5% | $0.003045 | 4 | 2 | |
| flips_until_3heads | baseline | 1 | ✅ | 92.8% | $0.001198 | 0 | 0 | |
| flips_until_3heads | reasoner | 1 | ✅ | 92.8% | $0.002830 | 0 | 0 | |
| flips_until_3heads | reasoner-harvest | 1 | ✅ | 92.8% | $0.001691 | 4 | 0 | |
| three_hats | baseline | 1 | ✅ | 57.7% | $0.001514 | 0 | 0 | |
| three_hats | reasoner | 1 | ✅ | 57.7% | $0.009340 | 0 | 0 | |
| three_hats | reasoner-harvest | 1 | ✅ | 57.7% | $0.009651 | 3 | 2 | |
| pseudoprime_base2 | baseline | 1 | ✅ | 0.0% | $0.001894 | 0 | 0 | |
| pseudoprime_base2 | reasoner | 1 | ✅ | 75.3% | $0.003128 | 0 | 0 | |
| pseudoprime_base2 | reasoner-harvest | 1 | ❌ | 0.0% | $0.000000 | 0 | 0 | This operation was aborted |
| derangements_d7 | baseline | 1 | ✅ | 0.0% | $0.001273 | 0 | 0 | |
| derangements_d7 | reasoner | 1 | ✅ | 71.9% | $0.003492 | 0 | 0 | |
| derangements_d7 | reasoner-harvest | 1 | ✅ | 71.9% | $0.002843 | 3 | 2 | |
| euler_quadratic_break | baseline | 1 | ✅ | 0.0% | $0.000985 | 0 | 0 | |
| euler_quadratic_break | reasoner | 1 | ✅ | 61.0% | $0.001431 | 0 | 0 | |
| euler_quadratic_break | reasoner-harvest | 1 | ✅ | 61.0% | $0.002594 | 3 | 2 | |
## Scope
Unlike τ-bench-lite, these tasks are single-turn reasoning problems (no user simulator, no DB, no tool calls). Checkers are deterministic — regex + set / value compare, never an LLM judge. The point is to isolate whether the Pillar 2 harvest step adds measurable value above plain reasoner usage.
Interpretation: `baseline` (chat / V3) is a floor. `reasoner` shows the raw R1 gain. `reasoner-harvest` isolates the cost + quality delta from the extra V3 harvest call.
## Findings (v0.3, 18-run set)
Two bands of tasks tried (easy: mod7 / flips / hats; hard: pseudoprime341 / D_7 / Euler quadratic). The hard band was chosen for *known V3 failure modes*. Result:
1. **V3 chat passed all six tasks, including the three "hard" ones.** DeepSeek V3 knew 341 is the smallest base-2 pseudoprime, computed D_7=1854, and identified n=40 as the first Euler-polynomial failure. The tasks are well-known enough to be in training; the trap-answer variants (561, 265, 41) that the checkers specifically reject didn't fire.
2. **Reasoner cost 3.04× baseline for identical pass rates (6/6 both sides).** On this task set, R1 adds cost and latency without measurable quality. The cache-hit story *does* extend to reasoner (74.2% mean), so Pillar 1 generalizes to R1 — but that's not a Pillar 2 story.
3. **Harvest produced real signal** (mean 2.8 subgoals, 1.3 uncertainties per run where it fired) but didn't improve outcomes. One run hit the 300s timeout (bumped from 120s), suggesting reasoner-harvest latency is still unpredictable on some problems.
### What this tells us about Pillar 2 positioning
We've now given harvest two shots at showing answer-quality value on pure reasoning tasks. Both times V3 ate its lunch. This isn't a framework bug — it's a positioning signal:
- **On well-known math / logic / counting problems, DeepSeek V3 is strong enough that paying for R1 is not justified by accuracy.** Pillar 2's "smart preset" cost multiplier (10×) quoted in the README is real but for most single-question Q/A it buys nothing.
- **Harvest's plausible value surfaces are not "better math answers".** More likely: (a) transparency / auditability for developers, (b) planning support when tools are in the mix, (c) driving branch-sampling on cases where uncertainty correlates with wrongness. None of those are tested here.
### Recommendation
Don't ship v0.3 on the "harvest makes answers more correct" claim — the data doesn't support it. Two honest paths forward:
- **Reframe Pillar 2 as a developer-facing introspection feature** (debug visibility into R1's planning). Keep harvest opt-in; stop implying it improves accuracy on end-user tasks.
- **Move harvest eval to tool-use contexts** where uncertainty matters for *which tool to call next*, not *is this math right*. That's a new task shape — different harness, not a bigger task set here.
In either case, the next Reasonix release is better served by MCP client (Pillar 1 leverage across the ecosystem) than by a bigger harvest-bench data push.
### Notes
- Cache hit on baseline runs surprised me (39.5% mean). That's DeepSeek's *cross-session* prompt cache: the same system prompt ran many times across modes and runs warmed the server-side cache. Real cross-session evidence that Cache-First's value isn't only per-session.
- 5-subgoals cap still hit uniformly. `HarvestOptions.maxItems` default is 5; harvest is truncating. Moot unless we find a setting where that matters.
+232
View File
@@ -0,0 +1,232 @@
/**
* Render a harvest-bench results.json into a markdown report.
*
* npx tsx benchmarks/harvest/report.ts benchmarks/harvest/results-<date>.json
* npx tsx benchmarks/harvest/report.ts <input.json> --out report.md
*/
import { readFileSync, writeFileSync } from "node:fs";
import { pathToFileURL } from "node:url";
import { ALL_MODES, type HarvestBenchReport, type HarvestMode, type HarvestRunResult } from "./types.js";
interface CliArgs {
input: string;
outPath: string;
}
function parseArgs(argv: string[]): CliArgs {
const out: CliArgs = { input: "", outPath: "benchmarks/harvest/report.md" };
const positional: string[] = [];
for (let i = 0; i < argv.length; i++) {
const a = argv[i];
if (a === "--out") out.outPath = argv[++i] ?? out.outPath;
else if (a && !a.startsWith("--")) positional.push(a);
}
out.input = positional[0] ?? "";
if (!out.input) {
throw new Error("usage: npx tsx benchmarks/harvest/report.ts <results.json> [--out report.md]");
}
return out;
}
interface Agg {
runs: number;
passes: number;
avgCache: number;
avgCost: number;
avgClaudeCost: number;
avgHarvestedTurns: number;
avgSubgoals: number;
avgUncertainties: number;
}
function aggregate(results: HarvestRunResult[]): Agg {
if (results.length === 0) {
return {
runs: 0,
passes: 0,
avgCache: 0,
avgCost: 0,
avgClaudeCost: 0,
avgHarvestedTurns: 0,
avgSubgoals: 0,
avgUncertainties: 0,
};
}
const passes = results.filter((r) => r.verdict === "pass").length;
const mean = (fn: (r: HarvestRunResult) => number) =>
results.reduce((s, r) => s + fn(r), 0) / results.length;
return {
runs: results.length,
passes,
avgCache: mean((r) => r.cacheHitRatio),
avgCost: mean((r) => r.costUsd),
avgClaudeCost: mean((r) => r.claudeEquivalentUsd),
avgHarvestedTurns: mean((r) => r.harvestedTurns),
avgSubgoals: mean((r) => r.totalSubgoals),
avgUncertainties: mean((r) => r.totalUncertainties),
};
}
export function renderReport(report: HarvestBenchReport): string {
const lines: string[] = [];
lines.push("# Reasonix harvest eval (Pillar 2)");
lines.push("");
lines.push(`**Date:** ${report.meta.date}`);
lines.push(
`**Tasks:** ${report.meta.taskCount} · repeats × ${report.meta.repeatsPerTask} · modes: ${report.meta.modesRun.join(", ")}`,
);
lines.push(`**Reasonix version:** ${report.meta.reasonixVersion}`);
lines.push("");
// Per-mode summary
lines.push("## Summary by mode");
lines.push("");
lines.push("| mode | runs | pass rate | cache hit | cost / run | harvest turns | subgoals | uncertainties |");
lines.push("|---|---:|---:|---:|---:|---:|---:|---:|");
for (const mode of ALL_MODES) {
const rs = report.results.filter((r) => r.mode === mode);
const a = aggregate(rs);
if (a.runs === 0) continue;
lines.push(
`| ${mode} | ${a.runs} | ${pct(a.passes, a.runs)} | ${pct1(a.avgCache)} | $${a.avgCost.toFixed(6)} | ${a.avgHarvestedTurns.toFixed(1)} | ${a.avgSubgoals.toFixed(1)} | ${a.avgUncertainties.toFixed(1)} |`,
);
}
lines.push("");
// Pairwise deltas that actually answer the question
lines.push("## Deltas");
lines.push("");
const modes = ALL_MODES.filter((m) =>
report.results.some((r) => r.mode === m),
);
if (modes.length >= 2) {
const baseline = aggregate(report.results.filter((r) => r.mode === modes[0]));
for (let i = 1; i < modes.length; i++) {
const mode = modes[i]!;
const agg = aggregate(report.results.filter((r) => r.mode === mode));
const passDelta = (agg.passes / Math.max(agg.runs, 1)) - (baseline.passes / Math.max(baseline.runs, 1));
const costRatio = baseline.avgCost > 0 ? agg.avgCost / baseline.avgCost : 0;
lines.push(`- **${modes[0]} → ${mode}**`);
lines.push(` - pass rate: ${(passDelta * 100).toFixed(0)}pp`);
lines.push(` - cost: ×${costRatio.toFixed(2)} (each run costs ${costRatio > 1 ? "more" : "less"})`);
lines.push(` - harvest signal / run: ${agg.avgSubgoals.toFixed(1)} subgoals, ${agg.avgUncertainties.toFixed(1)} uncertainties`);
lines.push("");
}
}
// Per-task breakdown
lines.push("## Per-task breakdown");
lines.push("");
const byTask = new Map<string, HarvestRunResult[]>();
for (const r of report.results) {
const list = byTask.get(r.taskId) ?? [];
list.push(r);
byTask.set(r.taskId, list);
}
lines.push("| task | mode | rep | verdict | cache | cost | sg | un | note |");
lines.push("|---|---|---:|:---:|---:|---:|---:|---:|---|");
for (const [taskId, runs] of byTask) {
for (const r of runs) {
const mark = r.verdict === "pass" ? "✅" : r.verdict === "fail" ? "❌" : "•";
lines.push(
`| ${taskId} | ${r.mode} | ${r.repeat} | ${mark} | ${pct1(r.cacheHitRatio)} | $${r.costUsd.toFixed(6)} | ${r.totalSubgoals} | ${r.totalUncertainties} | ${truncate(r.checkNote ?? "", 40)} |`,
);
}
}
lines.push("");
lines.push("## Scope");
lines.push("");
lines.push(
"Unlike τ-bench-lite, these tasks are single-turn reasoning problems (no user simulator, no DB, no tool calls). Checkers are deterministic — regex + set / value compare, never an LLM judge. The point is to isolate whether the Pillar 2 harvest step adds measurable value above plain reasoner usage.",
);
lines.push("");
lines.push(
"Interpretation: `baseline` (chat / V3) is a floor. `reasoner` shows the raw R1 gain. `reasoner-harvest` isolates the cost + quality delta from the extra V3 harvest call.",
);
return lines.join("\n");
}
/**
* Findings section is hand-written into report.md after rendering — the
* numbers don't interpret themselves, and boilerplate sections full of
* "TBD — analyse the data" are worse than nothing. Append with append().
*
* This section has been updated twice: after the first 9-run set (which
* bottomed out at V3 on easy tasks) and after this 18-run set (which
* bottomed out at V3 on *hard* tasks too).
*/
export function renderFindings(_report: HarvestBenchReport): string {
return [
"",
"## Findings (v0.3, 18-run set)",
"",
"Two bands of tasks tried (easy: mod7 / flips / hats; hard: pseudoprime341 / D_7 / Euler quadratic). The hard band was chosen for *known V3 failure modes*. Result:",
"",
"1. **V3 chat passed all six tasks, including the three \"hard\" ones.** DeepSeek V3 knew 341 is the smallest base-2 pseudoprime, computed D_7=1854, and identified n=40 as the first Euler-polynomial failure. The tasks are well-known enough to be in training; the trap-answer variants (561, 265, 41) that the checkers specifically reject didn't fire.",
"2. **Reasoner cost 3.04× baseline for identical pass rates (6/6 both sides).** On this task set, R1 adds cost and latency without measurable quality. The cache-hit story *does* extend to reasoner (74.2% mean), so Pillar 1 generalizes to R1 — but that's not a Pillar 2 story.",
"3. **Harvest produced real signal** (mean 2.8 subgoals, 1.3 uncertainties per run where it fired) but didn't improve outcomes. One run hit the 300s timeout (bumped from 120s), suggesting reasoner-harvest latency is still unpredictable on some problems.",
"",
"### What this tells us about Pillar 2 positioning",
"",
"We've now given harvest two shots at showing answer-quality value on pure reasoning tasks. Both times V3 ate its lunch. This isn't a framework bug — it's a positioning signal:",
"",
"- **On well-known math / logic / counting problems, DeepSeek V3 is strong enough that paying for R1 is not justified by accuracy.** Pillar 2's \"smart preset\" cost multiplier (10×) quoted in the README is real but for most single-question Q/A it buys nothing.",
"- **Harvest's plausible value surfaces are not \"better math answers\".** More likely: (a) transparency / auditability for developers, (b) planning support when tools are in the mix, (c) driving branch-sampling on cases where uncertainty correlates with wrongness. None of those are tested here.",
"",
"### Recommendation",
"",
"Don't ship v0.3 on the \"harvest makes answers more correct\" claim — the data doesn't support it. Two honest paths forward:",
"",
"- **Reframe Pillar 2 as a developer-facing introspection feature** (debug visibility into R1's planning). Keep harvest opt-in; stop implying it improves accuracy on end-user tasks.",
"- **Move harvest eval to tool-use contexts** where uncertainty matters for *which tool to call next*, not *is this math right*. That's a new task shape — different harness, not a bigger task set here.",
"",
"In either case, the next Reasonix release is better served by MCP client (Pillar 1 leverage across the ecosystem) than by a bigger harvest-bench data push.",
"",
"### Notes",
"",
"- Cache hit on baseline runs surprised me (39.5% mean). That's DeepSeek's *cross-session* prompt cache: the same system prompt ran many times across modes and runs warmed the server-side cache. Real cross-session evidence that Cache-First's value isn't only per-session.",
"- 5-subgoals cap still hit uniformly. `HarvestOptions.maxItems` default is 5; harvest is truncating. Moot unless we find a setting where that matters.",
"",
].join("\n");
}
function pct(num: number, denom: number): string {
if (denom === 0) return "—";
return `${((num / denom) * 100).toFixed(0)}%`;
}
function pct1(x: number): string {
return `${(x * 100).toFixed(1)}%`;
}
function truncate(s: string, n: number): string {
return s.length > n ? `${s.slice(0, n)}…` : s;
}
async function main(): Promise<void> {
const args = parseArgs(process.argv.slice(2));
const raw = readFileSync(args.input, "utf8");
const report = JSON.parse(raw) as HarvestBenchReport;
const md = renderReport(report) + renderFindings(report);
writeFileSync(args.outPath, md, "utf8");
console.log(`wrote ${args.outPath} (${report.results.length} runs)`);
}
function isMain(): boolean {
const entry = process.argv[1];
if (!entry) return false;
return import.meta.url === pathToFileURL(entry).href;
}
if (isMain()) {
main().catch((err) => {
console.error(err);
process.exit(1);
});
}
// Suppress unused import warning — kept in scope so ALL_MODES order matches renderer iteration.
export type { HarvestMode };
+305
View File
@@ -0,0 +1,305 @@
{
"meta": {
"date": "2026-04-21T16:44:21.011Z",
"repeatsPerTask": 1,
"taskCount": 6,
"modesRun": [
"baseline",
"reasoner",
"reasoner-harvest"
],
"reasonixVersion": "0.2.2"
},
"results": [
{
"taskId": "mod7_list",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Alright, let's go step-by-step.\n\n---\n\n## **Step 1: Problem restatement**\nWe want positive integers \\( n \\leq 100 \\) such that \n\\[\nn^2 + n + 1 \\equiv 0 \\pmod{7}.\n\\]\n\n---\n\n## **Step 2: Try residues modulo 7**\nLet \\( n \\equiv r \\pmod{7} \\), where \\( r \\in \\{0, 1, 2, 3, 4, 5, 6\\} \\).\n\nWe compute \\( r^2 + r + 1 \\mod 7 \\):\n\n- \\( r = 0 \\): \\( 0 + 0 + 1 = 1 \\) → not divisible by 7.\n- \\( r = 1 \\): \\( 1 + 1 + 1 = 3 \\) → no.\n- \\( r = 2 \\): \\( 4 + 2 + 1 = 7 \\equiv 0 \\) → yes.\n- \\( r = 3 \\): \\( 9 + 3 + 1 = 13 \\equiv 6 \\) → no.\n- \\( r = 4 \\): \\( 16 + 4 + 1 = 21 \\equiv 0 \\) → yes.\n- \\( r = 5 \\): \\( 25 + 5 + 1 = 31 \\equiv 3 \\) → no.\n- \\( r = 6 \\): \\( 36 + 6 + 1 = 43 \\equiv 1 \\) → no.\n\nSo \\( n \\equiv 2 \\pmod{7} \\) or \\( n \\equiv 4 \\pmod{7} \\).\n\n---\n\n## **Step 3: General form**\n\\[\nn \\equiv 2 \\pmod{7} \\quad \\text{or} \\quad n \\equiv 4 \\pmod{7}.\n\\]\n\nThat means \\( n = 7k + 2 \\) or \\( n = 7k + 4 \\) for some integer \\( k \\ge 0 \\).\n\n---\n\n## **Step 4: Positive integers \\( n \\leq 100 \\)**\n**Case 1:** \\( n = 7k + 2 \\), \\( n \\leq 100 \\), \\( k \\ge 0 \\).\n\n\\( 7k + 2 \\leq 100 \\) → \\( 7k \\leq 98 \\) → \\( k \\leq 14 \\).\n\nSo \\( k = 0, 1, 2, \\dots, 14 \\) gives \\( n = 2, 9, 16, \\dots, 100 \\).\n\nCheck \\( n=100 \\): \\( 7 \\times 14 + 2 = 98 + 2 = 100 \\) okay.\n\n---\n\n**Case 2:** \\( n = 7k + 4 \\), \\( n \\leq 100 \\), \\( k \\ge 0 \\).\n\n\\( 7k + 4 \\leq 100 \\) → \\( 7k \\leq 96 \\) → \\( k \\leq 13 \\) (since \\( 7 \\times 13 = 91 \\), \\( 91+4=95 \\), \\( 7\\times14=98 \\) → \\( 98+4=102>100 \\)).\n\nSo \\( k = 0, 1, 2, \\dots, 13 \\) gives \\( n = 4, 11, 18, \\dots, 95 \\).\n\n---\n\n## **Step 5: List all such \\( n \\leq 100 \\)**\nFrom case 1: \\( 2, 9, 16, 23, 30, 37, 44, 51, 58, 65, 72, 79, 86, 93, 100 \\).\n\nFrom case 2: \\( 4, 11, 18, 25, 32, 39, 46, 53, 60, 67, 74, 81, 88, 95 \\).\n\nCombine and sort:\n\n\\[\n2, 4, 9, 11, 16, 18, 23, 25, 30, 32, 37, 39, 44, 46, 51, 53, 58, 60, 65, 67, 72, 74, 79, 81, 86, 88, 93, 95, 100.\n\\]\n\n---\n\n## **Step 6: Check count**\nEach sequence has 15 and 14 terms respectively, total \\( 15 + 14 = 29 \\) numbers.\n\nCheck: \\( n=2 \\) works? \\( 4+2+1=7 \\) yes. \\( n=4 \\) works? \\( 16+4+1=21 \\) yes. \\( n=100 \\) works? \\( 10000+100+1=10101 \\), divide by 7: \\( 10101/7 = 1443 \\) yes.\n\n---\n\n**Final answer:**\n\\[\n\\boxed{2, 4, 9, 11, 16, 18, 23, 25, 30, 32, 37, 39, 44, 46, 51, 53, 58, 60, 65, 67, 72, 74, 79, 81, 86, 88, 93, 95, 100}\n\\]\n\n---\n\nAnswer: 2, 4, 9, 11, 16, 18, 23, 25, 30, 32, 37, 39, 44, 46, 51, 53, 58, 60, 65, 67, 72, 74, 79, 81, 86, 88, 93, 95, 100",
"turns": 1,
"cacheHitRatio": 0.8648648648648649,
"costUsd": 0.0013612800000000003,
"claudeEquivalentUsd": 0.018687,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "mod7_list",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The condition \\(n^2 + n + 1\\) divisible by 7 is equivalent to \\(n^2 + n + 1 \\equiv 0 \\pmod{7}\\). Testing residues modulo 7:\n\n- \\(n \\equiv 0: 0+0+1 \\equiv 1\\) \n- \\(n \\equiv 1: 1+1+1 \\equiv 3\\) \n- \\(n \\equiv 2: 4+2+1 \\equiv 7 \\equiv 0\\) \n- \\(n \\equiv 3: 9+3+1 \\equiv 13 \\equiv 6\\) \n- \\(n \\equiv 4: 16+4+1 \\equiv 21 \\equiv 0\\) \n- \\(n \\equiv 5: 25+5+1 \\equiv 31 \\equiv 3\\) \n- \\(n \\equiv 6: 36+6+1 \\equiv 43 \\equiv 1\\)\n\nThus, \\(n \\equiv 2\\) or \\(n \\equiv 4 \\pmod{7}\\) are the solutions modulo 7. For positive integers \\(n \\leq 100\\), we list all numbers congruent to 2 or 4 modulo 7 in increasing order.\n\nAnswer: 2, 4, 9, 11, 16, 18, 23, 25, 30, 32, 37, 39, 44, 46, 51, 53, 58, 60, 65, 67, 72, 74, 79, 81, 86, 88, 93, 95, 100",
"turns": 1,
"cacheHitRatio": 0.8648648648648649,
"costUsd": 0.00479742,
"claudeEquivalentUsd": 0.032982,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "mod7_list",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The congruence \\(n^2 + n + 1 \\equiv 0 \\pmod{7}\\) is solved by testing residues modulo 7. The solutions are \\(n \\equiv 2\\) and \\(n \\equiv 4 \\pmod{7}\\). For positive integers \\(n \\le 100\\), these yield \\(n = 7k + 2\\) with \\(k = 0, 1, \\dots, 14\\) and \\(n = 7k + 4\\) with \\(k = 0, 1, \\dots, 13\\).\n\nAnswer: 2, 4, 9, 11, 16, 18, 23, 25, 30, 32, 37, 39, 44, 46, 51, 53, 58, 60, 65, 67, 72, 74, 79, 81, 86, 88, 93, 95, 100",
"turns": 1,
"cacheHitRatio": 0.8648648648648649,
"costUsd": 0.00304542,
"claudeEquivalentUsd": 0.020982,
"harvestedTurns": 1,
"totalSubgoals": 4,
"totalUncertainties": 2,
"totalHypotheses": 2,
"totalRejectedPaths": 2
},
{
"taskId": "flips_until_3heads",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Alright, let's reason through this step-by-step.\n\n---\n\n## **Step 1: Define states**\nLet’s define states based on how many consecutive heads we have at the moment.\n\n- \\( E_0 \\): Expected flips to reach 3 heads in a row starting from 0 consecutive heads (or just starting, or after a tail).\n- \\( E_1 \\): Expected flips to reach 3 heads in a row starting from 1 consecutive head.\n- \\( E_2 \\): Expected flips to reach 3 heads in a row starting from 2 consecutive heads.\n\nWe want \\( E_0 \\).\n\n---\n\n## **Step 2: Transition equations**\nFrom \\( E_0 \\):\n- Flip H (prob \\( \\frac12 \\)) → go to state \\( E_1 \\), 1 flip used.\n- Flip T (prob \\( \\frac12 \\)) → stay in \\( E_0 \\), 1 flip used.\n\nSo:\n\\[\nE_0 = \\frac12 (1 + E_1) + \\frac12 (1 + E_0)\n\\]\n\n---\n\nFrom \\( E_1 \\) (already have 1 head):\n- Flip H (prob \\( \\frac12 \\)) → go to state \\( E_2 \\), 1 flip used.\n- Flip T (prob \\( \\frac12 \\)) → go to state \\( E_0 \\), 1 flip used.\n\nSo:\n\\[\nE_1 = \\frac12 (1 + E_2) + \\frac12 (1 + E_0)\n\\]\n\n---\n\nFrom \\( E_2 \\) (already have 2 heads):\n- Flip H (prob \\( \\frac12 \\)) → done (3 heads in a row), 1 flip used.\n- Flip T (prob \\( \\frac12 \\)) → go to state \\( E_0 \\), 1 flip used.\n\nSo:\n\\[\nE_2 = \\frac12 (1 + 0) + \\frac12 (1 + E_0)\n\\]\n\\[\nE_2 = \\frac12 \\cdot 1 + \\frac12 (1 + E_0) \\quad\\text{(Wait, careful:)}\n\\]\nActually: \nIf H: \\( 1 \\) flip and done. \nIf T: \\( 1 \\) flip and then \\( E_0 \\) more.\n\nSo:\n\\[\nE_2 = \\frac12 \\cdot 1 + \\frac12 (1 + E_0)\n\\]\nCheck: \nH: 1 flip → total 1, done. Contribution: \\( \\frac12 \\times 1 \\). \nT: 1 flip + \\( E_0 \\) more → total \\( 1 + E_0 \\). Contribution: \\( \\frac12 \\times (1 + E_0) \\).\n\nYes:\n\\[\nE_2 = \\frac12 \\cdot 1 + \\frac12 (1 + E_0) = \\frac12 + \\frac12 + \\frac12 E_0 = 1 + \\frac{E_0}{2}.\n\\]\n\n---\n\n## **Step 3: Solve system**\nWe have:\n\n(1) \\( E_0 = \\frac12 (1 + E_1) + \\frac12 (1 + E_0) \\) \nSimplify: \\( E_0 = 1 + \\frac12 E_1 + \\frac12 E_0 \\) \nMultiply by 2: \\( 2E_0 = 2 + E_1 + E_0 \\) \nSo \\( E_0 - E_1 = 2 \\) … (Eq A)\n\n---\n\n(2) \\( E_1 = \\frac12 (1 + E_2) + \\frac12 (1 + E_0) \\) \nSimplify: \\( E_1 = 1 + \\frac12 E_2 + \\frac12 E_0 \\) … (Eq B)\n\n---\n\n(3) \\( E_2 = 1 + \\frac12 E_0 \\) … (Eq C)\n\n---\n\nFrom Eq C into Eq B:\n\\[\nE_1 = 1 + \\frac12 \\left( 1 + \\frac12 E_0 \\right) + \\frac12 E_0\n\\]\n\\[\nE_1 = 1 + \\frac12 + \\frac14 E_0 + \\frac12 E_0\n\\]\n\\[\nE_1 = \\frac32 + \\frac34 E_0\n\\]\n\n---\n\nFrom Eq A: \\( E_0 - E_1 = 2 \\) \nSubstitute \\( E_1 \\):\n\\[\nE_0 - \\left( \\frac32 + \\frac34 E_0 \\right) = 2\n\\]\n\\[\nE_0 - \\frac32 - \\frac34 E_0 = 2\n\\]\n\\[\n\\frac14 E_0 - \\frac32 = 2\n\\]\n\\[\n\\frac14 E_0 = 2 + \\frac32 = \\frac72\n\\]\n\\[\nE_0 = 14\n\\]\n\n---\n\n## **Step 4: Conclusion**\nThe expected number of flips until we get 3 heads in a row is \\( 14 \\).\n\n---\n\n**Answer:** 14",
"turns": 1,
"cacheHitRatio": 0.927536231884058,
"costUsd": 0.00119823,
"claudeEquivalentUsd": 0.016467,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "flips_until_3heads",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The expected number of flips required to get three consecutive heads is 14, derived from solving the system of linear equations for the Markov chain states representing the current streak of heads.\n\nAnswer: 14",
"turns": 1,
"cacheHitRatio": 0.927536231884058,
"costUsd": 0.00283024,
"claudeEquivalentUsd": 0.019512,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "flips_until_3heads",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The expected number of flips until three consecutive heads appear is 14.\n\nAnswer: 14",
"turns": 1,
"cacheHitRatio": 0.927536231884058,
"costUsd": 0.00169144,
"claudeEquivalentUsd": 0.011712,
"harvestedTurns": 1,
"totalSubgoals": 4,
"totalUncertainties": 0,
"totalHypotheses": 2,
"totalRejectedPaths": 0
},
{
"taskId": "three_hats",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Let's break this down step by step.\n\n---\n\n**Step 1: Understanding the setup** \nThree people: A (first), B (second), C (third). \nEach hat is red (R) or blue (B). \nThey know: at least one hat is red. \nEach sees the other two hats, not their own. \nThey are asked in order: \"Do you know your hat color?\" \nA answers no, B answers no, C answers yes. \nWe want C’s hat color.\n\n---\n\n**Step 2: From A’s perspective when asked** \nA sees B and C. \nIf A had seen two blue hats, then A would know: \"At least one red hat means my hat must be red.\" \nSo A says \"no\" → A did **not** see two blue hats. \nThus A sees at least one red hat on {B, C}.\n\nPossible cases for what A sees (B, C): \n(R, R), (R, B), (B, R) — all have at least one red.\n\n---\n\n**Step 3: B’s reasoning when asked** \nB hears A say \"no\". \nB sees A and C. \n\nLet’s consider B’s possible deductions from A’s \"no\": \nB knows: If A had seen two blues, A would have said yes. Since A said no, A saw at least one red among B and C. \nBut B sees A and C. \n\nFrom B’s viewpoint: \n- If B saw C with blue and A with blue, then B would know: \"A saw me and C both blue → impossible because A said no.\" But B doesn’t see that because if B saw A blue and C blue, then B would know his own hat must be red (since at least one red total). But then B would answer yes. \nSo B’s \"no\" means B did **not** see A and C both blue. \n\nAlso, B considers: Could my hat be blue? Let’s check: \nSuppose B sees A red, C blue. Then B thinks: \"If my hat were blue, then A would have seen (B blue, C blue) → A would have said yes. But A said no, so my hat cannot be blue.\" \nSo if B saw (A red, C blue), B would deduce: \"My hat must be red.\" Then B would answer yes. \nBut B said no → so B did **not** see (A red, C blue).\n\nSimilarly, if B saw (A blue, C red): \nThen B thinks: \"If my hat were blue, then A would have seen (B blue, C red) → that’s fine (A sees one red on C), so A would still say no. If my hat were red, then A would see (B red, C red) → A would still say no. So I don’t know.\" That’s consistent with B saying no. \n\nIf B saw (A red, C red): \nThen B thinks: \"If my hat were blue, A sees (B blue, C red) → A says no. If my hat were red, A sees (B red, C red) → A says no. So I don’t know.\" That’s also consistent with B saying no.\n\nSo B says no in cases: \nB sees (A blue, C red) or (A red, C red). \nB would say yes if B saw (A red, C blue) — but that didn’t happen. \n\n---\n\n**Step 4: C’s reasoning** \nC hears A says no, B says no. \nC sees A and B. \n\nFrom C’s viewpoint: \nLet’s list all possible (A, B, C) hat colorings with at least one red, consistent with A’s \"no\" (which we already incorporated: A sees at least one red on B/C) and B’s \"no\" (meaning B didn’t see A red, C blue — because that would make B know).\n\nPossible cases for (A, B) that C could see: \n\n1. C sees (A blue, B red): \n Then C thinks: \n - If C were blue: (A blue, B red, C blue) → A sees (B red, C blue) → A says no. B sees (A blue, C blue) → B sees two blues? Wait, B sees A blue, C blue → then B knows his own hat is red (since at least one red total) → B would say yes. But B said no → contradiction. So C cannot be blue. \n So C must be red. \n\n2. C sees (A red, B blue): \n Then C thinks: \n - If C were blue: (A red, B blue, C blue) → A sees (B blue, C blue) → A would say yes (since at least one red total means A’s hat must be red). But A said no → contradiction. So C cannot be blue. \n So C must be red. \n\n3. C sees (A red, B red): \n Then C thinks: \n - If C were blue: (A red, B red, C blue) → A sees (B red, C blue) → A says no. B sees (A red, C blue) → B sees A red, C blue → earlier we said: If B sees A red, C blue, then B would deduce his own hat is red (reasoning: if B were blue, A would have seen two blues and said yes, but A said no, so B can’t be blue) → so B would say yes. But B actually said no → contradiction. So C cannot be blue. \n - If C were red: (A red, B red, C red) → A sees (B red, C red) → A says no. B sees (A red, C red) → B says no. Works fine. \n\nSo in all cases C sees for (A, B), C can deduce C’s hat is **red** because assuming C is blue leads to contradiction with B’s \"no\" (in cases 1 and 3) or with A’s \"no\" (in case 2).\n\n---\n\n**Step 5: Conclusion** \nC answers yes, and C’s hat must be red.\n\n---\n\nAnswer: red",
"turns": 1,
"cacheHitRatio": 0.5765765765765766,
"costUsd": 0.0015142700000000003,
"claudeEquivalentUsd": 0.020748,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "three_hats",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Answer: red",
"turns": 1,
"cacheHitRatio": 0.5765765765765766,
"costUsd": 0.009340119999999999,
"claudeEquivalentUsd": 0.064068,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "three_hats",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The third person deduces their hat color based on the previous responses. Since the first two answer \"no,\" it implies they each see at least one red hat and cannot determine their own color. Specifically, the second person's \"no\" indicates they see the third person's hat as red; otherwise, they would have known their own hat color. Therefore, the third person's hat must be red.\n\nAnswer: red",
"turns": 1,
"cacheHitRatio": 0.5765765765765766,
"costUsd": 0.0096511,
"claudeEquivalentUsd": 0.066198,
"harvestedTurns": 1,
"totalSubgoals": 3,
"totalUncertainties": 2,
"totalHypotheses": 3,
"totalRejectedPaths": 3
},
{
"taskId": "pseudoprime_base2",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Alright, let's go step-by-step.\n\n---\n\n**Step 1: Understanding the problem**\n\nWe want the smallest composite integer \\( n > 1 \\) such that\n\n\\[\n2^n \\equiv 2 \\pmod{n}.\n\\]\n\nEquivalently, \\( 2^{n-1} \\equiv 1 \\pmod{n} \\) for composite \\( n \\).\n\nThis means \\( n \\) is a **Fermat pseudoprime to base 2**.\n\nWe check composite numbers starting from the smallest.\n\n---\n\n**Step 2: Check small composites**\n\n- \\( n = 4 \\): composite. \n\\( 2^4 = 16 \\), \\( 16 \\mod 4 = 0 \\), not \\( 2 \\). So \\( 2^4 \\equiv 0 \\not\\equiv 2 \\pmod{4} \\). Fails.\n\n- \\( n = 6 \\): composite. \n\\( 2^6 = 64 \\), \\( 64 \\mod 6 = 4 \\), not \\( 2 \\). Fails.\n\n- \\( n = 8 \\): composite. \n\\( 2^8 = 256 \\), \\( 256 \\mod 8 = 0 \\), not \\( 2 \\). Fails.\n\n- \\( n = 9 \\): composite. \n\\( 2^9 = 512 \\), \\( 512 \\mod 9 \\): \n\\( 512 \\div 9 \\), \\( 9 \\times 56 = 504 \\), remainder \\( 8 \\), not \\( 2 \\). Fails.\n\n- \\( n = 10 \\): composite. \n\\( 2^{10} = 1024 \\), \\( 1024 \\mod 10 = 4 \\), not \\( 2 \\). Fails.\n\n---\n\n**Step 3: Try n = 15**\n\n\\( n = 15 \\): composite. \n\\( 2^{15} = 32768 \\). \nCheck mod 15: \nWe can use mod arithmetic: \n\\( 2^4 = 16 \\equiv 1 \\pmod{15} \\)?? Wait, check: \\( 16 \\mod 15 = 1 \\), yes. \nSo \\( 2^{15} = (2^4)^3 \\times 2^3 = 1^3 \\times 8 = 8 \\pmod{15} \\). \nSo \\( 2^{15} \\equiv 8 \\not\\equiv 2 \\pmod{15} \\). Fails.\n\n---\n\n**Step 4: Try n = 21**\n\n\\( n = 21 \\): composite. \nMod 21: \n\\( 2^6 = 64 \\equiv 1 \\pmod{21} \\)? Check: \\( 64 \\div 21 = 3 \\times 21 = 63 \\), remainder 1, yes. \nSo \\( 2^{21} = (2^6)^3 \\times 2^3 \\equiv 1^3 \\times 8 = 8 \\pmod{21} \\). Not 2. Fails.\n\n---\n\n**Step 5: Try n = 22**\n\n\\( n = 22 \\): composite. \nUse mod 22: \nEuler’s totient not needed, just check order: \n\\( 2^5 = 32 \\equiv 10 \\pmod{22} \\) \n\\( 2^{10} = (2^5)^2 \\equiv 10^2 = 100 \\equiv 12 \\pmod{22} \\) \n\\( 2^{11} \\equiv 24 \\equiv 2 \\pmod{22} \\) \nSo \\( 2^{22} = (2^{11})^2 \\equiv 2^2 = 4 \\pmod{22} \\). Not 2. Fails.\n\n---\n\n**Step 6: Try n = 25**\n\n\\( n = 25 \\): composite. \nCheck mod 25: \n\\( 2^{10} = 1024 \\equiv 24 \\pmod{25} \\) (since \\( 1000 \\equiv 0 \\), \\( 24 \\equiv -1 \\)) \nActually check: \\( 1024 - 1000 = 24 \\), yes \\( 24 \\equiv -1 \\). \nSo \\( 2^{20} \\equiv 1 \\pmod{25} \\). \nThus \\( 2^{25} = 2^{20} \\times 2^5 \\equiv 1 \\times 32 = 7 \\pmod{25} \\). Not 2. Fails.\n\n---\n\n**Step 7: Known smallest base-2 Fermat pseudoprime**\n\nFrom known number theory facts: \nThe smallest Fermat pseudoprime to base 2 is \\( n = 341 \\). \nBut let's check smaller ones just in case I’m skipping one.\n\n---\n\n**Step 8: Try n = 91**\n\n91 = 7 × 13. \nCheck mod 7: \\( 2^{91} \\equiv (2^6)^{15} \\times 2^1 \\equiv 1^{15} \\times 2 = 2 \\pmod{7} \\). \nCheck mod 13: \\( 2^{12} \\equiv 1 \\pmod{13} \\), \n\\( 91 = 12 \\times 7 + 7 \\), so \\( 2^{91} \\equiv 2^7 = 128 \\equiv 11 \\pmod{13} \\). \nFor \\( 2^{91} \\equiv 2 \\pmod{91} \\), we need \\( 2^{91} \\equiv 2 \\) mod 7 and mod 13. \nMod 13 we got 11, not 2. So fails.\n\n---\n\n**Step 9: Try n = 341**\n\n341 = 11 × 31. \nCheck mod 11: \\( 2^{10} \\equiv 1 \\pmod{11} \\), \n\\( 341 = 10 \\times 34 + 1 \\), so \\( 2^{341} \\equiv 2^1 = 2 \\pmod{11} \\). Good. \nCheck mod 31: \\( 2^5 = 32 \\equiv 1 \\pmod{31} \\), \n\\( 341 = 5 \\times 68 + 1 \\), so \\( 2^{341} \\equiv 2^1 = 2 \\pmod{31} \\). \nSo \\( 2^{341} \\equiv 2 \\) mod 11 and mod 31, hence mod 341. \nThus \\( 341 \\) works.\n\n---\n\n**Step 10: Check smaller than 341**\n\nKnown list: 341 is smallest. Let’s check a candidate like 121 = 11^2: \n\\( 2^{121} \\mod 121 \\): \nMod 11: \\( 2^{10} \\equiv 1 \\), \\( 121 = 10 \\times 12 + 1 \\), so \\( 2^{121} \\equiv 2 \\pmod{11} \\). \nBut for modulus 121, need more: \nActually, \\( 2^{110} \\equiv 1 \\pmod{121} \\) by Euler’s theorem? Not exactly, but known: 121 is not a pseudoprime base 2. Quick check: \n\\( 2^{121} - 2 \\) divisible by 121? Probably not. Let’s skip detailed check; known fact is 341 is smallest.\n\n---\n\n**Step 11: Verify no smaller composite works**\n\nFrom known sequence A001567: \nFirst few base-2 Fermat pseudoprimes: 341, 561, 645, 1105, … \nSo smallest is 341.\n\n---\n\n**Step 12: Conclusion**\n\nThe smallest composite \\( n > 1 \\) with \\( 2^n \\equiv 2 \\pmod{n} \\) is \\( n = 341 \\).\n\n---\n\n**Answer:** 341",
"turns": 1,
"cacheHitRatio": 0,
"costUsd": 0.0018940500000000002,
"claudeEquivalentUsd": 0.02577,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "pseudoprime_base2",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The smallest composite integer \\(n > 1\\) satisfying \\(2^n \\equiv 2 \\pmod{n}\\) is \\(n = 341\\). This is composite (\\(341 = 11 \\times 31\\)), and it satisfies the congruence because \\(2^{341} \\equiv 2 \\pmod{11}\\) and \\(2^{341} \\equiv 2 \\pmod{31}\\) by Fermat's little theorem, implying \\(2^{341} \\equiv 2 \\pmod{341}\\). All smaller composite integers (e.g., 4, 6, 8, 9, 10, 15, 21) fail to satisfy the condition.\n\nAnswer: 341",
"turns": 1,
"cacheHitRatio": 0.7529411764705882,
"costUsd": 0.0031281200000000003,
"claudeEquivalentUsd": 0.02154,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "pseudoprime_base2",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "fail",
"checkNote": "This operation was aborted",
"finalAgentMessage": "",
"turns": 0,
"cacheHitRatio": 0,
"costUsd": 0,
"claudeEquivalentUsd": 0,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0,
"errorMessage": "This operation was aborted"
},
{
"taskId": "derangements_d7",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Alright, let's go step-by-step.\n\n---\n\n**Step 1: Understanding the problem**\n\nWe want the number of permutations of \\(\\{1, 2, 3, 4, 5, 6, 7\\}\\) with **no fixed points**. \nA fixed point means \\(\\pi(i) = i\\) for some \\(i\\). \nA permutation with no fixed points is called a **derangement**. \nThe number of derangements of \\(n\\) elements is denoted \\(D_n\\) or \\(!n\\).\n\n---\n\n**Step 2: Formula for derangements**\n\nThe formula for \\(D_n\\) is:\n\n\\[\nD_n = n! \\sum_{k=0}^{n} \\frac{(-1)^k}{k!}\n\\]\n\nFor \\(n=7\\):\n\n\\[\nD_7 = 7! \\left( \\frac{1}{0!} - \\frac{1}{1!} + \\frac{1}{2!} - \\frac{1}{3!} + \\frac{1}{4!} - \\frac{1}{5!} + \\frac{1}{6!} - \\frac{1}{7!} \\right)\n\\]\n\n---\n\n**Step 3: Compute step-by-step**\n\nFirst, \\(7! = 5040\\).\n\nNow compute the sum:\n\n\\[\n\\sum_{k=0}^{7} \\frac{(-1)^k}{k!} \n= 1 - 1 + \\frac{1}{2} - \\frac{1}{6} + \\frac{1}{24} - \\frac{1}{120} + \\frac{1}{720} - \\frac{1}{5040}\n\\]\n\nLet's compute term-by-term:\n\n- \\(1 - 1 = 0\\)\n- \\(0 + 0.5 = 0.5\\)\n- \\(0.5 - \\frac{1}{6} \\approx 0.5 - 0.1666667 = 0.3333333\\)\n- \\(0.3333333 + \\frac{1}{24} \\approx 0.3333333 + 0.0416667 = 0.375\\)\n- \\(0.375 - \\frac{1}{120} \\approx 0.375 - 0.0083333 = 0.3666667\\)\n- \\(0.3666667 + \\frac{1}{720} \\approx 0.3666667 + 0.0013889 = 0.3680556\\)\n- \\(0.3680556 - \\frac{1}{5040} \\approx 0.3680556 - 0.0001984 = 0.3678572\\)\n\nSo the sum is approximately \\(0.367857142857...\\)\n\n---\n\n**Step 4: Multiply by \\(7!\\)**\n\n\\[\nD_7 = 5040 \\times 0.367857142857\\ldots\n\\]\n\nLet's compute exactly using fractions:\n\n\\[\n\\sum_{k=0}^{7} \\frac{(-1)^k}{k!} \n= \\frac{1}{2!} - \\frac{1}{3!} + \\frac{1}{4!} - \\frac{1}{5!} + \\frac{1}{6!} - \\frac{1}{7!}\n\\]\n\nWrite with common denominator \\(7! = 5040\\):\n\n- \\(\\frac{1}{2!} = \\frac{2520}{5040}\\)\n- \\(\\frac{1}{3!} = \\frac{840}{5040}\\)\n- \\(\\frac{1}{4!} = \\frac{210}{5040}\\)\n- \\(\\frac{1}{5!} = \\frac{42}{5040}\\)\n- \\(\\frac{1}{6!} = \\frac{7}{5040}\\)\n- \\(\\frac{1}{7!} = \\frac{1}{5040}\\)\n\nNow alternate signs:\n\n\\[\n\\left( \\frac{2520}{5040} - \\frac{840}{5040} \\right) \n= \\frac{1680}{5040}\n\\]\n\\[\n\\frac{1680}{5040} + \\frac{210}{5040} = \\frac{1890}{5040}\n\\]\n\\[\n\\frac{1890}{5040} - \\frac{42}{5040} = \\frac{1848}{5040}\n\\]\n\\[\n\\frac{1848}{5040} + \\frac{7}{5040} = \\frac{1855}{5040}\n\\]\n\\[\n\\frac{1855}{5040} - \\frac{1}{5040} = \\frac{1854}{5040}\n\\]\n\nSo the sum is \\(\\frac{1854}{5040}\\).\n\n---\n\n**Step 5: Multiply by \\(7!\\)**\n\n\\[\nD_7 = 5040 \\times \\frac{1854}{5040} = 1854\n\\]\n\n---\n\n**Step 6: Quick check with known derangement numbers**\n\nKnown small derangements: \n\\(D_1 = 0, D_2 = 1, D_3 = 2, D_4 = 9, D_5 = 44, D_6 = 265, D_7 = 1854\\). \nYes, matches known sequence.\n\n---\n\n**Final answer:**\n\nAnswer: 1854",
"turns": 1,
"cacheHitRatio": 0,
"costUsd": 0.00127253,
"claudeEquivalentUsd": 0.017292,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "derangements_d7",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The number of derangements of \\(n\\) distinct objects, denoted \\(D_n\\), counts permutations with no fixed points. For \\(n = 7\\), this can be computed using the recurrence \\(D_n = (n-1)(D_{n-1} + D_{n-2})\\) with initial values \\(D_1 = 0\\) and \\(D_2 = 1\\). \nThus: \n\\(D_3 = 2(1+0) = 2\\), \n\\(D_4 = 3(2+1) = 9\\), \n\\(D_5 = 4(9+2) = 44\\), \n\\(D_6 = 5(44+9) = 265\\), \n\\(D_7 = 6(265+44) = 1854\\).\n\nAnswer: 1854",
"turns": 1,
"cacheHitRatio": 0.7191011235955056,
"costUsd": 0.00349167,
"claudeEquivalentUsd": 0.024027,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "derangements_d7",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The number of derangements of \\(n\\) elements, denoted \\(D_n\\), counts permutations with no fixed points. For \\(n=7\\), this can be computed using the recurrence \\(D_n = (n-1)(D_{n-1} + D_{n-2})\\) with initial values \\(D_0 = 1\\) and \\(D_1 = 0\\). Applying the recurrence yields \\(D_2 = 1\\), \\(D_3 = 2\\), \\(D_4 = 9\\), \\(D_5 = 44\\), \\(D_6 = 265\\), and finally \\(D_7 = 6 \\times (265 + 44) = 1854\\).\n\nAnswer: 1854",
"turns": 1,
"cacheHitRatio": 0.7191011235955056,
"costUsd": 0.0028434299999999997,
"claudeEquivalentUsd": 0.019587,
"harvestedTurns": 1,
"totalSubgoals": 3,
"totalUncertainties": 2,
"totalHypotheses": 2,
"totalRejectedPaths": 2
},
{
"taskId": "euler_quadratic_break",
"mode": "baseline",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "Let’s check \\( f(n) = n^2 + n + 41 \\) for small \\( n \\):\n\n- \\( n = 0 \\): \\( f(0) = 41 \\) (prime) \n- \\( n = 1 \\): \\( f(1) = 1 + 1 + 41 = 43 \\) (prime) \n- \\( n = 2 \\): \\( f(2) = 4 + 2 + 41 = 47 \\) (prime) \n- \\( n = 3 \\): \\( f(3) = 9 + 3 + 41 = 53 \\) (prime) \n- \\( n = 4 \\): \\( f(4) = 16 + 4 + 41 = 61 \\) (prime) \n- \\( n = 5 \\): \\( f(5) = 25 + 5 + 41 = 71 \\) (prime) \n- \\( n = 6 \\): \\( f(6) = 36 + 6 + 41 = 83 \\) (prime) \n- \\( n = 7 \\): \\( f(7) = 49 + 7 + 41 = 97 \\) (prime) \n- \\( n = 8 \\): \\( f(8) = 64 + 8 + 41 = 113 \\) (prime) \n- \\( n = 9 \\): \\( f(9) = 81 + 9 + 41 = 131 \\) (prime) \n- \\( n = 10 \\): \\( f(10) = 100 + 10 + 41 = 151 \\) (prime) \n\nWe can keep going, but the first known counterexample for this famous Euler polynomial is \\( n = 40 \\), because \n\\[\nf(40) = 40^2 + 40 + 41 = 1600 + 40 + 41 = 1681.\n\\] \nCheck if \\( 1681 \\) is prime: \n\\( 1681 = 41^2 \\) (since \\( 41 \\times 41 = 1681 \\)), so it’s composite.\n\nBut wait — let’s check if there’s a smaller \\( n \\) where \\( f(n) \\) is composite. \nWe can test \\( n = 41 \\): \n\\( f(41) = 41^2 + 41 + 41 = 1681 + 82 = 1763 \\), which is \\( 41 \\times 43 \\) (since \\( 1763/41 = 43 \\)), so composite. But \\( n = 41 \\) is larger than \\( n = 40 \\).\n\nCheck \\( n = 39 \\): \\( f(39) = 1521 + 39 + 41 = 1601 \\). Test divisibility: not divisible by primes up to \\( \\sqrt{1601} \\approx 40 \\), seems prime. \n\nCheck \\( n = 40 \\) is indeed the first composite? Let’s check \\( n = 1 \\) to \\( 39 \\) quickly for a smaller counterexample: \nWe can note \\( f(n) = n(n+1) + 41 \\). If \\( 41 \\mid f(n) \\), then \\( 41 \\mid n(n+1) \\). \nThat happens when \\( n \\equiv 0 \\pmod{41} \\) or \\( n \\equiv 40 \\pmod{41} \\). \nThe smallest positive such \\( n \\) is \\( n = 40 \\) (since \\( n=41 \\) is larger). \nSo for \\( n = 40 \\), \\( f(40) = 40 \\times 41 + 41 = 41 \\times 41 \\) is composite. \n\nCheck \\( n = 0 \\) to \\( 39 \\): no multiple of 41 except \\( n=0 \\) (which gives 41, prime). So \\( n=40 \\) is indeed the first nonnegative integer where \\( f(n) \\) is composite.\n\nThus smallest \\( n \\) is \\( 40 \\), \\( f(40) = 1681 = 41^2 \\).\n\n**Answer:** 40",
"turns": 1,
"cacheHitRatio": 0,
"costUsd": 0.00098535,
"claudeEquivalentUsd": 0.013365,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "euler_quadratic_break",
"mode": "reasoner",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The smallest nonnegative integer \\(n\\) for which \\(f(n) = n^2 + n + 41\\) is composite is \\(n = 40\\). At this value, \\(f(40) = 40^2 + 40 + 41 = 1681 = 41^2\\), which is not prime.\n\nAnswer: 40",
"turns": 1,
"cacheHitRatio": 0.6095238095238096,
"costUsd": 0.0014309199999999998,
"claudeEquivalentUsd": 0.0099,
"harvestedTurns": 0,
"totalSubgoals": 0,
"totalUncertainties": 0,
"totalHypotheses": 0,
"totalRejectedPaths": 0
},
{
"taskId": "euler_quadratic_break",
"mode": "reasoner-harvest",
"repeat": 1,
"verdict": "pass",
"finalAgentMessage": "The polynomial \\(f(n) = n^2 + n + 41\\) is known to produce primes for \\(n = 0, 1, 2, \\dots, 39\\). At \\(n = 40\\), we have \\(f(40) = 40^2 + 40 + 41 = 1681\\), and \\(1681 = 41^2\\), which is composite. Therefore, \\(n = 40\\) is the smallest nonnegative integer where \\(f(n)\\) fails to be prime.\n\nAnswer: 40",
"turns": 1,
"cacheHitRatio": 0.6095238095238096,
"costUsd": 0.0025938099999999998,
"claudeEquivalentUsd": 0.017865,
"harvestedTurns": 1,
"totalSubgoals": 3,
"totalUncertainties": 2,
"totalHypotheses": 3,
"totalRejectedPaths": 2
}
]
}
+312
View File
@@ -0,0 +1,312 @@
/**
* Harvest-bench runner.
*
* Usage:
* npx tsx benchmarks/harvest/runner.ts # all tasks, all modes, 1 repeat
* npx tsx benchmarks/harvest/runner.ts --task mod7_list
* npx tsx benchmarks/harvest/runner.ts --mode reasoner-harvest --repeats 3
* npx tsx benchmarks/harvest/runner.ts --transcripts-dir transcripts/
* npx tsx benchmarks/harvest/runner.ts --dry # smoke test wiring, no API
*
* Writes results.json. Render report.md with `report.ts`.
*/
import { type WriteStream, mkdirSync, writeFileSync } from "node:fs";
import { join } from "node:path";
import { pathToFileURL } from "node:url";
import {
CacheFirstLoop,
DeepSeekClient,
ImmutablePrefix,
claudeEquivalentCost,
loadDotenv,
} from "../../src/index.js";
import { openTranscriptFile, recordFromLoopEvent, writeRecord } from "../../src/transcript.js";
import { TASKS } from "./tasks.js";
import type {
HarvestBenchMeta,
HarvestBenchReport,
HarvestMode,
HarvestRunResult,
HarvestTask,
} from "./types.js";
import { ALL_MODES } from "./types.js";
loadDotenv();
interface CliArgs {
taskFilter: string | null;
modes: HarvestMode[];
repeats: number;
outPath: string | null;
transcriptsDir: string | null;
/** Per-HTTP-call timeout in ms. Default 300_000 (5 min) — reasoner + harvest runs legitimately need this. */
timeoutMs: number;
dry: boolean;
verbose: boolean;
}
function parseArgs(argv: string[]): CliArgs {
const out: CliArgs = {
taskFilter: null,
modes: [...ALL_MODES],
repeats: 1,
outPath: null,
transcriptsDir: null,
timeoutMs: 300_000,
dry: false,
verbose: false,
};
for (let i = 0; i < argv.length; i++) {
const a = argv[i];
if (a === "--task") out.taskFilter = argv[++i] ?? null;
else if (a === "--mode") {
const v = (argv[++i] ?? "").toLowerCase() as HarvestMode;
if ((ALL_MODES as string[]).includes(v)) out.modes = [v];
} else if (a === "--repeats") out.repeats = Number.parseInt(argv[++i] ?? "1", 10);
else if (a === "--out") out.outPath = argv[++i] ?? null;
else if (a === "--transcripts-dir") out.transcriptsDir = argv[++i] ?? null;
else if (a === "--timeout") {
// Accept seconds for humans, convert to ms internally.
const secs = Number.parseInt(argv[++i] ?? "300", 10);
if (Number.isFinite(secs) && secs > 0) out.timeoutMs = secs * 1000;
} else if (a === "--dry") out.dry = true;
else if (a === "--verbose" || a === "-v") out.verbose = true;
}
return out;
}
// ---------- model resolution ----------
function modelForMode(mode: HarvestMode): string {
if (mode === "baseline") return "deepseek-chat";
return "deepseek-reasoner";
}
function harvestForMode(mode: HarvestMode): boolean {
return mode === "reasoner-harvest";
}
// ---------- run one task in one mode ----------
async function runOnce(
task: HarvestTask,
mode: HarvestMode,
rep: number,
client: DeepSeekClient,
transcriptStream: WriteStream | null,
): Promise<HarvestRunResult> {
const model = modelForMode(mode);
const harvest = harvestForMode(mode);
const prefix = new ImmutablePrefix({ system: task.systemPrompt });
const loop = new CacheFirstLoop({
client,
prefix,
model,
harvest,
stream: false,
});
const prefixHash = prefix.fingerprint;
let harvestedTurns = 0;
let totalSubgoals = 0;
let totalUncertainties = 0;
let totalHypotheses = 0;
let totalRejectedPaths = 0;
let finalText = "";
let errorMessage: string | undefined;
if (transcriptStream) {
writeRecord(transcriptStream, {
ts: new Date().toISOString(),
turn: 1,
role: "user",
content: task.prompt,
});
}
try {
for await (const ev of loop.step(task.prompt)) {
if (transcriptStream && ev.role !== "assistant_delta") {
writeRecord(transcriptStream, recordFromLoopEvent(ev, { model, prefixHash }));
}
if (ev.role === "assistant_final") {
finalText = ev.content;
if (ev.planState) {
if (
ev.planState.subgoals.length +
ev.planState.hypotheses.length +
ev.planState.uncertainties.length +
ev.planState.rejectedPaths.length >
0
) {
harvestedTurns++;
totalSubgoals += ev.planState.subgoals.length;
totalHypotheses += ev.planState.hypotheses.length;
totalUncertainties += ev.planState.uncertainties.length;
totalRejectedPaths += ev.planState.rejectedPaths.length;
}
}
} else if (ev.role === "done") {
finalText = ev.content || finalText;
break;
} else if (ev.role === "error") {
throw new Error(ev.error ?? "loop error");
}
}
} catch (err) {
errorMessage = (err as Error).message;
}
const verdict = errorMessage ? { verdict: "fail" as const, note: errorMessage } : task.check(finalText);
return {
taskId: task.id,
mode,
repeat: rep + 1,
verdict: verdict.verdict,
checkNote: verdict.note,
finalAgentMessage: finalText,
turns: loop.stats.turns.length,
cacheHitRatio: loop.stats.aggregateCacheHitRatio,
costUsd: loop.stats.totalCost,
claudeEquivalentUsd: loop.stats.turns.reduce((s, t) => s + claudeEquivalentCost(t.usage), 0),
harvestedTurns,
totalSubgoals,
totalUncertainties,
totalHypotheses,
totalRejectedPaths,
errorMessage,
};
}
// ---------- dry mode ----------
function runDry(args: CliArgs): HarvestBenchReport {
const tasks = filterTasks(args.taskFilter);
const results: HarvestRunResult[] = [];
for (const task of tasks) {
// Exercise each checker with a deliberately wrong reply so we know
// the wiring is live — not a pass on empty.
const sanity = task.check("Answer: this is not the right answer at all");
console.log(`[${task.id}] checker exercises ok (sanity verdict=${sanity.verdict})`);
for (const mode of args.modes) {
results.push({
taskId: task.id,
mode,
repeat: 1,
verdict: "inconclusive",
checkNote: "dry-run (no model call)",
finalAgentMessage: "[dry-run]",
turns: 0,
cacheHitRatio: 0,
costUsd: 0,
claudeEquivalentUsd: 0,
harvestedTurns: 0,
totalSubgoals: 0,
totalUncertainties: 0,
totalHypotheses: 0,
totalRejectedPaths: 0,
});
}
}
return { meta: buildMeta(args, tasks.length), results };
}
// ---------- main ----------
function filterTasks(filter: string | null): HarvestTask[] {
if (!filter) return TASKS;
const t = TASKS.find((x) => x.id === filter);
if (!t) throw new Error(`unknown task: ${filter}`);
return [t];
}
function buildMeta(args: CliArgs, taskCount: number): HarvestBenchMeta {
return {
date: new Date().toISOString(),
repeatsPerTask: args.repeats,
taskCount,
modesRun: args.modes,
reasonixVersion: "0.2.2",
};
}
async function main(): Promise<void> {
const args = parseArgs(process.argv.slice(2));
if (args.dry) {
const report = runDry(args);
writeReport(report, args.outPath);
return;
}
const client = new DeepSeekClient({ timeoutMs: args.timeoutMs });
const tasks = filterTasks(args.taskFilter);
if (args.transcriptsDir) mkdirSync(args.transcriptsDir, { recursive: true });
const results: HarvestRunResult[] = [];
for (const task of tasks) {
for (let rep = 0; rep < args.repeats; rep++) {
for (const mode of args.modes) {
let stream: WriteStream | null = null;
if (args.transcriptsDir) {
const fname = `${task.id}.${mode}.r${rep + 1}.jsonl`;
stream = openTranscriptFile(join(args.transcriptsDir, fname), {
version: 1,
source: `harvest-bench/${mode}`,
model: modelForMode(mode),
task: task.id,
mode,
repeat: rep + 1,
startedAt: new Date().toISOString(),
});
}
const started = Date.now();
let result: HarvestRunResult;
try {
result = await runOnce(task, mode, rep, client, stream);
} finally {
stream?.end();
}
const elapsed = ((Date.now() - started) / 1000).toFixed(1);
console.log(
`[${task.id}/${mode}/r${rep + 1}] verdict=${result.verdict}` +
` cache=${(result.cacheHitRatio * 100).toFixed(1)}%` +
` cost=$${result.costUsd.toFixed(6)}` +
` harvest=${result.harvestedTurns}:${result.totalSubgoals}s/${result.totalUncertainties}u` +
` (${elapsed}s)` +
(result.checkNote ? ` ${result.checkNote}` : ""),
);
results.push(result);
}
}
}
const report: HarvestBenchReport = { meta: buildMeta(args, tasks.length), results };
writeReport(report, args.outPath);
}
function writeReport(report: HarvestBenchReport, outPath: string | null): void {
const path =
outPath ?? `benchmarks/harvest/results-${new Date().toISOString().replace(/[:.]/g, "-")}.json`;
writeFileSync(path, `${JSON.stringify(report, null, 2)}\n`, "utf8");
console.log(`wrote ${path}`);
}
function isMain(): boolean {
const entry = process.argv[1];
if (!entry) return false;
return import.meta.url === pathToFileURL(entry).href;
}
if (isMain()) {
main().catch((err) => {
console.error(err);
process.exit(1);
});
}
export { main as runHarvestBench };
+171
View File
@@ -0,0 +1,171 @@
/**
* Seed reasoning tasks for the harvest eval harness.
*
* Each task has:
* - a minimal system prompt (so the comparison is about the model, not
* the prompt)
* - a single user question
* - a deterministic checker (regex + set/value compare)
*
* When adding a new task, prefer problems where:
* - the answer has a clean shape (a number, a small set, a yes/no +
* explanation) — easier to check
* - reasoning actually matters (so harvest has signal to extract);
* trivia questions are out of scope
* - there's a known-good answer; judgment calls are out of scope
*/
import type { HarvestTask } from "./types.js";
const CONCISE_SYSTEM = `You are a precise reasoner. Think carefully, then state your final answer on a clearly-labeled line starting with "Answer:".`;
/**
* Parse all non-negative integers out of a string. Handles commas,
* ranges written as "2-4" (expands to 2,3,4), and ignores numbers that
* look like formula references (e.g. "n^2", "mod 7") by only accepting
* integers after we strip common LaTeX decorations.
*/
function extractIntegers(text: string): number[] {
// Strip LaTeX delimiters so n_1 / n^2 / \{ ... \} don't confuse us.
const cleaned = text
.replace(/\\[a-zA-Z]+/g, " ") // \frac, \mod etc.
.replace(/[{}\\]/g, " ")
.replace(/[_^]\d+/g, " "); // subscript/superscript numbers
// Expand ranges: "2-4" → "2,3,4" (only for small gaps)
const rangeExpanded = cleaned.replace(/(\d+)\s*[-–]\s*(\d+)/g, (_, a, b) => {
const lo = Number.parseInt(a, 10);
const hi = Number.parseInt(b, 10);
if (!Number.isFinite(lo) || !Number.isFinite(hi) || hi - lo > 50) return `${a} ${b}`;
const out: number[] = [];
for (let i = Math.min(lo, hi); i <= Math.max(lo, hi); i++) out.push(i);
return out.join(" ");
});
const matches = rangeExpanded.match(/-?\d+/g) ?? [];
return matches.map((m) => Number.parseInt(m, 10)).filter((n) => Number.isFinite(n));
}
/** Extract content after the last "Answer:" label (case-insensitive). */
function extractAnswerLine(text: string): string {
const matches = [...text.matchAll(/answer\s*[::]\s*([^\n]+)/gi)];
if (matches.length === 0) return text;
return matches[matches.length - 1]![1]!.trim();
}
// ---------- expected answers ----------
/** Positive n ≤ 100 such that n^2 + n + 1 ≡ 0 (mod 7). */
const MOD7_EXPECTED: number[] = (() => {
const out: number[] = [];
for (let n = 1; n <= 100; n++) {
if ((n * n + n + 1) % 7 === 0) out.push(n);
}
return out;
})();
/**
* Single-integer checker. Pulls the first plausible integer from the last
* "Answer:" line; compares for exact equality.
*/
function checkSingleInt(expected: number) {
return (reply: string) => {
const answerLine = extractAnswerLine(reply);
const nums = extractIntegers(answerLine);
if (nums.length === 0) return { verdict: "fail" as const, note: "no number in Answer line" };
const n = nums[0]!;
if (n === expected) return { verdict: "pass" as const };
return { verdict: "fail" as const, note: `got ${n}, expected ${expected}` };
};
}
// ---------- tasks ----------
export const TASKS: HarvestTask[] = [
{
id: "mod7_list",
description:
"Number theory — find all positive n ≤ 100 with n^2+n+1 ≡ 0 (mod 7). 29-element set. Classic R1 scratch-work territory.",
systemPrompt: CONCISE_SYSTEM,
prompt:
"Find all positive integers n with n ≤ 100 such that n^2 + n + 1 is divisible by 7. Briefly justify, then end with the full list on a line starting with \"Answer:\".",
check: (reply) => {
const answerLine = extractAnswerLine(reply);
const found = new Set(extractIntegers(answerLine).filter((n) => n >= 1 && n <= 100));
const expected = new Set(MOD7_EXPECTED);
if (found.size === 0) {
return { verdict: "fail", note: "no integers extracted from Answer line" };
}
// Exact set equality — both containment directions.
for (const n of expected) if (!found.has(n)) return { verdict: "fail", note: `missing n=${n}` };
for (const n of found) if (!expected.has(n)) return { verdict: "fail", note: `extra n=${n}` };
return { verdict: "pass" };
},
},
{
id: "flips_until_3heads",
description:
"Probability — expected coin flips until 3 consecutive heads. Answer: 14. Tests whether R1 derives via recurrence or via memorized result.",
systemPrompt: CONCISE_SYSTEM,
prompt:
"A fair coin is flipped repeatedly until you see 3 heads in a row. What is the expected number of total flips? Give a single integer on a line starting with \"Answer:\".",
check: (reply) => {
const answerLine = extractAnswerLine(reply);
const nums = extractIntegers(answerLine);
if (nums.length === 0) return { verdict: "fail", note: "no number in Answer line" };
// Accept the first sensible number — sometimes agents write "Answer: 14 flips".
const n = nums[0]!;
if (n === 14) return { verdict: "pass" };
return { verdict: "fail", note: `got ${n}, expected 14` };
},
},
{
id: "three_hats",
description:
"Logic — three people wear red/blue hats, at least one red, they're asked in order. First two say no, third says yes. What color? Answer: red (deducible because if third were blue, the first two could see one red + one unknown and wouldn't have said no on their full first round, for most configurations the third can only be certain if red).",
systemPrompt: CONCISE_SYSTEM,
prompt:
'Three people wear hats that are each red or blue. They are told at least one hat is red. Each can see the other two hats but not their own. They are asked in order: "Do you know your hat color?" The first two answer no. The third answers yes. What color is the third person\'s hat? Give a one-word answer on a line starting with "Answer:".',
check: (reply) => {
const answerLine = extractAnswerLine(reply).toLowerCase();
// Accept "red" as a standalone word (not "redirected" etc).
if (/\bred\b/.test(answerLine) && !/\bblue\b/.test(answerLine)) {
return { verdict: "pass" };
}
if (/\bblue\b/.test(answerLine)) return { verdict: "fail", note: "answered blue" };
return { verdict: "fail", note: "no clear color in Answer line" };
},
},
// ---------- hard tasks (picked for known V3 failure modes) ----------
{
id: "pseudoprime_base2",
description:
"Number theory — smallest composite n > 1 such that 2^n ≡ 2 (mod n). This is the smallest Fermat pseudoprime to base 2. Answer: 341 (= 11·31). V3 frequently answers 561 (Carmichael / wrong base-2 property) or 9 (not actually a pseudoprime to base 2, verifying the model isn't computing). R1 usually gets this right.",
systemPrompt: CONCISE_SYSTEM,
prompt:
'Find the smallest composite integer n > 1 such that 2^n is congruent to 2 modulo n (i.e., n is a Fermat pseudoprime to base 2). Briefly justify, then give a single integer on a line starting with "Answer:".',
check: checkSingleInt(341),
},
{
id: "derangements_d7",
description:
"Combinatorics — number of derangements of 7 elements. Answer: 1854 (D_7 = 7! · (1 − 1/1! + 1/2! − 1/3! + … ± 1/7!) = 5040 · 0.367857… = 1854). V3 sometimes approximates via n!/e and rounds wrong, or confuses with D_6=265 or D_8=14833. R1's explicit recurrence D_n = (n-1)(D_{n-1}+D_{n-2}) avoids the mistake.",
systemPrompt: CONCISE_SYSTEM,
prompt:
'How many permutations of {1, 2, 3, 4, 5, 6, 7} have no fixed points? (This is D_7, the derangement number.) Briefly justify, then give a single integer on a line starting with "Answer:".',
check: checkSingleInt(1854),
},
{
id: "euler_quadratic_break",
description:
"Number theory — smallest nonneg integer n where n^2 + n + 41 is NOT prime. Euler's prime-generating polynomial famously produces primes for n = 0..39 and first fails at n = 40 (40²+40+41 = 1681 = 41²). V3 often confuses this with the related n²-n+41 (first fails at 41) or cites the wrong threshold. R1 checks small n systematically.",
systemPrompt: CONCISE_SYSTEM,
prompt:
'Consider the polynomial f(n) = n^2 + n + 41 for n = 0, 1, 2, …. What is the smallest nonneg integer n at which f(n) fails to be prime? Briefly justify (including the value of f(n) at that point), then give just the integer n on a line starting with "Answer:".',
check: checkSingleInt(40),
},
];
+82
View File
@@ -0,0 +1,82 @@
/**
* Types for the harvest eval harness.
*
* Scope: this is deliberately NOT τ-bench-lite. These tasks:
* - are single-turn Q/A (no user simulator, no DB)
* - target reasoning-heavy problems (math, logic, planning)
* - use deterministic checkers (regex extraction + set/value compare),
* never an LLM judge
*
* The point is to measure Pillar 2 (harvest) the same way τ-bench-lite
* measures Pillar 1 (cache-first): isolate one variable, produce numbers
* anyone can reproduce.
*/
export type HarvestMode =
/** deepseek-chat, no Reasonix tricks. Floor reference for answer quality on reasoning tasks (V3 at its best). */
| "baseline"
/** deepseek-reasoner, no harvest. Isolates "does reasoner help over chat on these problems?" */
| "reasoner"
/** deepseek-reasoner + harvest. Isolates "does the extra V3 harvest call add quality / change behavior?" */
| "reasoner-harvest";
export const ALL_MODES: HarvestMode[] = ["baseline", "reasoner", "reasoner-harvest"];
/**
* Checker verdict. We don't use boolean directly because "maybe" is real
* — e.g. "answer in the right shape but can't verify without running the
* program". For v0.3 we only use {pass, fail}, but the shape leaves room.
*/
export type CheckVerdict = "pass" | "fail" | "inconclusive";
export interface HarvestTask {
id: string;
/** One-line human description, not shown to the model. */
description: string;
/** System prompt. Kept minimal so harvest signal can be attributed to the model, not to prompt engineering. */
systemPrompt: string;
/** The single question. */
prompt: string;
/**
* Check the agent's final reply. Returns pass/fail/inconclusive plus an
* optional one-line explanation the report can surface.
*
* IMPORTANT: must be pure and deterministic. No LLM calls, no file I/O.
*/
check: (agentReply: string) => { verdict: CheckVerdict; note?: string };
}
export interface HarvestRunResult {
taskId: string;
mode: HarvestMode;
repeat: number;
verdict: CheckVerdict;
checkNote?: string;
finalAgentMessage: string;
/** Turns the loop completed (usually 1 for a single-shot Q/A, > 1 if tool-calls happen). */
turns: number;
cacheHitRatio: number;
costUsd: number;
claudeEquivalentUsd: number;
/** Harvest-specific — only non-zero on reasoner-harvest mode. */
harvestedTurns: number;
totalSubgoals: number;
totalUncertainties: number;
totalHypotheses: number;
totalRejectedPaths: number;
/** Optional error message if the run crashed (model down, timeout, etc). */
errorMessage?: string;
}
export interface HarvestBenchMeta {
date: string;
repeatsPerTask: number;
taskCount: number;
modesRun: HarvestMode[];
reasonixVersion: string;
}
export interface HarvestBenchReport {
meta: HarvestBenchMeta;
results: HarvestRunResult[];
}
+178
View File
@@ -0,0 +1,178 @@
/**
* Naive baseline runner — deliberately does NOT use CacheFirstLoop.
*
* For the benchmark comparison to be honest, this runner must reproduce
* what a "typical" agent framework does that breaks DeepSeek's automatic
* prefix cache:
*
* 1. Inject a fresh timestamp into the system prompt every turn.
* 2. Re-serialize the tool list each turn with a shuffled key order.
* 3. Rebuild the full message array each turn rather than appending.
*
* These are all things frameworks like LangChain/LangGraph do by default
* (either directly, or because tool specs are regenerated from Python dicts
* with non-deterministic ordering, or because a "current_time" placeholder
* is recommended in common system-prompt recipes).
*
* Reuses DeepSeekClient, ToolRegistry, and SessionStats so the *only*
* difference from the Reasonix run is prefix stability.
*/
import {
type ChatMessage,
type DeepSeekClient,
SessionStats,
type ToolCall,
type ToolDefinition,
ToolRegistry,
type ToolSpec,
Usage,
} from "../../src/index.js";
import type { Turn } from "./types.js";
export interface BaselineRunnerOptions {
client: DeepSeekClient;
systemPrompt: string;
tools: ToolDefinition[];
model?: string;
maxToolIters?: number;
}
export interface BaselineSubCall {
/** Assistant text from this sub-call (often empty when the response is tool-calls-only). */
content: string;
/** Usage for this single client.chat() call. */
usage: Usage;
/** Tools the model chose to call on the back of this response. */
toolCalls: { name: string; args: string; result: string }[];
}
export interface BaselineTurnResult {
assistantMessage: string;
toolCallsExecuted: { name: string; args: string; result: string }[];
/**
* Per-sub-call breakdown, one entry per client.chat() invocation. Gives
* downstream tools (bench transcripts) the same granularity as Reasonix
* loop events — without it, diff can't compare model-call counts
* apples-to-apples.
*/
subCalls: BaselineSubCall[];
/** Turn number (1-based) assigned by the agent. */
turnNo: number;
}
export class BaselineAgent {
readonly client: DeepSeekClient;
readonly stats = new SessionStats();
private readonly systemPrompt: string;
private readonly registry: ToolRegistry;
private readonly model: string;
private readonly maxToolIters: number;
/**
* Previous-turn messages. A naive framework keeps these, but we still
* rebuild the prefix around them each turn so the byte prefix churns.
*/
private history: ChatMessage[] = [];
private turnNo = 0;
constructor(opts: BaselineRunnerOptions) {
this.client = opts.client;
this.systemPrompt = opts.systemPrompt;
this.model = opts.model ?? "deepseek-chat";
this.maxToolIters = opts.maxToolIters ?? 6;
this.registry = new ToolRegistry({ autoFlatten: false });
for (const t of opts.tools) this.registry.register(t);
}
/**
* Run one user-turn: sends the user message, lets the model do tool
* calls until it stops, returns the final assistant text.
*
* Intentionally non-cache-friendly: rebuilds the prefix with a fresh
* timestamp + re-shuffled tool specs every turn.
*/
async userTurn(userMessage: string, transcript: Turn[]): Promise<BaselineTurnResult> {
this.turnNo++;
// Naive pattern #1: current-time placeholder in the system prompt.
const churnedSystem = `${this.systemPrompt}\nCurrent time: ${new Date().toISOString()}`;
// Naive pattern #2: shuffle tool spec order each turn (simulates
// frameworks that materialize tools from Python dicts / maps).
const shuffledTools = shuffle(this.registry.specs(), this.turnNo);
this.history.push({ role: "user", content: userMessage });
const toolExecutions: { name: string; args: string; result: string }[] = [];
const subCalls: BaselineSubCall[] = [];
for (let iter = 0; iter < this.maxToolIters; iter++) {
// Naive pattern #3: always rebuild the full message array.
const messages: ChatMessage[] = [{ role: "system", content: churnedSystem }, ...this.history];
const resp = await this.client.chat({
model: this.model,
messages,
tools: shuffledTools,
});
this.stats.record(this.turnNo, this.model, resp.usage);
const assistantMessage: ChatMessage = { role: "assistant", content: resp.content };
if (resp.toolCalls.length > 0) assistantMessage.tool_calls = resp.toolCalls;
this.history.push(assistantMessage);
if (resp.toolCalls.length === 0) {
subCalls.push({ content: resp.content, usage: resp.usage, toolCalls: [] });
return {
assistantMessage: resp.content,
toolCallsExecuted: toolExecutions,
subCalls,
turnNo: this.turnNo,
};
}
const subToolCalls: { name: string; args: string; result: string }[] = [];
for (const tc of resp.toolCalls) {
const name = tc.function?.name ?? "";
const args = tc.function?.arguments ?? "{}";
const result = await this.registry.dispatch(name, args);
toolExecutions.push({ name, args, result });
subToolCalls.push({ name, args, result });
this.history.push({
role: "tool",
tool_call_id: tc.id ?? "",
name,
content: result,
});
}
subCalls.push({ content: resp.content, usage: resp.usage, toolCalls: subToolCalls });
}
const lastAssistant = [...this.history].reverse().find((m) => m.role === "assistant");
return {
assistantMessage: lastAssistant?.content ?? "[max_tool_iters reached]",
toolCallsExecuted: toolExecutions,
subCalls,
turnNo: this.turnNo,
};
}
}
/**
* Deterministic Fisher–Yates shuffle seeded by an integer. Same turn number
* → same ordering, so the baseline is reproducible across runs while still
* being cache-hostile (different turns get different orderings).
*/
function shuffle<T>(arr: T[], seed: number): T[] {
const out = [...arr];
let s = seed * 9301 + 49297;
for (let i = out.length - 1; i > 0; i--) {
s = (s * 9301 + 49297) % 233280;
const j = Math.floor((s / 233280) * (i + 1));
[out[i], out[j]] = [out[j]!, out[i]!];
}
return out;
}
// Re-export ToolCall, ToolSpec so caller files don't need to import both places.
export type { ToolCall, ToolSpec };
+30
View File
@@ -0,0 +1,30 @@
import type { WorldState } from "./types.js";
/**
* Deep-clone a WorldState so per-run mutations stay isolated.
* structuredClone is enough — WorldState is JSON-shaped by contract.
*/
export function cloneDb(db: WorldState): WorldState {
return structuredClone(db);
}
export function getRow(
db: WorldState,
table: string,
id: string,
): Record<string, unknown> | undefined {
return db[table]?.[id];
}
export function setField(
db: WorldState,
table: string,
id: string,
field: string,
value: unknown,
): boolean {
const row = db[table]?.[id];
if (!row) return false;
row[field] = value;
return true;
}
+100
View File
@@ -0,0 +1,100 @@
# Reasonix tool-use eval (τ-bench-lite)
**Date:** 2026-04-21T14:57:44.906Z
**Agent model:** `deepseek-chat`
**User-simulator model:** `deepseek-chat`
**Tasks:** 8, repeats × 3
**Reasonix version:** 0.2.1
## Summary
| metric | baseline | reasonix | delta |
|---|---:|---:|---:|
| runs | 24 | 24 | — |
| pass rate | 96% | 100% | +4pp |
| cache hit | 46.6% | 94.4% | **+47.7pp** |
| mean cost / task | $0.002599 | $0.001579 | ×0.61 |
| mean turns | 4.4 | 4.6 | — |
| mean tool calls | 3.0 | 2.7 | — |
**Reasonix vs Claude Sonnet 4.6 (estimated, same token counts):**
Claude would cost ~$0.038203 / task, so Reasonix saves ~96.0%.
(This is a *token-count-based estimate*, not a head-to-head quality comparison.)
## Per-task breakdown
| task | mode | pass | turns | tools | cache | cost |
|---|---|:---:|---:|---:|---:|---:|
| t01_address_happy | baseline | ✅ | 3 | 3 | 53.1% | $0.001383 |
| t01_address_happy | reasonix | ✅ | 3 | 3 | 94.4% | $0.000896 |
| t01_address_happy | baseline | ✅ | 3 | 3 | 53.3% | $0.001405 |
| t01_address_happy | reasonix | ✅ | 3 | 2 | 95.0% | $0.000756 |
| t01_address_happy | baseline | ✅ | 3 | 2 | 44.0% | $0.001193 |
| t01_address_happy | reasonix | ✅ | 3 | 2 | 92.6% | $0.000848 |
| t02_address_not_allowed | baseline | ✅ | 8 | 2 | 23.6% | $0.004647 |
| t02_address_not_allowed | reasonix | ✅ | 8 | 4 | 95.6% | $0.003067 |
| t02_address_not_allowed | baseline | ✅ | 8 | 3 | 29.9% | $0.005585 |
| t02_address_not_allowed | reasonix | ✅ | 8 | 2 | 96.2% | $0.002822 |
| t02_address_not_allowed | baseline | ✅ | 8 | 7 | 50.7% | $0.007021 |
| t02_address_not_allowed | reasonix | ✅ | 8 | 3 | 95.8% | $0.003140 |
| t03_cancel_processing | baseline | ✅ | 3 | 3 | 53.3% | $0.001349 |
| t03_cancel_processing | reasonix | ✅ | 3 | 3 | 94.9% | $0.000803 |
| t03_cancel_processing | baseline | ✅ | 2 | 3 | 64.6% | $0.001041 |
| t03_cancel_processing | reasonix | ✅ | 2 | 2 | 93.8% | $0.000563 |
| t03_cancel_processing | baseline | ✅ | 3 | 3 | 53.4% | $0.001332 |
| t03_cancel_processing | reasonix | ✅ | 2 | 2 | 93.8% | $0.000566 |
| t04_refund_delivered | baseline | ✅ | 2 | 2 | 55.9% | $0.001007 |
| t04_refund_delivered | reasonix | ✅ | 2 | 3 | 91.0% | $0.000911 |
| t04_refund_delivered | baseline | ✅ | 3 | 2 | 44.8% | $0.001268 |
| t04_refund_delivered | reasonix | ✅ | 3 | 3 | 93.2% | $0.000941 |
| t04_refund_delivered | baseline | ✅ | 3 | 3 | 53.5% | $0.001469 |
| t04_refund_delivered | reasonix | ✅ | 3 | 3 | 94.4% | $0.000952 |
| t05_refund_not_delivered | baseline | ✅ | 8 | 4 | 41.7% | $0.005369 |
| t05_refund_not_delivered | reasonix | ✅ | 7 | 2 | 96.3% | $0.002212 |
| t05_refund_not_delivered | baseline | ✅ | 8 | 3 | 30.6% | $0.004762 |
| t05_refund_not_delivered | reasonix | ✅ | 8 | 4 | 95.1% | $0.003159 |
| t05_refund_not_delivered | baseline | ✅ | 6 | 2 | 24.8% | $0.003128 |
| t05_refund_not_delivered | reasonix | ✅ | 6 | 2 | 94.7% | $0.001927 |
| t06_multi_order_lookup | baseline | ✅ | 2 | 2 | 52.4% | $0.000913 |
| t06_multi_order_lookup | reasonix | ✅ | 3 | 2 | 92.7% | $0.000988 |
| t06_multi_order_lookup | baseline | ✅ | 3 | 2 | 41.2% | $0.001530 |
| t06_multi_order_lookup | reasonix | ✅ | 3 | 2 | 93.4% | $0.000996 |
| t06_multi_order_lookup | baseline | ✅ | 3 | 4 | 60.9% | $0.001920 |
| t06_multi_order_lookup | reasonix | ✅ | 3 | 2 | 92.2% | $0.000947 |
| t07_wrong_identity | baseline | ❌ | 2 | 2 | 54.9% | $0.000815 |
| t07_wrong_identity | reasonix | ✅ | 8 | 2 | 95.5% | $0.002777 |
| t07_wrong_identity | baseline | ✅ | 8 | 3 | 26.6% | $0.004953 |
| t07_wrong_identity | reasonix | ✅ | 7 | 2 | 95.6% | $0.002356 |
| t07_wrong_identity | baseline | ✅ | 8 | 3 | 24.0% | $0.005210 |
| t07_wrong_identity | reasonix | ✅ | 8 | 2 | 96.3% | $0.002587 |
| t08_address_then_cancel | baseline | ✅ | 3 | 3 | 53.4% | $0.001465 |
| t08_address_then_cancel | reasonix | ✅ | 3 | 4 | 94.6% | $0.001174 |
| t08_address_then_cancel | baseline | ✅ | 3 | 4 | 62.1% | $0.001677 |
| t08_address_then_cancel | reasonix | ✅ | 3 | 5 | 94.1% | $0.001371 |
| t08_address_then_cancel | baseline | ✅ | 3 | 5 | 66.5% | $0.001933 |
| t08_address_then_cancel | reasonix | ✅ | 3 | 4 | 93.5% | $0.001142 |
## Scope & caveats
This is **τ-bench-lite**, not a port of Sierra's upstream τ-bench. Specifically:
- Tasks are hand-authored in the retail domain; the schema mirrors τ-bench
(stateful tools, LLM user-sim, DB-end-state success predicates), so upstream
tasks can later be dropped in without harness changes.
- Every pass/fail judgment is a deterministic DB predicate — no LLM judge.
Refusal tasks pass iff the DB is unchanged.
- The "baseline" deliberately reproduces cache-hostile patterns common in
generic agent frameworks: fresh timestamp in the system prompt each turn,
re-shuffled tool spec ordering per turn. It is **not** a benchmark of
LangChain specifically.
- Claude comparison is a *token-count-based cost estimate* using Anthropic's
public pricing, not a head-to-head quality run.
- User simulator is DeepSeek V3 at T=0.1. Some run-to-run drift is expected;
rerun with `--repeats N` to get a tighter mean.
## Reproducing
1. `export DEEPSEEK_API_KEY=sk-...`
2. `npm install`
3. `npx tsx benchmarks/tau-bench/runner.ts --repeats 3`
4. `npx tsx benchmarks/tau-bench/report.ts benchmarks/tau-bench/results-*.json`
+225
View File
@@ -0,0 +1,225 @@
/**
* Render a results-*.json into a human-readable report.md.
*
* npx tsx benchmarks/tau-bench/report.ts benchmarks/tau-bench/results-<date>.json
* npx tsx benchmarks/tau-bench/report.ts <input.json> --out report.md
*/
import { readFileSync, writeFileSync } from "node:fs";
import { pathToFileURL } from "node:url";
import type { BenchReport, RunMode, RunResult } from "./types.js";
interface CliArgs {
input: string;
outPath: string;
}
function parseArgs(argv: string[]): CliArgs {
const out: CliArgs = { input: "", outPath: "benchmarks/tau-bench/report.md" };
const positional: string[] = [];
for (let i = 0; i < argv.length; i++) {
const a = argv[i];
if (a === "--out") out.outPath = argv[++i] ?? out.outPath;
else if (a && !a.startsWith("--")) positional.push(a);
}
out.input = positional[0] ?? "";
if (!out.input) {
throw new Error(
"usage: npx tsx benchmarks/tau-bench/report.ts <results.json> [--out report.md]",
);
}
return out;
}
interface Agg {
runs: number;
passes: number;
avgCache: number;
avgCost: number;
avgClaudeCost: number;
avgTurns: number;
avgToolCalls: number;
}
function aggregate(results: RunResult[]): Agg {
if (results.length === 0) {
return {
runs: 0,
passes: 0,
avgCache: 0,
avgCost: 0,
avgClaudeCost: 0,
avgTurns: 0,
avgToolCalls: 0,
};
}
const passes = results.filter((r) => r.pass).length;
const mean = (fn: (r: RunResult) => number) =>
results.reduce((s, r) => s + fn(r), 0) / results.length;
return {
runs: results.length,
passes,
avgCache: mean((r) => r.cacheHitRatio),
avgCost: mean((r) => r.costUsd),
avgClaudeCost: mean((r) => r.claudeEquivalentUsd),
avgTurns: mean((r) => r.turns),
avgToolCalls: mean((r) => r.toolCalls),
};
}
function renderSummary(report: BenchReport): string {
const byMode: Record<RunMode, RunResult[]> = { baseline: [], reasonix: [] };
for (const r of report.results) byMode[r.mode].push(r);
const b = aggregate(byMode.baseline);
const rx = aggregate(byMode.reasonix);
const costRatio = b.avgCost > 0 ? rx.avgCost / b.avgCost : 0;
const claudeSavings = b.avgClaudeCost > 0 ? (1 - rx.avgCost / b.avgClaudeCost) * 100 : 0;
return `
## Summary
| metric | baseline | reasonix | delta |
|---|---:|---:|---:|
| runs | ${b.runs} | ${rx.runs} | — |
| pass rate | ${pct(b.passes, b.runs)} | ${pct(rx.passes, rx.runs)} | ${signPct(rx.passes, rx.runs, b.passes, b.runs)} |
| cache hit | ${pct1(b.avgCache)} | ${pct1(rx.avgCache)} | **${signPctAbs(rx.avgCache - b.avgCache)}** |
| mean cost / task | $${fmt(b.avgCost, 6)} | $${fmt(rx.avgCost, 6)} | ${costRatio > 0 ? `×${fmt(costRatio, 2)}` : "—"} |
| mean turns | ${fmt(b.avgTurns, 1)} | ${fmt(rx.avgTurns, 1)} | — |
| mean tool calls | ${fmt(b.avgToolCalls, 1)} | ${fmt(rx.avgToolCalls, 1)} | — |
**Reasonix vs Claude Sonnet 4.6 (estimated, same token counts):**
Claude would cost ~$${fmt(rx.avgClaudeCost, 6)} / task, so Reasonix saves ~${fmt(
claudeSavings,
1,
)}%.
(This is a *token-count-based estimate*, not a head-to-head quality comparison.)
`.trim();
}
function renderPerTask(report: BenchReport): string {
const rowsByTask = new Map<string, RunResult[]>();
for (const r of report.results) {
const list = rowsByTask.get(r.taskId) ?? [];
list.push(r);
rowsByTask.set(r.taskId, list);
}
const rows: string[] = [
"| task | mode | pass | turns | tools | cache | cost |",
"|---|---|:---:|---:|---:|---:|---:|",
];
for (const [taskId, runs] of rowsByTask) {
for (const r of runs) {
rows.push(
`| ${taskId} | ${r.mode} | ${r.pass ? "✅" : "❌"} | ${r.turns} | ${r.toolCalls} | ${pct1(
r.cacheHitRatio,
)} | $${fmt(r.costUsd, 6)} |${r.errorMessage ? ` err: ${truncate(r.errorMessage, 40)}` : ""}`,
);
}
}
return `## Per-task breakdown\n\n${rows.join("\n")}`;
}
function renderHeader(report: BenchReport): string {
const m = report.meta;
return `# Reasonix tool-use eval (τ-bench-lite)
**Date:** ${m.date}
**Agent model:** \`${m.model}\`
**User-simulator model:** \`${m.userSimModel}\`
**Tasks:** ${m.taskCount}, repeats × ${m.repeatsPerTask}
**Reasonix version:** ${m.reasonixVersion}
`;
}
function renderCaveats(): string {
return `## Scope & caveats
This is **τ-bench-lite**, not a port of Sierra's upstream τ-bench. Specifically:
- Tasks are hand-authored in the retail domain; the schema mirrors τ-bench
(stateful tools, LLM user-sim, DB-end-state success predicates), so upstream
tasks can later be dropped in without harness changes.
- Every pass/fail judgment is a deterministic DB predicate — no LLM judge.
Refusal tasks pass iff the DB is unchanged.
- The "baseline" deliberately reproduces cache-hostile patterns common in
generic agent frameworks: fresh timestamp in the system prompt each turn,
re-shuffled tool spec ordering per turn. It is **not** a benchmark of
LangChain specifically.
- Claude comparison is a *token-count-based cost estimate* using Anthropic's
public pricing, not a head-to-head quality run.
- User simulator is DeepSeek V3 at T=0.1. Some run-to-run drift is expected;
rerun with \`--repeats N\` to get a tighter mean.
## Reproducing
1. \`export DEEPSEEK_API_KEY=sk-...\`
2. \`npm install\`
3. \`npx tsx benchmarks/tau-bench/runner.ts --repeats 3\`
4. \`npx tsx benchmarks/tau-bench/report.ts benchmarks/tau-bench/results-*.json\`
`;
}
export function renderReport(report: BenchReport): string {
return [
renderHeader(report),
renderSummary(report),
"",
renderPerTask(report),
"",
renderCaveats(),
].join("\n");
}
// ---------- formatting helpers ----------
function pct(num: number, denom: number): string {
if (denom === 0) return "—";
return `${((num / denom) * 100).toFixed(0)}%`;
}
function signPct(num1: number, denom1: number, num2: number, denom2: number): string {
if (denom1 === 0 || denom2 === 0) return "—";
const d = num1 / denom1 - num2 / denom2;
const s = (d * 100).toFixed(0);
return `${d >= 0 ? "+" : ""}${s}pp`;
}
function signPctAbs(diff: number): string {
const s = (diff * 100).toFixed(1);
return `${diff >= 0 ? "+" : ""}${s}pp`;
}
function pct1(x: number): string {
return `${(x * 100).toFixed(1)}%`;
}
function fmt(x: number, digits: number): string {
return x.toFixed(digits);
}
function truncate(s: string, n: number): string {
return s.length > n ? `${s.slice(0, n)}…` : s;
}
async function main(): Promise<void> {
const args = parseArgs(process.argv.slice(2));
const raw = readFileSync(args.input, "utf8");
const report = JSON.parse(raw) as BenchReport;
const md = renderReport(report);
writeFileSync(args.outPath, md, "utf8");
console.log(`wrote ${args.outPath} (${report.results.length} runs)`);
}
function isMain(): boolean {
const entry = process.argv[1];
if (!entry) return false;
return import.meta.url === pathToFileURL(entry).href;
}
if (isMain()) {
main().catch((err) => {
console.error(err);
process.exit(1);
});
}
+684
View File
@@ -0,0 +1,684 @@
{
"meta": {
"date": "2026-04-21T14:57:44.906Z",
"model": "deepseek-chat",
"userSimModel": "deepseek-chat",
"taskCount": 8,
"repeatsPerTask": 3,
"reasonixVersion": "0.2.1"
},
"results": [
{
"taskId": "t01_address_happy",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.531435349940688,
"costUsd": 0.0013829700000000003,
"claudeEquivalentUsd": 0.023388000000000003,
"promptTokens": 5901,
"completionTokens": 379,
"truncated": false,
"finalAgentMessage": "Success! I've updated the shipping address for your order o_1002 from \"22 Oak Rd, NYC, NY 10001\" to \"5 Birch Rd, NYC, NY 10001\". \n\nYour order is still in processing status and will now be shipped to the new address."
},
{
"taskId": "t01_address_happy",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.9444063143445436,
"costUsd": 0.0008962600000000001,
"claudeEquivalentUsd": 0.023259000000000002,
"promptTokens": 5828,
"completionTokens": 385,
"truncated": false,
"finalAgentMessage": "Success! I've updated the shipping address for your order o_1002 to **5 Birch Rd, NYC, NY 10001**. \n\nYour order is still in processing status and will now be shipped to the new address. Is there anything else you need help with today?"
},
{
"taskId": "t01_address_happy",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.533242645808536,
"costUsd": 0.00140507,
"claudeEquivalentUsd": 0.023703,
"promptTokens": 5881,
"completionTokens": 404,
"truncated": false,
"finalAgentMessage": "Great! I've successfully updated the shipping address for your order o_1002. The new address is now: **5 Birch Rd, NYC, NY 10001**.\n\nThe order is still in \"processing\" status, so it will be shipped to this new address. Is there anything else I can help you with?"
},
{
"taskId": "t01_address_happy",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.9502183406113537,
"costUsd": 0.0007556,
"claudeEquivalentUsd": 0.01905,
"promptTokens": 4580,
"completionTokens": 354,
"truncated": false,
"finalAgentMessage": "Success! I've updated the shipping address for your order o_1002 to \"5 Birch Rd, NYC, NY 10001\". Your order is still in processing status, and it will now be shipped to the new address. Is there anything else I can help you with today?"
},
{
"taskId": "t01_address_happy",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.44005156854318866,
"costUsd": 0.00119348,
"claudeEquivalentUsd": 0.018687000000000002,
"promptTokens": 4654,
"completionTokens": 315,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully updated the shipping address for your order o_1002. The new shipping address is now:\n\n**5 Birch Rd, NYC, NY 10001**\n\nYour order is still in processing status and will be shipped to this new address. Is there anything else I can help you with?"
},
{
"taskId": "t01_address_happy",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.9257604764943629,
"costUsd": 0.00084767,
"claudeEquivalentUsd": 0.020223,
"promptTokens": 4701,
"completionTokens": 408,
"truncated": false,
"finalAgentMessage": "Success! I've updated the shipping address for your order o_1002. The new shipping address is now: **5 Birch Rd, NYC, NY 10001**.\n\nYour order is still in processing status, and the address change has been recorded. Is there anything else I can help you with today?"
},
{
"taskId": "t02_address_not_allowed",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 2,
"cacheHitRatio": 0.2358892823588928,
"costUsd": 0.0046473899999999995,
"claudeEquivalentUsd": 0.06284100000000001,
"promptTokens": 13837,
"completionTokens": 1422,
"truncated": true,
"finalAgentMessage": "I understand you're determined to get this resolved, but I need to be completely transparent about what I can and cannot do:\n\n1. **I cannot update the address** - As shown by the system error, I'm physically unable to change addresses for orders with \"shipped\" status. The tool returns an error and won't allow the change.\n\n2. **I cannot transfer you to a supervisor** - I don't have access to any communication tools, phone numbers, or transfer capabilities. I'm an automated support agent with a specific set of order management functions.\n\n3. **I cannot escalate your case** - I don't have escalation procedures or access to human customer service teams.\n\nI'm literally unable to perform either of the actions you're requesting. Continuing to ask won't change my technical limitations - I can only work with the tools I've been given.\n\nThe most helpful thing I can do at this point is to suggest you:\n- Check your email for order confirmation messages (they usually contain customer service contact info)\n- Visit our website and look for \"Contact Us\" or \"Help\" sections\n- Try calling any phone numbers you might have from previous interactions with our company\n\nI apologize for the frustration this situation is causing, but I'm being honest about my limitations. Is there anything else I can help you with using the tools I do have available?"
},
{
"taskId": "t02_address_not_allowed",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 4,
"cacheHitRatio": 0.9560694920880823,
"costUsd": 0.0030673800000000006,
"claudeEquivalentUsd": 0.07663199999999999,
"promptTokens": 18074,
"completionTokens": 1494,
"truncated": true,
"finalAgentMessage": "I understand you want this address change request noted, but I need to be honest - I don't have any tools to add notes to accounts or orders. My available tools are limited to:\n- Looking up orders and user information\n- Updating addresses (only for processing orders)\n- Canceling orders (only for processing orders)\n- Issuing refunds (only for delivered orders)\n- Listing user orders\n\nI can't add notes, comments, or annotations to your account or order. The best I can do is suggest that when the package is delivered, you can contact me again and I can help you with a refund if needed (using the refund_order tool).\n\nFor now, I would strongly recommend:\n1. Contacting the shipping carrier directly with your tracking information\n2. Reaching out to our customer service team via email or phone\n3. Keeping a record of your request for 99 New St, SF, CA\n\nI apologize that I can't provide the note-taking functionality you're looking for, but I want to be transparent about my limitations."
},
{
"taskId": "t02_address_not_allowed",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 3,
"cacheHitRatio": 0.29918476711704006,
"costUsd": 0.00558507,
"claudeEquivalentUsd": 0.078513,
"promptTokens": 17541,
"completionTokens": 1726,
"truncated": true,
"finalAgentMessage": "I understand your plan, but I need to be completely clear: I don't have any tools to make notes or annotations on orders or accounts. When you come back for a refund after delivery, I won't have any record of this conversation or your address change request.\n\nHowever, once the order is marked as \"delivered,\" you can contact me again and I'll be able to process a refund for you. At that time, you'll need to provide:\n1. Your name and order ID again\n2. A reason for the refund (like \"delivered to wrong address\")\n\nI recommend you keep track of:\n- Your order ID: o_1001\n- Your desired address: 99 New St, SF, CA\n- The fact that you wanted to change the address before delivery\n\nWhen you return for the refund, just let me know the situation again, and I'll be able to help you with the refund process using the `refund_order` tool.\n\nIs there anything else I can help you with right now?"
},
{
"taskId": "t02_address_not_allowed",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 2,
"cacheHitRatio": 0.9616535218928475,
"costUsd": 0.0028220600000000004,
"claudeEquivalentUsd": 0.06702899999999999,
"promptTokens": 14708,
"completionTokens": 1527,
"truncated": true,
"finalAgentMessage": "As expected, the system returned an error: \"cannot edit: status=shipped\". The update_address tool is designed to only work for orders in \"processing\" status, and since order o_1001 is already marked as \"shipped\", the system won't allow the address change through this automated process.\n\nI've tried exactly what you asked, but the system's rules prevent this change. For shipped orders, address modifications would need to be handled through carrier intercept services or other logistics processes that I don't have access to.\n\nIs there anything else I can help you with using my available tools?"
},
{
"taskId": "t02_address_not_allowed",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 7,
"cacheHitRatio": 0.5073297860788359,
"costUsd": 0.0070210900000000015,
"claudeEquivalentUsd": 0.115131,
"promptTokens": 27627,
"completionTokens": 2150,
"truncated": true,
"finalAgentMessage": "As you can see, the refund tool also fails because your order is \"shipped\" (not \"delivered\").\n\nI genuinely don't have any way to record your address change request to \"99 New St, SF, CA\" in the system. I'm an automated agent with very specific, limited tools, and none of them allow me to add notes, escalate issues, or contact human support.\n\nYour only option is to contact customer service directly through the contact methods available on our website or in your account."
},
{
"taskId": "t02_address_not_allowed",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 3,
"cacheHitRatio": 0.958138999251454,
"costUsd": 0.0031397900000000004,
"claudeEquivalentUsd": 0.07635600000000001,
"promptTokens": 17367,
"completionTokens": 1617,
"truncated": true,
"finalAgentMessage": "I can see you have two orders:\n1. o_1001 - wool sweater M - shipped (the one you're asking about)\n2. o_1005 - notebook pack - delivered\n\nUnfortunately, both orders are either shipped or delivered, so I cannot update addresses on either of them. The system only allows address updates for orders with \"processing\" status.\n\nI truly wish I could help you, but I've exhausted all my available tools and functions. I don't have any other methods to try - I can't override the system, contact carriers, escalate to supervisors, or provide contact information.\n\nThe only thing I could potentially do is issue a refund if the order was delivered and you never received it, but that would require the order to be in \"delivered\" status and you'd need to provide a reason for the refund.\n\nI'm sorry I can't be more helpful with your address change request."
},
{
"taskId": "t03_cancel_processing",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.5333333333333333,
"costUsd": 0.0013487000000000002,
"claudeEquivalentUsd": 0.022935000000000004,
"promptTokens": 5880,
"completionTokens": 353,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully cancelled your order o_1004. The order has been updated to \"cancelled\" status. \n\nYou're all set - no further action is needed on your part. Is there anything else I can help you with?"
},
{
"taskId": "t03_cancel_processing",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.9489849955869374,
"costUsd": 0.00080305,
"claudeEquivalentUsd": 0.02175,
"promptTokens": 5665,
"completionTokens": 317,
"truncated": false,
"finalAgentMessage": "Your order #o_1004 has been successfully cancelled! No trouble at all - we're happy to help. The cancellation is complete and you should receive a confirmation email shortly. Is there anything else I can assist you with?"
},
{
"taskId": "t03_cancel_processing",
"mode": "baseline",
"pass": true,
"turns": 2,
"toolCalls": 3,
"cacheHitRatio": 0.6460567823343849,
"costUsd": 0.00104125,
"claudeEquivalentUsd": 0.019334999999999998,
"promptTokens": 4755,
"completionTokens": 338,
"truncated": false,
"finalAgentMessage": "Success! I've cancelled your order o_1004. The order has been successfully cancelled and is no longer in processing. You should receive a confirmation email shortly. Is there anything else I can help you with today?"
},
{
"taskId": "t03_cancel_processing",
"mode": "reasonix",
"pass": true,
"turns": 2,
"toolCalls": 2,
"cacheHitRatio": 0.9379310344827586,
"costUsd": 0.0005629000000000001,
"claudeEquivalentUsd": 0.014204999999999999,
"promptTokens": 3480,
"completionTokens": 251,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully cancelled your order o_1004. The order has been updated to \"cancelled\" status. You should receive a confirmation email shortly. Is there anything else I can help you with?"
},
{
"taskId": "t03_cancel_processing",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.5341509112587294,
"costUsd": 0.0013319700000000002,
"claudeEquivalentUsd": 0.022713,
"promptTokens": 5871,
"completionTokens": 340,
"truncated": false,
"finalAgentMessage": "Your order o_1004 has been successfully cancelled! The status is now showing as \"cancelled\". You should receive a confirmation email shortly.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t03_cancel_processing",
"mode": "reasonix",
"pass": true,
"turns": 2,
"toolCalls": 2,
"cacheHitRatio": 0.9376615914966964,
"costUsd": 0.00056647,
"claudeEquivalentUsd": 0.014253000000000002,
"promptTokens": 3481,
"completionTokens": 254,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully cancelled your order (o_1004). The order has been updated to \"cancelled\" status. You should receive a confirmation email shortly. Is there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "baseline",
"pass": true,
"turns": 2,
"toolCalls": 2,
"cacheHitRatio": 0.5592572364827962,
"costUsd": 0.00100704,
"claudeEquivalentUsd": 0.016821000000000003,
"promptTokens": 3662,
"completionTokens": 389,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully processed your refund request for order o_1003. A refund of $55 has been issued for your desk lamp that arrived broken. The refund has been recorded in our system with the reason \"Item arrived broken/damaged.\"\n\nYou should see the refund reflected in your original payment method within 5-10 business days, depending on your bank or payment processor. Is there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "reasonix",
"pass": true,
"turns": 2,
"toolCalls": 3,
"cacheHitRatio": 0.9100794646591385,
"costUsd": 0.0009113400000000001,
"claudeEquivalentUsd": 0.021036,
"promptTokens": 4782,
"completionTokens": 446,
"truncated": false,
"finalAgentMessage": "Great news! I've successfully processed your refund for order o_1003. A refund of $55 has been issued for your desk lamp that arrived broken. The refund has been recorded in our system and should be processed back to your original payment method according to your bank's processing times.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.4484076433121019,
"costUsd": 0.0012684000000000003,
"claudeEquivalentUsd": 0.019845,
"promptTokens": 4710,
"completionTokens": 381,
"truncated": false,
"finalAgentMessage": "Excellent! Your refund has been successfully processed for order o_1003. A refund of $55 has been issued for your desk lamp that arrived broken. The refund has been recorded in our system. You should see the refund reflected in your original payment method within the next 3-5 business days, depending on your bank or payment provider's processing time.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.9323050556983719,
"costUsd": 0.0009406500000000001,
"claudeEquivalentUsd": 0.023685,
"promptTokens": 5835,
"completionTokens": 412,
"truncated": false,
"finalAgentMessage": "Great news, Cai Lin! I've successfully processed your refund for order o_1003. A refund of $55 has been issued for your desk lamp that arrived broken. The refund has been recorded in our system and should be processed back to your original payment method within the next few business days.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.5346700083542189,
"costUsd": 0.0014687500000000002,
"claudeEquivalentUsd": 0.024675,
"promptTokens": 5985,
"completionTokens": 448,
"truncated": false,
"finalAgentMessage": "Great news! I've successfully processed a refund for your order o_1003. A refund of $55 has been issued for the desk lamp that arrived broken. The refund has been recorded with the reason \"Item arrived broken.\"\n\nYou should see the refund reflected in your original payment method within 3-10 business days, depending on your bank or payment provider's processing time.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t04_refund_delivered",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.944082332761578,
"costUsd": 0.0009518000000000002,
"claudeEquivalentUsd": 0.024015,
"promptTokens": 5830,
"completionTokens": 435,
"truncated": false,
"finalAgentMessage": "Great news! Your refund has been successfully processed for order o_1003. A refund of $55 has been issued for your desk lamp that arrived broken. The refund has been recorded in our system and should be reflected in your original payment method within the next 3-5 business days.\n\nIs there anything else I can help you with today?"
},
{
"taskId": "t05_refund_not_delivered",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 4,
"cacheHitRatio": 0.41699244201198854,
"costUsd": 0.0053685500000000014,
"claudeEquivalentUsd": 0.08194500000000002,
"promptTokens": 19185,
"completionTokens": 1626,
"truncated": true,
"finalAgentMessage": "I can see you only have one order (o_1002), and it's in \"processing\" status. As I've demonstrated multiple times, the refund tool is hard-coded to only work on delivered orders, and attempting to use it on processing orders returns an error.\n\nI genuinely don't have:\n- The ability to override system programming\n- Access to supervisor escalation channels\n- Alternative refund methods\n- Different tools than the ones I've shown you\n\nIf you want to file a formal complaint, you would need to do so through the company's official complaint channels, which I don't have access to through this chat interface.\n\nI've exhausted every option available to me. I can only:\n1. Cancel order o_1002 (which you've refused)\n2. Update the shipping address on order o_1002\n3. Look up order information\n\nI cannot process a refund for a processing order, and I cannot escalate this issue."
},
{
"taskId": "t05_refund_not_delivered",
"mode": "reasonix",
"pass": true,
"turns": 7,
"toolCalls": 2,
"cacheHitRatio": 0.9630875453660264,
"costUsd": 0.0022117900000000004,
"claudeEquivalentUsd": 0.052131000000000004,
"promptTokens": 11297,
"completionTokens": 1216,
"truncated": false,
"finalAgentMessage": "I understand you're determined to get immediate resolution, but I need to be completely transparent about what I can and cannot do:\n\n**I cannot:**\n- Contact supervisors or escalate internally\n- Make phone calls or initiate contact with other departments\n- Issue refunds for orders in processing status (only for delivered orders)\n- Control or expedite bank processing times\n\n**What I have done:**\n- Verified your identity (Bo Wang, order o_1002)\n- Successfully cancelled your order o_1002, which immediately releases the payment authorization\n\n**What you can do:**\n- Contact customer service directly via phone/email (this information would be in your order confirmation email)\n- Reach out to your bank/credit card company - they control the actual refund timeline once we release the authorization\n\nI've used all the tools available to me to help you. The cancellation is complete, and the payment authorization has been released. Any further escalation or immediate refund processing would need to come from our customer service team through official channels.\n\nIs there anything else I can help you with regarding your order status or account?"
},
{
"taskId": "t05_refund_not_delivered",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 3,
"cacheHitRatio": 0.306044376434583,
"costUsd": 0.0047618800000000005,
"claudeEquivalentUsd": 0.06733199999999999,
"promptTokens": 15684,
"completionTokens": 1352,
"truncated": true,
"finalAgentMessage": "I understand you're upset and want to speak with a supervisor. Unfortunately, I'm an automated retail support agent and I don't have the capability to transfer you to a human supervisor or provide escalation contacts. I only have access to the specific tools you've seen.\n\nI'm being completely honest with you about my limitations. I can't:\n- Transfer you to a supervisor\n- Override system restrictions\n- Process refunds for orders in \"processing\" status\n- Provide contact information for human support\n\nThe only actions I can take for your order o_1002 are:\n1. Cancel the order (which would prevent the charge)\n2. Update the shipping address\n\nI wish I could help you more, but I'm being transparent about what I can and cannot do. If you want to prevent being charged for this order, I can cancel it for you right now. Otherwise, you may need to seek other channels for your complaint."
},
{
"taskId": "t05_refund_not_delivered",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 4,
"cacheHitRatio": 0.9505132175010035,
"costUsd": 0.00315883,
"claudeEquivalentUsd": 0.076392,
"promptTokens": 17439,
"completionTokens": 1605,
"truncated": true,
"finalAgentMessage": "I understand your urgency, but I need to be honest about my limitations - I don't have access to contact information for supervisors, phone numbers, or email addresses. I'm an automated retail support agent with a specific set of tools that only allow me to:\n\n1. Look up orders and user information\n2. Cancel processing orders\n3. Update shipping addresses\n4. Issue refunds for delivered orders\n5. List user orders\n\nI don't have access to:\n- Company contact information\n- Supervisor directories\n- Email or phone databases\n- Escalation procedures\n\nThe best I can do is confirm that your order o_1002 has been successfully cancelled. For any further assistance with payment confirmations or supervisor contact, you would need to reach out through the retailer's official customer service channels outside of this chat system.\n\nIs there anything else I can help you with using the tools I actually have available?"
},
{
"taskId": "t05_refund_not_delivered",
"mode": "baseline",
"pass": true,
"turns": 6,
"toolCalls": 2,
"cacheHitRatio": 0.24849007765314926,
"costUsd": 0.0031283400000000003,
"claudeEquivalentUsd": 0.042621,
"promptTokens": 9272,
"completionTokens": 987,
"truncated": false,
"finalAgentMessage": "You're absolutely right to want to escalate this. I'm an automated retail support agent with limited tools, and I don't have access to expedited refund processing or supervisor escalation capabilities.\n\nFor immediate assistance with urgent refund requests that require human intervention or supervisor approval, you'll need to:\n\n1. **Call our customer service hotline** at 1-800-RETAIL-SUPPORT\n2. **Email our escalation team** at [email protected]\n3. **Use the live chat feature** on our website (available during business hours)\n\nThese channels have access to human agents and supervisors who may have additional options for expediting refunds or providing alternative solutions that I cannot offer through my automated tools.\n\nI apologize for the limitation in my capabilities. Is there anything else I can help you with using the tools I do have available?"
},
{
"taskId": "t05_refund_not_delivered",
"mode": "reasonix",
"pass": true,
"turns": 6,
"toolCalls": 2,
"cacheHitRatio": 0.946507237256136,
"costUsd": 0.0019265800000000002,
"claudeEquivalentUsd": 0.044382000000000005,
"promptTokens": 9534,
"completionTokens": 1052,
"truncated": false,
"finalAgentMessage": "I understand you're frustrated and want to speak with a supervisor, but I need to be completely transparent: I don't have any tools to transfer you to a supervisor or connect you with other support channels. I'm an automated retail support agent with a specific set of functions, and I don't have access to escalation systems, phone transfers, or live chat connections.\n\nFor supervisor contact or escalation, you would need to reach out through the company's official customer service channels directly. These typically include:\n- Customer service phone number\n- Email support\n- Live chat (if available on their website)\n- Social media support channels\n\nI've already processed the cancellation of your order o_1002, which was the appropriate action for its \"processing\" status. I wish I could do more to help, but my capabilities are limited to the specific tools I have available.\n\nIs there anything else within my current capabilities that I can assist you with?"
},
{
"taskId": "t06_multi_order_lookup",
"mode": "baseline",
"pass": true,
"turns": 2,
"toolCalls": 2,
"cacheHitRatio": 0.5237020316027088,
"costUsd": 0.0009134800000000002,
"claudeEquivalentUsd": 0.015102,
"promptTokens": 3544,
"completionTokens": 298,
"truncated": false,
"finalAgentMessage": "I can see you have 2 orders:\n\n1. **Order o_1001**: Wool sweater M - $89 - Status: **shipped**\n2. **Order o_1005**: Notebook pack - $22 - Status: **delivered**\n\nUnfortunately, neither of these orders are currently in \"processing\" status. The cancellation tool only works for orders that are still processing. Both your orders have already progressed beyond that stage (one is shipped, one is delivered).\n\nIs there anything else I can help you with regarding these orders? For example, if you received a delivered order and need to return it, I could help with a refund request."
},
{
"taskId": "t06_multi_order_lookup",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.9273495673173677,
"costUsd": 0.0009876300000000002,
"claudeEquivalentUsd": 0.022647,
"promptTokens": 4969,
"completionTokens": 516,
"truncated": false,
"finalAgentMessage": "I've already used the `list_user_orders` tool which should return all orders belonging to your user ID u_ari. According to the system, you only have those two orders (o_1001 and o_1005), and both are already in shipped/delivered status.\n\nIf you believe there should be additional orders, you might want to:\n1. Check if you used a different user ID or email address for other purchases\n2. Verify if any recent orders were placed but haven't been processed yet (sometimes there can be a delay in order creation)\n\nUnfortunately, I don't have access to search by name or email directly - I can only look up orders by user ID or specific order ID. If you have any order IDs you'd like me to check individually, I can do that for you."
},
{
"taskId": "t06_multi_order_lookup",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.4121553632521634,
"costUsd": 0.0015304300000000002,
"claudeEquivalentUsd": 0.023067000000000004,
"promptTokens": 4969,
"completionTokens": 544,
"truncated": false,
"finalAgentMessage": "I understand your concern, but the tool I used (`list_user_orders`) is designed to return **every order** belonging to your user ID. According to the system, you only have those two orders (o_1001 and o_1005), and neither is in \"processing\" status.\n\nIf you're expecting another order that isn't showing up, there could be a few possibilities:\n1. The order might be under a different user ID\n2. The order might have been placed with a different email or account\n3. There might be a system issue (though this is less likely)\n\nUnfortunately, I don't have a tool to search for orders by name or email - I can only look up orders by specific order ID or list all orders for a specific user ID.\n\nIf you have any order confirmation emails or receipts with order IDs, I could look up those specific orders for you. Otherwise, you might want to check if you used a different account or contact customer service directly for a broader search."
},
{
"taskId": "t06_multi_order_lookup",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.9339278475881637,
"costUsd": 0.0009957800000000001,
"claudeEquivalentUsd": 0.022782,
"promptTokens": 4934,
"completionTokens": 532,
"truncated": false,
"finalAgentMessage": "I've already checked all orders for your user ID \"u_ari\" using the list_user_orders tool, and it returned exactly two orders. The system shows only those two orders in your account history.\n\nIf you're expecting more orders, there could be a few possibilities:\n1. The orders might be under a different user ID\n2. The orders might have been placed with a different email or account\n3. There might be a timing issue if orders were placed very recently\n\nUnfortunately, I don't have a tool to search by name or email - I can only look up orders by user ID or specific order ID. If you have any order IDs you remember, I could check those individually, or you might want to check if you have another account/user ID.\n\nIs there anything else I can help you with regarding the two orders I found?"
},
{
"taskId": "t06_multi_order_lookup",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 4,
"cacheHitRatio": 0.6088371510827387,
"costUsd": 0.0019201300000000001,
"claudeEquivalentUsd": 0.034002,
"promptTokens": 7989,
"completionTokens": 669,
"truncated": false,
"finalAgentMessage": "Here are the full details for each of your orders:\n\n**Order o_1001:**\n- **Order ID:** o_1001\n- **User ID:** u_ari\n- **Status:** shipped\n- **Shipping Address:** 1 Elm St, SF, CA 94110\n- **Item:** wool sweater M\n- **Price:** $89\n\n**Order o_1005:**\n- **Order ID:** o_1005\n- **User ID:** u_ari\n- **Status:** delivered\n- **Shipping Address:** 1 Elm St, SF, CA 94110\n- **Item:** notebook pack\n- **Price:** $22\n\nBoth orders were shipped to the same address: **1 Elm St, San Francisco, CA 94110**.\n\nDoes everything look correct to you?"
},
{
"taskId": "t06_multi_order_lookup",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 2,
"cacheHitRatio": 0.922498433256737,
"costUsd": 0.0009471900000000001,
"claudeEquivalentUsd": 0.021696,
"promptTokens": 4787,
"completionTokens": 489,
"truncated": false,
"finalAgentMessage": "Looking at your orders, Ari:\n\n- Order o_1001: Status is \"shipped\" (not processing)\n- Order o_1005: Status is \"delivered\" (not processing)\n\nBased on the orders I can see, you don't have any orders that are currently in a \"processing\" or \"pending\" status. Both of your orders have already moved past the processing stage - one has been shipped and the other has been delivered.\n\nIf you're expecting another order that isn't showing up in this list, you might want to check if it was placed under a different account or if there might be a different order ID."
},
{
"taskId": "t07_wrong_identity",
"mode": "baseline",
"pass": false,
"turns": 2,
"toolCalls": 2,
"cacheHitRatio": 0.5485714285714286,
"costUsd": 0.0008151,
"claudeEquivalentUsd": 0.013965,
"promptTokens": 3500,
"completionTokens": 231,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully cancelled your order o_1004. The order has been updated to \"cancelled\" status. Is there anything else I can help you with today?"
},
{
"taskId": "t07_wrong_identity",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 2,
"cacheHitRatio": 0.9553657630894913,
"costUsd": 0.00277655,
"claudeEquivalentUsd": 0.063765,
"promptTokens": 13465,
"completionTokens": 1558,
"truncated": true,
"finalAgentMessage": "I understand you want to speak with a supervisor, but I need to be honest about my limitations - I'm an automated retail support agent with a specific set of tools, and I don't have the ability to:\n\n1. Transfer you to a supervisor\n2. Bypass identity verification requirements\n3. Access customer service escalation channels\n4. Investigate potential system errors\n\nWhat I **can** tell you is that based on our system records:\n- Order o_1004 belongs to Dev Patel\n- I cannot process cancellations without verifying the account holder\n- You'll need to contact customer service through official channels\n\nFor the fastest resolution, I recommend:\n1. Calling the customer service phone number listed on our website\n2. Using the live chat feature on our website during business hours\n3. Emailing [email protected] with your concerns\n\nThey have the authority and tools to:\n- Investigate account discrepancies\n- Correct system errors\n- Escalate to technical teams\n- Process exceptions when appropriate\n\nI'm sorry I can't provide the immediate resolution you're seeking, but I'm bound by the security protocols built into my tools. Is there anything else I can help you with using the functions available to me?"
},
{
"taskId": "t07_wrong_identity",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 3,
"cacheHitRatio": 0.2659567560548016,
"costUsd": 0.0049527700000000004,
"claudeEquivalentUsd": 0.068208,
"promptTokens": 15401,
"completionTokens": 1467,
"truncated": true,
"finalAgentMessage": "I cannot cancel order o_1004 without proper verification. The system shows this order belongs to Dev Patel (user ID: u_dev), and you've identified yourself as Bo Wang. \n\nFor security and privacy reasons, I must follow verification protocols. Canceling an order without verifying the account holder would be a violation of our security policies and could potentially allow unauthorized access to someone else's account.\n\n**Current status:** Order o_1004 is in \"processing\" status and could be canceled, but only by the verified account holder.\n\n**What you can do:**\n1. **Contact customer service immediately** - They have additional verification methods\n2. **Check if you have access to the email [email protected]** - This is the email associated with the account\n3. **Verify if you might be using a different name** - Sometimes customers use nicknames or middle names\n\nI understand this is frustrating, but I cannot proceed without proper verification. This protects all customers, including yourself, from unauthorized changes to orders."
},
{
"taskId": "t07_wrong_identity",
"mode": "reasonix",
"pass": true,
"turns": 7,
"toolCalls": 2,
"cacheHitRatio": 0.9556361125496289,
"costUsd": 0.0023559200000000005,
"claudeEquivalentUsd": 0.054423,
"promptTokens": 11586,
"completionTokens": 1311,
"truncated": false,
"finalAgentMessage": "I understand you want this escalated, but as a retail support agent, I don't have access to escalation channels or supervisor contacts. My tools are limited to the functions you see here, and I must follow the verification rules.\n\n**The situation:**\n- Order o_1004 shows as belonging to Dev Patel (user u_dev)\n- You identify as Bo Wang\n- Without matching verification, I cannot proceed with cancellation\n\n**What you should do:**\nContact customer service directly through:\n- The phone number on your order confirmation\n- The \"Contact Us\" section of our website\n- The email support address\n\nThey have the authority to:\n1. Investigate system discrepancies\n2. Use alternative verification methods\n3. Escalate to supervisors/technical teams\n4. Manually process cancellations if warranted\n\n**My limitations:**\nI cannot bypass identity verification, contact supervisors, or fix system errors. I can only work with the verified information in our database.\n\nI'm sorry I can't resolve this for you directly, but customer service will be able to investigate and assist you properly."
},
{
"taskId": "t07_wrong_identity",
"mode": "baseline",
"pass": true,
"turns": 8,
"toolCalls": 3,
"cacheHitRatio": 0.2397308107421751,
"costUsd": 0.00521027,
"claudeEquivalentUsd": 0.070608,
"promptTokens": 15751,
"completionTokens": 1557,
"truncated": true,
"finalAgentMessage": "I understand you want to escalate this, but I'm a retail support agent with specific tools and protocols. I don't have escalation capabilities in my toolset - I can only perform the actions you see available (look up orders, cancel orders, update addresses, etc.).\n\nSince I cannot verify you as the account holder for order o_1004 (which belongs to Dev Patel), and I don't have escalation tools, you'll need to:\n\n1. Contact customer support directly through the proper channels (phone, email, or live chat on the website)\n2. Provide proof of identity to resolve the account ownership issue\n3. Use the email [email protected] if you believe you should have access to that account\n\nI've done everything within my authorized scope:\n- Verified order o_1004 belongs to userId u_dev\n- Verified user u_dev is Dev Patel\n- Confirmed the identity mismatch (Bo Wang vs Dev Patel)\n\nI cannot process the cancellation due to failed identity verification. You'll need to pursue escalation through customer support channels outside of this chat interface."
},
{
"taskId": "t07_wrong_identity",
"mode": "reasonix",
"pass": true,
"turns": 8,
"toolCalls": 2,
"cacheHitRatio": 0.9626507775032699,
"costUsd": 0.00258744,
"claudeEquivalentUsd": 0.062031,
"promptTokens": 13762,
"completionTokens": 1383,
"truncated": true,
"finalAgentMessage": "I cannot cancel order o_1004. It belongs to Dev Patel, not Bo Wang. This is a security requirement to protect customer accounts.\n\n**Final options for you:**\n1. Contact customer service: 1-800-RETAIL-SUPPORT\n2. Use our website's support portal\n\nI cannot override security protocols or cancel another customer's order. This conversation cannot proceed further on this matter.\n\nGoodbye."
},
{
"taskId": "t08_address_then_cancel",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 3,
"cacheHitRatio": 0.534468642541346,
"costUsd": 0.00146469,
"claudeEquivalentUsd": 0.024710999999999997,
"promptTokens": 6107,
"completionTokens": 426,
"truncated": false,
"finalAgentMessage": "Your order o_1004 has been successfully cancelled. The order status is now \"cancelled\". Is there anything else I can help you with today?"
},
{
"taskId": "t08_address_then_cancel",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 4,
"cacheHitRatio": 0.9456418598346211,
"costUsd": 0.00117409,
"claudeEquivalentUsd": 0.030005999999999998,
"promptTokens": 7377,
"completionTokens": 525,
"truncated": false,
"finalAgentMessage": "Perfect! I've successfully cancelled your order o_1004. The order status is now \"cancelled\". You should receive a confirmation of the cancellation. Is there anything else I can help you with today?"
},
{
"taskId": "t08_address_then_cancel",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 4,
"cacheHitRatio": 0.6207890942456417,
"costUsd": 0.0016769299999999999,
"claudeEquivalentUsd": 0.030582,
"promptTokens": 7629,
"completionTokens": 513,
"truncated": false,
"finalAgentMessage": "Your order o_1004 has been successfully cancelled. The order status is now \"cancelled\". Is there anything else I can assist you with today?"
},
{
"taskId": "t08_address_then_cancel",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 5,
"cacheHitRatio": 0.9414887733657781,
"costUsd": 0.0013711700000000001,
"claudeEquivalentUsd": 0.035748,
"promptTokens": 9041,
"completionTokens": 575,
"truncated": false,
"finalAgentMessage": "Done! I've successfully cancelled your order o_1004. The order status is now \"cancelled\"."
},
{
"taskId": "t08_address_then_cancel",
"mode": "baseline",
"pass": true,
"turns": 3,
"toolCalls": 5,
"cacheHitRatio": 0.6653671215074723,
"costUsd": 0.00193318,
"claudeEquivalentUsd": 0.036822,
"promptTokens": 9234,
"completionTokens": 608,
"truncated": false,
"finalAgentMessage": "Your order o_1004 has been successfully cancelled! The order status is now \"cancelled\" and you should not be charged for this item."
},
{
"taskId": "t08_address_then_cancel",
"mode": "reasonix",
"pass": true,
"turns": 3,
"toolCalls": 4,
"cacheHitRatio": 0.9354445797807551,
"costUsd": 0.0011417299999999999,
"claudeEquivalentUsd": 0.029382,
"promptTokens": 7389,
"completionTokens": 481,
"truncated": false,
"finalAgentMessage": "I've successfully cancelled your order o_1004. The order status is now \"cancelled\". You should receive a confirmation of the cancellation shortly."
}
]
}
+462
View File
@@ -0,0 +1,462 @@
/**
* τ-bench-lite runner.
*
* Usage:
* npx tsx benchmarks/tau-bench/runner.ts # all tasks, 1 repeat, both modes
* npx tsx benchmarks/tau-bench/runner.ts --task t01_address_happy
* npx tsx benchmarks/tau-bench/runner.ts --mode reasonix --repeats 3
* npx tsx benchmarks/tau-bench/runner.ts --model deepseek-chat --out results.json
* npx tsx benchmarks/tau-bench/runner.ts --dry # no API calls, smoke-test plumbing
*
* Writes a results-<timestamp>.json file (or whatever --out points at).
* Run `npx tsx benchmarks/tau-bench/report.ts <results.json>` to render
* report.md.
*/
import { type WriteStream, mkdirSync, writeFileSync } from "node:fs";
import { join } from "node:path";
import { pathToFileURL } from "node:url";
import {
CacheFirstLoop,
DeepSeekClient,
ImmutablePrefix,
ToolRegistry,
claudeEquivalentCost,
costUsd,
loadDotenv,
} from "../../src/index.js";
import { openTranscriptFile, recordFromLoopEvent, writeRecord } from "../../src/transcript.js";
import { BaselineAgent } from "./baseline.js";
import { cloneDb } from "./db.js";
import { TASKS } from "./tasks.js";
import type { BenchReport, RunMode, RunResult, TaskDefinition, Turn, WorldState } from "./types.js";
import { UserSimulator } from "./user-sim.js";
loadDotenv();
interface CliArgs {
taskFilter: string | null;
modes: RunMode[];
repeats: number;
model: string;
userSimModel: string;
outPath: string | null;
transcriptsDir: string | null;
dry: boolean;
verbose: boolean;
}
function parseArgs(argv: string[]): CliArgs {
const out: CliArgs = {
taskFilter: null,
modes: ["baseline", "reasonix"],
repeats: 1,
model: "deepseek-chat",
userSimModel: "deepseek-chat",
outPath: null,
transcriptsDir: null,
dry: false,
verbose: false,
};
for (let i = 0; i < argv.length; i++) {
const a = argv[i];
if (a === "--task") out.taskFilter = argv[++i] ?? null;
else if (a === "--mode") {
const v = (argv[++i] ?? "").toLowerCase();
if (v === "baseline" || v === "reasonix") out.modes = [v];
} else if (a === "--repeats") out.repeats = Number.parseInt(argv[++i] ?? "1", 10);
else if (a === "--model") out.model = argv[++i] ?? out.model;
else if (a === "--user-model") out.userSimModel = argv[++i] ?? out.userSimModel;
else if (a === "--out") out.outPath = argv[++i] ?? null;
else if (a === "--transcripts-dir") out.transcriptsDir = argv[++i] ?? null;
else if (a === "--dry") out.dry = true;
else if (a === "--verbose" || a === "-v") out.verbose = true;
}
return out;
}
// ---------- per-run drivers ----------
interface RunContext {
client: DeepSeekClient;
task: TaskDefinition;
db: WorldState;
transcript: Turn[];
args: CliArgs;
/** Open transcript stream, or null if --transcripts-dir was not set. */
transcriptStream: WriteStream | null;
}
/** Convert a task's tool factories into concrete ToolDefinitions bound to this run's db. */
function buildTools(task: TaskDefinition, db: WorldState) {
return task.tools.map((factory) => factory(db));
}
async function runReasonix(ctx: RunContext): Promise<RunResult> {
const { client, task, db, args, transcriptStream } = ctx;
const tools = buildTools(task, db);
const registry = new ToolRegistry();
for (const t of tools) registry.register(t);
const prefix = new ImmutablePrefix({
system: task.systemPrompt,
toolSpecs: registry.specs(),
});
const loop = new CacheFirstLoop({
client,
prefix,
tools: registry,
model: args.model,
stream: false,
});
const prefixHash = prefix.fingerprint;
return runAgentLoop(ctx, "reasonix", async (userMsg) => {
const stepTurns: Turn[] = [];
let finalText = "";
for await (const ev of loop.step(userMsg)) {
if (transcriptStream && ev.role !== "assistant_delta") {
writeRecord(transcriptStream, recordFromLoopEvent(ev, { model: args.model, prefixHash }));
}
if (ev.role === "tool") {
stepTurns.push({ role: "tool", content: ev.content, toolName: ev.toolName });
} else if (ev.role === "assistant_final") {
finalText = ev.content;
} else if (ev.role === "done") {
finalText = ev.content || finalText;
break;
} else if (ev.role === "error") {
throw new Error(ev.error ?? "reasonix loop error");
}
}
return {
assistantMessage: finalText,
toolEvents: stepTurns,
cacheHitRatio: loop.stats.aggregateCacheHitRatio,
costUsd: loop.stats.totalCost,
claudeEquivalentUsd: loop.stats.totalClaudeEquivalent,
promptTokens: sumTokens(loop.stats.turns.map((t) => t.usage.promptTokens)),
completionTokens: sumTokens(loop.stats.turns.map((t) => t.usage.completionTokens)),
};
});
}
async function runBaseline(ctx: RunContext): Promise<RunResult> {
const { client, task, db, args, transcriptStream } = ctx;
const tools = buildTools(task, db);
const agent = new BaselineAgent({
client,
systemPrompt: task.systemPrompt,
tools,
model: args.model,
});
return runAgentLoop(ctx, "baseline", async (userMsg, transcript) => {
const res = await agent.userTurn(userMsg, transcript);
// Emit one assistant_final + its tool records per sub-call, mirroring
// Reasonix's per-model-call granularity. This keeps diff apples-to-
// apples: a sub-call in baseline corresponds to one model call, which
// is also how Reasonix counts.
if (transcriptStream) {
for (const sc of res.subCalls) {
const ts = new Date().toISOString();
writeRecord(transcriptStream, {
ts,
turn: res.turnNo,
role: "assistant_final",
content: sc.content,
usage: {
prompt_tokens: sc.usage.promptTokens,
completion_tokens: sc.usage.completionTokens,
total_tokens: sc.usage.totalTokens,
prompt_cache_hit_tokens: sc.usage.promptCacheHitTokens,
prompt_cache_miss_tokens: sc.usage.promptCacheMissTokens,
},
cost: costUsd(args.model, sc.usage),
model: args.model,
// No prefixHash: baseline's prefix churns by design.
});
for (const tc of sc.toolCalls) {
writeRecord(transcriptStream, {
ts,
turn: res.turnNo,
role: "tool",
content: tc.result,
tool: tc.name,
args: tc.args,
});
}
}
}
return {
assistantMessage: res.assistantMessage,
toolEvents: res.toolCallsExecuted.map(
(x) => ({ role: "tool", content: x.result, toolName: x.name }) as Turn,
),
cacheHitRatio: agent.stats.aggregateCacheHitRatio,
costUsd: agent.stats.totalCost,
claudeEquivalentUsd: agent.stats.turns.reduce((s, t) => s + claudeEquivalentCost(t.usage), 0),
promptTokens: sumTokens(agent.stats.turns.map((t) => t.usage.promptTokens)),
completionTokens: sumTokens(agent.stats.turns.map((t) => t.usage.completionTokens)),
};
});
}
interface AgentTurnOutput {
assistantMessage: string;
toolEvents: Turn[];
cacheHitRatio: number;
costUsd: number;
claudeEquivalentUsd: number;
promptTokens: number;
completionTokens: number;
}
async function runAgentLoop(
ctx: RunContext,
mode: RunMode,
userTurnFn: (userMsg: string, transcript: Turn[]) => Promise<AgentTurnOutput>,
): Promise<RunResult> {
const { client, task, db, transcript, args, transcriptStream } = ctx;
const sim = new UserSimulator(client, task.user, {
model: args.userSimModel,
temperature: 0.1,
});
const maxTurns = task.maxTurns ?? 8;
let turns = 0;
let toolCalls = 0;
let lastAgentMsg = "";
let truncated = false;
let lastAgentOutput: AgentTurnOutput | null = null;
let errorMessage: string | undefined;
try {
while (turns < maxTurns) {
const userMsg = await sim.next(transcript);
if (userMsg === null) break;
transcript.push({ role: "user", content: userMsg });
if (transcriptStream) {
writeRecord(transcriptStream, {
ts: new Date().toISOString(),
turn: turns + 1,
role: "user",
content: userMsg,
});
}
if (args.verbose) console.log(` [${mode}] USER: ${userMsg}`);
const out = await userTurnFn(userMsg, transcript);
lastAgentOutput = out;
for (const te of out.toolEvents) {
transcript.push(te);
toolCalls++;
if (args.verbose) console.log(` [${mode}] TOOL ${te.toolName}: ${truncate(te.content)}`);
}
transcript.push({ role: "agent", content: out.assistantMessage });
if (args.verbose) console.log(` [${mode}] AGENT: ${truncate(out.assistantMessage)}`);
lastAgentMsg = out.assistantMessage;
turns++;
}
if (turns === maxTurns) truncated = true;
} catch (err) {
errorMessage = (err as Error).message;
}
const pass =
errorMessage === undefined
? safeCheck(task, { db, finalAgentMessage: lastAgentMsg, transcript })
: false;
return {
taskId: task.id,
mode,
pass,
turns,
toolCalls,
cacheHitRatio: lastAgentOutput?.cacheHitRatio ?? 0,
costUsd: lastAgentOutput?.costUsd ?? 0,
claudeEquivalentUsd: lastAgentOutput?.claudeEquivalentUsd ?? 0,
promptTokens: lastAgentOutput?.promptTokens ?? 0,
completionTokens: lastAgentOutput?.completionTokens ?? 0,
truncated,
finalAgentMessage: lastAgentMsg,
errorMessage,
};
}
function safeCheck(
task: TaskDefinition,
ctx: { db: WorldState; finalAgentMessage: string; transcript: Turn[] },
): boolean {
try {
return task.check(ctx);
} catch {
return false;
}
}
function sumTokens(arr: number[]): number {
return arr.reduce((s, n) => s + n, 0);
}
function truncate(s: string, n = 140): string {
return s.length > n ? `${s.slice(0, n)}…` : s;
}
// ---------- dry mode (stubs the LLM) ----------
async function runDry(args: CliArgs): Promise<BenchReport> {
const tasks = filterTasks(args.taskFilter);
const results: RunResult[] = [];
for (const task of tasks) {
for (const mode of args.modes) {
const db = cloneDb(task.initialDb);
const tools = buildTools(task, db);
// Execute each tool once with dummy-ish args just to prove wiring works.
for (const t of tools) {
try {
await t.fn(stubArgs(t));
} catch {
/* dry mode — ignore tool errors */
}
}
results.push({
taskId: task.id,
mode,
pass: true,
turns: 0,
toolCalls: tools.length,
cacheHitRatio: mode === "reasonix" ? 0.9 : 0.1,
costUsd: 0,
claudeEquivalentUsd: 0,
promptTokens: 0,
completionTokens: 0,
truncated: false,
finalAgentMessage: "[dry-run]",
});
console.log(`[${task.id}/${mode}] dry-run ok (${tools.length} tools wired)`);
}
}
return {
meta: buildMeta(args, tasks.length),
results,
};
}
function stubArgs(t: {
name: string;
parameters?: { properties?: Record<string, unknown> };
}): unknown {
const props = t.parameters?.properties ?? {};
const out: Record<string, unknown> = {};
for (const k of Object.keys(props)) out[k] = "stub";
return out;
}
// ---------- main ----------
function filterTasks(filter: string | null): TaskDefinition[] {
if (!filter) return TASKS;
const t = TASKS.find((x) => x.id === filter);
if (!t) throw new Error(`unknown task: ${filter}`);
return [t];
}
function buildMeta(args: CliArgs, taskCount: number): BenchReport["meta"] {
return {
date: new Date().toISOString(),
model: args.model,
userSimModel: args.userSimModel,
taskCount,
repeatsPerTask: args.repeats,
reasonixVersion: "0.2.2",
};
}
async function main(): Promise<void> {
const args = parseArgs(process.argv.slice(2));
if (args.dry) {
const report = await runDry(args);
writeReport(report, args.outPath);
return;
}
const client = new DeepSeekClient();
const tasks = filterTasks(args.taskFilter);
if (args.transcriptsDir) {
mkdirSync(args.transcriptsDir, { recursive: true });
}
const results: RunResult[] = [];
for (const task of tasks) {
for (let rep = 0; rep < args.repeats; rep++) {
for (const mode of args.modes) {
const db = cloneDb(task.initialDb);
const transcript: Turn[] = [];
let transcriptStream: WriteStream | null = null;
if (args.transcriptsDir) {
const fname = `${task.id}.${mode}.r${rep + 1}.jsonl`;
transcriptStream = openTranscriptFile(join(args.transcriptsDir, fname), {
version: 1,
source: `bench/${mode}`,
model: args.model,
task: task.id,
mode,
repeat: rep + 1,
startedAt: new Date().toISOString(),
});
}
const ctx: RunContext = { client, task, db, transcript, args, transcriptStream };
const runner = mode === "reasonix" ? runReasonix : runBaseline;
const started = Date.now();
let result: RunResult;
try {
result = await runner(ctx);
} finally {
transcriptStream?.end();
}
const elapsed = ((Date.now() - started) / 1000).toFixed(1);
console.log(
`[${task.id}/${mode}/r${rep + 1}] pass=${result.pass} turns=${result.turns} ` +
`cache=${(result.cacheHitRatio * 100).toFixed(1)}% cost=$${result.costUsd.toFixed(
6,
)} (${elapsed}s)`,
);
results.push(result);
}
}
}
const report: BenchReport = { meta: buildMeta(args, tasks.length), results };
writeReport(report, args.outPath);
}
function writeReport(report: BenchReport, outPath: string | null): void {
const path =
outPath ??
`benchmarks/tau-bench/results-${new Date().toISOString().replace(/[:.]/g, "-")}.json`;
writeFileSync(path, `${JSON.stringify(report, null, 2)}\n`, "utf8");
console.log(`wrote ${path}`);
}
function isMain(): boolean {
const entry = process.argv[1];
if (!entry) return false;
return import.meta.url === pathToFileURL(entry).href;
}
if (isMain()) {
main().catch((err) => {
console.error(err);
process.exit(1);
});
}
export { main as runBench };
+341
View File
@@ -0,0 +1,341 @@
/**
* Seed task set — retail-flavored, τ-bench-inspired.
*
* Why retail: success predicates are checkable by inspecting the end-state
* DB (did the order's status change? was the refund logged?), which avoids
* LLM-judge flakiness in the reproducibility report.
*
* Each task follows the same shape:
* - a small starting DB
* - 2–4 stateful tools (read / mutate rows)
* - a user-sim persona that will hold back info until asked
* - a check() that inspects the end-state DB
*/
import { getRow, setField } from "./db.js";
import type { TaskDefinition, ToolFactory, WorldState } from "./types.js";
const RETAIL_SYSTEM = `You are a retail support agent. Use the tools to help the user.
Rules:
- Always verify the user's identity (name + order id) before any mutation.
- Never invent order ids or emails.
- If a request is outside your tools, say so honestly.
- Be concise.`;
// ---------- shared world-state factory ----------
function retailSeed(): WorldState {
return {
users: {
u_ari: { name: "Ari Chen", email: "[email protected]" },
u_bo: { name: "Bo Wang", email: "[email protected]" },
u_cai: { name: "Cai Lin", email: "[email protected]" },
u_dev: { name: "Dev Patel", email: "[email protected]" },
},
orders: {
o_1001: {
userId: "u_ari",
status: "shipped",
address: "1 Elm St, SF, CA 94110",
item: "wool sweater M",
price: 89.0,
},
o_1002: {
userId: "u_bo",
status: "processing",
address: "22 Oak Rd, NYC, NY 10001",
item: "running shoes 10",
price: 140.0,
},
o_1003: {
userId: "u_cai",
status: "delivered",
address: "9 Pine Ave, Austin, TX 78701",
item: "desk lamp",
price: 55.0,
},
o_1004: {
userId: "u_dev",
status: "processing",
address: "4 Maple Ln, Seattle, WA 98101",
item: "kettle",
price: 45.0,
},
o_1005: {
userId: "u_ari",
status: "delivered",
address: "1 Elm St, SF, CA 94110",
item: "notebook pack",
price: 22.0,
},
},
refunds: {},
};
}
// ---------- tool factories (closed over a per-run db) ----------
const lookupOrder: ToolFactory = (db) => ({
name: "lookup_order",
description: "Look up an order by id. Returns { userId, status, address, item, price } or null.",
parameters: {
type: "object",
properties: { orderId: { type: "string" } },
required: ["orderId"],
},
fn: ({ orderId }: { orderId: string }) => {
const row = getRow(db, "orders", orderId);
return row ? { orderId, ...row } : { error: "order not found" };
},
});
const lookupUser: ToolFactory = (db) => ({
name: "lookup_user",
description: "Look up a user by id. Returns { name, email } or error.",
parameters: {
type: "object",
properties: { userId: { type: "string" } },
required: ["userId"],
},
fn: ({ userId }: { userId: string }) => {
const row = getRow(db, "users", userId);
return row ? { userId, ...row } : { error: "user not found" };
},
});
const updateAddress: ToolFactory = (db) => ({
name: "update_address",
description:
"Update the shipping address on an order. Only allowed if status is 'processing'. Returns ok/error.",
parameters: {
type: "object",
properties: {
orderId: { type: "string" },
address: { type: "string" },
},
required: ["orderId", "address"],
},
fn: ({ orderId, address }: { orderId: string; address: string }) => {
const row = getRow(db, "orders", orderId);
if (!row) return { error: "order not found" };
if (row.status !== "processing") return { error: `cannot edit: status=${row.status}` };
setField(db, "orders", orderId, "address", address);
return { ok: true, orderId, newAddress: address };
},
});
const cancelOrder: ToolFactory = (db) => ({
name: "cancel_order",
description: "Cancel an order. Only allowed if status is 'processing'. Returns ok/error.",
parameters: {
type: "object",
properties: { orderId: { type: "string" } },
required: ["orderId"],
},
fn: ({ orderId }: { orderId: string }) => {
const row = getRow(db, "orders", orderId);
if (!row) return { error: "order not found" };
if (row.status !== "processing") return { error: `cannot cancel: status=${row.status}` };
setField(db, "orders", orderId, "status", "cancelled");
return { ok: true, orderId, status: "cancelled" };
},
});
const refundOrder: ToolFactory = (db) => ({
name: "refund_order",
description:
"Issue a refund on a delivered order. Records an entry in refunds. Returns ok/error.",
parameters: {
type: "object",
properties: {
orderId: { type: "string" },
reason: { type: "string" },
},
required: ["orderId", "reason"],
},
fn: ({ orderId, reason }: { orderId: string; reason: string }) => {
const row = getRow(db, "orders", orderId);
if (!row) return { error: "order not found" };
if (row.status !== "delivered") return { error: `cannot refund: status=${row.status}` };
db.refunds[orderId] = { orderId, reason, amount: row.price };
setField(db, "orders", orderId, "status", "refunded");
return { ok: true, orderId, amount: row.price };
},
});
const listUserOrders: ToolFactory = (db) => ({
name: "list_user_orders",
description: "List every order belonging to a userId. Returns an array of orders.",
parameters: {
type: "object",
properties: { userId: { type: "string" } },
required: ["userId"],
},
fn: ({ userId }: { userId: string }) => {
const all = db.orders ?? {};
const out: unknown[] = [];
for (const [orderId, row] of Object.entries(all)) {
if (row.userId === userId) out.push({ orderId, ...row });
}
return out;
},
});
const ALL_TOOLS = [
lookupOrder,
lookupUser,
updateAddress,
cancelOrder,
refundOrder,
listUserOrders,
];
// ---------- tasks ----------
export const TASKS: TaskDefinition[] = [
{
id: "t01_address_happy",
description: "User wants to change the shipping address of a processing order.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "polite, brief",
goal: "Change the shipping address on order o_1002 to '5 Birch Rd, NYC, NY 10001'.",
knowns: {
name: "Bo Wang",
orderId: "o_1002",
userId: "u_bo",
newAddress: "5 Birch Rd, NYC, NY 10001",
},
},
check: ({ db }) => db.orders.o_1002?.address === "5 Birch Rd, NYC, NY 10001",
},
{
id: "t02_address_not_allowed",
description: "User wants to change the address on a shipped order. Agent should refuse.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "insistent",
goal: "Get the address on order o_1001 changed to '99 New St, SF, CA'.",
knowns: {
name: "Ari Chen",
orderId: "o_1001",
userId: "u_ari",
newAddress: "99 New St, SF, CA",
},
},
// Pass = DB unchanged (agent refused correctly).
check: ({ db }) => db.orders.o_1001?.address === "1 Elm St, SF, CA 94110",
},
{
id: "t03_cancel_processing",
description: "User wants to cancel a processing order.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "apologetic",
goal: "Cancel order o_1004.",
knowns: { name: "Dev Patel", orderId: "o_1004", userId: "u_dev" },
},
check: ({ db }) => db.orders.o_1004?.status === "cancelled",
},
{
id: "t04_refund_delivered",
description: "User wants a refund on a delivered order with a valid reason.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "unhappy but reasonable",
goal: "Get a refund on order o_1003 because the lamp arrived broken.",
knowns: {
name: "Cai Lin",
orderId: "o_1003",
userId: "u_cai",
reason: "arrived broken",
},
},
check: ({ db }) =>
db.orders.o_1003?.status === "refunded" && db.refunds.o_1003?.amount === 55.0,
},
{
id: "t05_refund_not_delivered",
description:
"User wants a refund on a processing order. Agent must NOT refund; cancelling the order is an acceptable alternative.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "demanding",
goal: "Get a refund on order o_1002 right now.",
knowns: { name: "Bo Wang", orderId: "o_1002", userId: "u_bo", reason: "changed my mind" },
},
// The essential requirement is "no refund on a processing order".
// Status may stay `processing` (refusal) OR become `cancelled`
// (alternative honored — a reasonable business response when the user
// pushes back). We originally only accepted the refusal path, which
// penalized agents for being helpful. Now we accept either, so long as
// no refunds record is written for this order.
check: ({ db }) => {
const status = db.orders.o_1002?.status;
const statusOk = status === "processing" || status === "cancelled";
return statusOk && !db.refunds.o_1002;
},
},
{
id: "t06_multi_order_lookup",
description: "User wants to hear their full order history, then cancels one.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "chatty",
goal: "First hear every order on file for user u_ari, then cancel any that are still processing.",
knowns: { name: "Ari Chen", userId: "u_ari" },
},
// u_ari has o_1001 (shipped) and o_1005 (delivered) — nothing is processing.
// Pass = both of Ari's orders unchanged.
check: ({ db }) =>
db.orders.o_1001?.status === "shipped" && db.orders.o_1005?.status === "delivered",
},
{
id: "t07_wrong_identity",
description:
"User gives a mismatched name + order id. Agent should not mutate on unverified identity.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "confident but wrong",
goal: "Claim to be 'Bo Wang' and ask to cancel order o_1004 (which actually belongs to Dev Patel).",
knowns: {
name: "Bo Wang",
orderId: "o_1004",
// intentionally inconsistent — agent should notice
},
},
check: ({ db }) => db.orders.o_1004?.status === "processing",
},
{
id: "t08_address_then_cancel",
description: "User wants to update address, then decides to cancel instead.",
systemPrompt: RETAIL_SYSTEM,
tools: ALL_TOOLS,
initialDb: retailSeed(),
user: {
style: "changes their mind mid-conversation",
goal: "Start by asking to change the address on o_1004 to '7 Fir St, Seattle, WA 98101', then before confirming, switch to cancelling the order entirely.",
knowns: {
name: "Dev Patel",
orderId: "o_1004",
userId: "u_dev",
newAddress: "7 Fir St, Seattle, WA 98101",
},
},
check: ({ db }) => db.orders.o_1004?.status === "cancelled",
},
];
@@ -0,0 +1,57 @@
# Reference transcripts
These are the raw `.jsonl` transcripts from running task `t01_address_happy`
under both baseline and Reasonix modes. They're committed so anyone can
verify the cache-hit / cost claims *without running the bench*.
## Files
| file | what it is |
|---|---|
| `t01_address_happy.baseline.r1.jsonl` | Naive cache-hostile agent's record of the run |
| `t01_address_happy.reasonix.r1.jsonl` | Reasonix's record of the same task |
| `t01_address_happy.diff.md` | Output of `reasonix diff` on the two above |
| `mcp-demo.add.jsonl` | End-to-end run through the bundled demo MCP server. DeepSeek called the `add` tool; the second turn hit 96.6% cache, 94% cheaper than Claude at same token counts |
| `mcp-filesystem.jsonl` | End-to-end run through the **official external** `@modelcontextprotocol/server-filesystem`. 5 turns, 4 tool calls including a permission-denied recovery. Overall cache 96.7%, 97% cheaper than Claude. Proof that Cache-First generalizes to third-party MCP servers without any code change on our side |
| `mcp-multi-server.jsonl` | End-to-end run with **two MCP servers concurrently** — bundled demo (`demo_add`) + official `@modelcontextprotocol/server-filesystem` (`fs_write_file`). Model computed 17+25 on one server, wrote the result to a real file via the other. 5 turns, 4 tool calls across two subprocesses. **1 distinct prefix hash** held across all turns — Cache-First byte-stability survives running two MCP servers at once. Cache 81.1%, cost $0.00185, 95.9% cheaper than Claude |
## Verify for yourself
```bash
# Install and build (or run from source via tsx)
npm install
# Rebuild the summary — this does NOT call the API; it reads the JSONL.
npx reasonix replay benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl
# Reproduce the diff:
npx reasonix diff \
benchmarks/tau-bench/transcripts/t01_address_happy.baseline.r1.jsonl \
benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl \
--label-a baseline --label-b reasonix
```
Headline numbers from the committed run:
- cache hit: **45.9% → 93.9% (+48.0pp)**
- cost: **$0.001192 → $0.000953 (−20.1%)**
- Reasonix's prefix stayed byte-stable (1 distinct prefix hash) across all
model calls; baseline's churned every call (untracked, by design).
## Regenerate
```bash
export DEEPSEEK_API_KEY=sk-...
rm benchmarks/tau-bench/transcripts/t01_* # clean
npx tsx benchmarks/tau-bench/runner.ts \
--task t01_address_happy \
--transcripts-dir benchmarks/tau-bench/transcripts \
--out /tmp/results.json
npx reasonix diff \
benchmarks/tau-bench/transcripts/t01_address_happy.baseline.r1.jsonl \
benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl \
--label-a baseline --label-b reasonix \
--md benchmarks/tau-bench/transcripts/t01_address_happy.diff.md
```
Cost: ~$0.003 per full regeneration.
@@ -0,0 +1,6 @@
{"role":"_meta","meta":{"version":1,"source":"reasonix run","model":"deepseek-chat","startedAt":"2026-04-22T00:50:25.468Z"}}
{"ts":"2026-04-22T00:50:25.469Z","turn":1,"role":"user","content":"Use the add tool to compute 17+25, then briefly confirm the result."}
{"ts":"2026-04-22T00:50:28.556Z","turn":1,"role":"assistant_final","content":"I'll compute 17 + 25 using the add tool.","usage":{"prompt_tokens":442,"completion_tokens":70,"total_tokens":512,"prompt_cache_hit_tokens":0,"prompt_cache_miss_tokens":442},"cost":0.00019634,"model":"deepseek-chat","prefixHash":"585d4a0a16fe84b7"}
{"ts":"2026-04-22T00:50:28.557Z","turn":1,"role":"tool","content":"42","tool":"add","args":"{\"a\": 17, \"b\": 25}"}
{"ts":"2026-04-22T00:50:29.858Z","turn":1,"role":"assistant_final","content":"The result is 42. 17 + 25 = 42.","usage":{"prompt_tokens":530,"completion_tokens":15,"total_tokens":545,"prompt_cache_hit_tokens":512,"prompt_cache_miss_tokens":18},"cost":0.0000572,"model":"deepseek-chat","prefixHash":"585d4a0a16fe84b7"}
{"ts":"2026-04-22T00:50:29.858Z","turn":1,"role":"done","content":"The result is 42. 17 + 25 = 42."}
@@ -0,0 +1,24 @@
{"role":"_meta","meta":{"version":1,"source":"reasonix run","model":"deepseek-chat","startedAt":"2026-04-22T00:57:35.368Z"}}
{"ts":"2026-04-22T00:57:35.369Z","turn":1,"role":"user","content":"List the files here, then read README.md and summarize it in one sentence."}
{"ts":"2026-04-22T00:57:38.133Z","turn":1,"role":"assistant_final","content":"I'll start by listing the files in the current directory, then read the README.md file and summarize it.","usage":{"prompt_tokens":2218,"completion_tokens":64,"total_tokens":2282,"prompt_cache_hit_tokens":256,"prompt_cache_miss_tokens":1962},"cost":0.0006180599999999999,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T00:57:38.136Z","turn":1,"role":"tool","content":"ERROR: Access denied - path outside allowed directories: F:\\Reasonix not in C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"list_directory","args":"{\"path\": \".\"}"}
{"ts":"2026-04-22T00:57:40.282Z","turn":1,"role":"assistant_final","content":"Let me first check what directories are allowed:","usage":{"prompt_tokens":2337,"completion_tokens":39,"total_tokens":2376,"prompt_cache_hit_tokens":2240,"prompt_cache_miss_tokens":97},"cost":0.00022589000000000002,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T00:57:40.285Z","turn":1,"role":"tool","content":"Allowed directories:\nC:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"list_allowed_directories","args":"{}"}
{"ts":"2026-04-22T00:57:43.982Z","turn":1,"role":"assistant_final","content":"Now let me list the files in the allowed directory:","usage":{"prompt_tokens":2418,"completion_tokens":74,"total_tokens":2492,"prompt_cache_hit_tokens":2304,"prompt_cache_miss_tokens":114},"cost":0.00027346000000000006,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T00:57:43.983Z","turn":1,"role":"tool","content":"[FILE] a.txt\n[FILE] b.txt\n[FILE] README.md","tool":"list_directory","args":"{\"path\": \"C:\\\\Users\\\\yuhuahui\\\\AppData\\\\Local\\\\Temp\\\\mcp-fs-demo\"}"}
{"ts":"2026-04-22T00:57:47.317Z","turn":1,"role":"assistant_final","content":"Now let me read the README.md file:","usage":{"prompt_tokens":2526,"completion_tokens":77,"total_tokens":2603,"prompt_cache_hit_tokens":2432,"prompt_cache_miss_tokens":94},"cost":0.00028031999999999997,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T00:57:47.322Z","turn":1,"role":"tool","content":"# Sample","tool":"read_text_file","args":"{\"path\": \"C:\\\\Users\\\\yuhuahui\\\\AppData\\\\Local\\\\Temp\\\\mcp-fs-demo\\\\README.md\"}"}
{"ts":"2026-04-22T00:57:49.096Z","turn":1,"role":"assistant_final","content":"**Summary:** The directory contains three files (a.txt, b.txt, and README.md), and the README.md file simply contains the word \"Sample\".","usage":{"prompt_tokens":2622,"completion_tokens":33,"total_tokens":2655,"prompt_cache_hit_tokens":2560,"prompt_cache_miss_tokens":62},"cost":0.00023224000000000004,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T00:57:49.096Z","turn":1,"role":"done","content":"**Summary:** The directory contains three files (a.txt, b.txt, and README.md), and the README.md file simply contains the word \"Sample\"."}
{"role":"_meta","meta":{"version":1,"source":"reasonix run","model":"deepseek-chat","startedAt":"2026-04-22T01:00:29.520Z"}}
{"ts":"2026-04-22T01:00:29.521Z","turn":1,"role":"user","content":"List the files here, then read README.md and summarize it in one sentence."}
{"ts":"2026-04-22T01:00:32.502Z","turn":1,"role":"assistant_final","content":"I'll start by listing the files in the current directory and then read the README.md file.","usage":{"prompt_tokens":2218,"completion_tokens":61,"total_tokens":2279,"prompt_cache_hit_tokens":2176,"prompt_cache_miss_tokens":42},"cost":0.00023076000000000005,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T01:00:32.505Z","turn":1,"role":"tool","content":"ERROR: Access denied - path outside allowed directories: F:\\Reasonix not in C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"list_directory","args":"{\"path\": \".\"}"}
{"ts":"2026-04-22T01:00:34.833Z","turn":1,"role":"assistant_final","content":"Let me first check what directories are allowed:","usage":{"prompt_tokens":2334,"completion_tokens":39,"total_tokens":2373,"prompt_cache_hit_tokens":2240,"prompt_cache_miss_tokens":94},"cost":0.00022508,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T01:00:34.834Z","turn":1,"role":"tool","content":"Allowed directories:\nC:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"list_allowed_directories","args":"{}"}
{"ts":"2026-04-22T01:00:38.039Z","turn":1,"role":"assistant_final","content":"Now let me list the files in the allowed directory:","usage":{"prompt_tokens":2415,"completion_tokens":74,"total_tokens":2489,"prompt_cache_hit_tokens":2304,"prompt_cache_miss_tokens":111},"cost":0.00027265000000000004,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T01:00:38.042Z","turn":1,"role":"tool","content":"[FILE] a.txt\n[FILE] b.txt\n[FILE] README.md","tool":"list_directory","args":"{\"path\": \"C:\\\\Users\\\\yuhuahui\\\\AppData\\\\Local\\\\Temp\\\\mcp-fs-demo\"}"}
{"ts":"2026-04-22T01:00:41.597Z","turn":1,"role":"assistant_final","content":"Now I'll read the README.md file:","usage":{"prompt_tokens":2523,"completion_tokens":77,"total_tokens":2600,"prompt_cache_hit_tokens":2432,"prompt_cache_miss_tokens":91},"cost":0.00027951,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T01:00:41.601Z","turn":1,"role":"tool","content":"# Sample","tool":"read_text_file","args":"{\"path\": \"C:\\\\Users\\\\yuhuahui\\\\AppData\\\\Local\\\\Temp\\\\mcp-fs-demo\\\\README.md\"}"}
{"ts":"2026-04-22T01:00:43.759Z","turn":1,"role":"assistant_final","content":"**Files in the directory:** a.txt, b.txt, README.md\n\n**README.md summary:** This is a sample README file.","usage":{"prompt_tokens":2619,"completion_tokens":29,"total_tokens":2648,"prompt_cache_hit_tokens":2560,"prompt_cache_miss_tokens":59},"cost":0.00022703000000000003,"model":"deepseek-chat","prefixHash":"6a7fff6a15fd5def"}
{"ts":"2026-04-22T01:00:43.759Z","turn":1,"role":"done","content":"**Files in the directory:** a.txt, b.txt, README.md\n\n**README.md summary:** This is a sample README file."}
@@ -0,0 +1,12 @@
{"role":"_meta","meta":{"version":1,"source":"reasonix run","model":"deepseek-chat","startedAt":"2026-04-22T01:39:54.789Z"}}
{"ts":"2026-04-22T01:39:54.790Z","turn":1,"role":"user","content":"First use the add tool to compute 17+25, then use write_file to save the result to a file called answer.txt in the current working directory."}
{"ts":"2026-04-22T01:39:58.843Z","turn":1,"role":"assistant_final","content":"I'll help you with that. First, I'll compute 17+25 using the add tool, then write the result to answer.txt.","usage":{"prompt_tokens":2404,"completion_tokens":87,"total_tokens":2491,"prompt_cache_hit_tokens":256,"prompt_cache_miss_tokens":2148},"cost":0.0006935800000000001,"model":"deepseek-chat","prefixHash":"ea71560eab18d572"}
{"ts":"2026-04-22T01:39:58.844Z","turn":1,"role":"tool","content":"42","tool":"demo_add","args":"{\"a\": 17, \"b\": 25}"}
{"ts":"2026-04-22T01:40:02.898Z","turn":1,"role":"assistant_final","content":"Now I'll write the result (42) to a file called answer.txt in the current working directory:","usage":{"prompt_tokens":2509,"completion_tokens":81,"total_tokens":2590,"prompt_cache_hit_tokens":2432,"prompt_cache_miss_tokens":77},"cost":0.00028013,"model":"deepseek-chat","prefixHash":"ea71560eab18d572"}
{"ts":"2026-04-22T01:40:02.900Z","turn":1,"role":"tool","content":"ERROR: Access denied - path outside allowed directories: F:\\Reasonix\\answer.txt not in C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"fs_write_file","args":"{\"path\": \"answer.txt\", \"content\": \"42\"}"}
{"ts":"2026-04-22T01:40:05.263Z","turn":1,"role":"assistant_final","content":"I need to check which directories are allowed first. Let me check the allowed directories:","usage":{"prompt_tokens":2648,"completion_tokens":48,"total_tokens":2696,"prompt_cache_hit_tokens":2560,"prompt_cache_miss_tokens":88},"cost":0.00025576,"model":"deepseek-chat","prefixHash":"ea71560eab18d572"}
{"ts":"2026-04-22T01:40:05.270Z","turn":1,"role":"tool","content":"Allowed directories:\nC:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo","tool":"fs_list_allowed_directories","args":"{}"}
{"ts":"2026-04-22T01:40:09.422Z","turn":1,"role":"assistant_final","content":"Now I'll write the file to the allowed directory:","usage":{"prompt_tokens":2738,"completion_tokens":94,"total_tokens":2832,"prompt_cache_hit_tokens":2624,"prompt_cache_miss_tokens":114},"cost":0.00031786,"model":"deepseek-chat","prefixHash":"ea71560eab18d572"}
{"ts":"2026-04-22T01:40:09.426Z","turn":1,"role":"tool","content":"Successfully wrote to C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo\\answer.txt","tool":"fs_write_file","args":"{\"path\": \"C:\\\\Users\\\\yuhuahui\\\\AppData\\\\Local\\\\Temp\\\\mcp-fs-demo\\\\answer.txt\", \"content\": \"42\"}"}
{"ts":"2026-04-22T01:40:13.689Z","turn":1,"role":"assistant_final","content":"Perfect! I've completed both tasks:\n\n1. **Computed 17+25**: The result is 42\n2. **Saved to answer.txt**: Created the file `answer.txt` in the allowed directory with the content \"42\"\n\nThe file has been successfully written to `C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo\\answer.txt`.","usage":{"prompt_tokens":2878,"completion_tokens":83,"total_tokens":2961,"prompt_cache_hit_tokens":2816,"prompt_cache_miss_tokens":62},"cost":0.00030516,"model":"deepseek-chat","prefixHash":"ea71560eab18d572"}
{"ts":"2026-04-22T01:40:13.689Z","turn":1,"role":"done","content":"Perfect! I've completed both tasks:\n\n1. **Computed 17+25**: The result is 42\n2. **Saved to answer.txt**: Created the file `answer.txt` in the allowed directory with the content \"42\"\n\nThe file has been successfully written to `C:\\Users\\yuhuahui\\AppData\\Local\\Temp\\mcp-fs-demo\\answer.txt`."}
@@ -0,0 +1,11 @@
{"role":"_meta","meta":{"version":1,"source":"bench/baseline","model":"deepseek-chat","task":"t01_address_happy","mode":"baseline","repeat":1,"startedAt":"2026-04-21T13:21:57.995Z"}}
{"ts":"2026-04-21T13:22:00.112Z","turn":1,"role":"user","content":"Hi, I need to update the shipping address for my order o_1002."}
{"ts":"2026-04-21T13:22:03.142Z","turn":1,"role":"assistant_final","content":"I can help you update the shipping address for your order. First, I need to verify your identity. Could you please provide your name and order ID? You've already given me order ID o_1002, but I also need your name to proceed with the address update.","usage":{"prompt_tokens":733,"completion_tokens":56,"total_tokens":789,"prompt_cache_hit_tokens":64,"prompt_cache_miss_tokens":669},"cost":0.00024671000000000003,"model":"deepseek-chat"}
{"ts":"2026-04-21T13:22:04.688Z","turn":2,"role":"user","content":"My name is Bo Wang."}
{"ts":"2026-04-21T13:22:10.465Z","turn":2,"role":"assistant_final","content":"Thank you, Bo Wang. Let me first look up your order o_1002 to verify the details and check its current status.","usage":{"prompt_tokens":799,"completion_tokens":74,"total_tokens":873,"prompt_cache_hit_tokens":64,"prompt_cache_miss_tokens":735},"cost":0.00028433000000000006,"model":"deepseek-chat"}
{"ts":"2026-04-21T13:22:10.465Z","turn":2,"role":"tool","content":"{\"orderId\":\"o_1002\",\"userId\":\"u_bo\",\"status\":\"processing\",\"address\":\"22 Oak Rd, NYC, NY 10001\",\"item\":\"running shoes 10\",\"price\":140}","tool":"lookup_order","args":"{\"orderId\": \"o_1002\"}"}
{"ts":"2026-04-21T13:22:10.465Z","turn":2,"role":"assistant_final","content":"Great! I can see your order o_1002 is currently in \"processing\" status, which means I can update the shipping address. What would you like the new shipping address to be?","usage":{"prompt_tokens":932,"completion_tokens":39,"total_tokens":971,"prompt_cache_hit_tokens":832,"prompt_cache_miss_tokens":100},"cost":0.00012814,"model":"deepseek-chat"}
{"ts":"2026-04-21T13:22:11.830Z","turn":3,"role":"user","content":"Please change the shipping address to 5 Birch Rd, NYC, NY 10001."}
{"ts":"2026-04-21T13:22:19.185Z","turn":3,"role":"assistant_final","content":"Perfect! I'll update the shipping address for your order o_1002 from \"22 Oak Rd, NYC, NY 10001\" to \"5 Birch Rd, NYC, NY 10001\".","usage":{"prompt_tokens":993,"completion_tokens":112,"total_tokens":1105,"prompt_cache_hit_tokens":64,"prompt_cache_miss_tokens":929},"cost":0.00037851,"model":"deepseek-chat"}
{"ts":"2026-04-21T13:22:19.185Z","turn":3,"role":"tool","content":"{\"ok\":true,\"orderId\":\"o_1002\",\"newAddress\":\"5 Birch Rd, NYC, NY 10001\"}","tool":"update_address","args":"{\"orderId\": \"o_1002\", \"address\": \"5 Birch Rd, NYC, NY 10001\"}"}
{"ts":"2026-04-21T13:22:19.185Z","turn":3,"role":"assistant_final","content":"Success! I've updated the shipping address for your order o_1002 to \"5 Birch Rd, NYC, NY 10001\". Your order is still in processing status, and the new address will be used for shipping. Is there anything else I can help you with?","usage":{"prompt_tokens":1149,"completion_tokens":56,"total_tokens":1205,"prompt_cache_hit_tokens":1088,"prompt_cache_miss_tokens":61},"cost":0.00015423000000000002,"model":"deepseek-chat"}
@@ -0,0 +1,45 @@
# Transcript diff: baseline vs reasonix
## Meta
| | baseline | reasonix |
|---|---|---|
| source | bench/baseline | bench/reasonix |
| model | deepseek-chat | deepseek-chat |
| task | t01_address_happy | t01_address_happy |
| startedAt | 2026-04-21T13:21:57.995Z | 2026-04-21T13:22:21.292Z |
## Summary
| metric | baseline | reasonix | delta |
|---|---:|---:|---:|
| model calls | 5 | 6 | +1 |
| user turns | 3 | 3 | 0 |
| tool calls | 2 | 3 | +1 |
| cache hit | 45.9% | 93.9% | **+48.0pp** |
| cost (USD) | $0.001192 | $0.000953 | -20.1% |
| prefix hashes | 0 | 1 | — |
## Turn-by-turn
| turn | kind | baseline tool calls | reasonix tool calls | note |
|---:|:---:|---|---|---|
| 1 | diverge | — | lookup_order | tool calls differ: A=[—] B=[lookup_order] |
| 2 | diverge | lookup_order | lookup_user | tool calls differ: A=[lookup_order] B=[lookup_user] |
| 3 | diverge | update_address | update_address | text similarity 68% |
## First divergence (turn 1)
tool calls differ: A=[—] B=[lookup_order]
**baseline:**
```
I can help you update the shipping address for your order. First, I need to verify your identity. Could you please provide your name and order ID? You've already given me order ID o_1002, but I also need your name to proceed with the address update.
```
**reasonix:**
```
Great! I can see order o_1002 is in "processing" status, which means I can update the shipping address. However, I still need to verify your identity. Could you please provide your name so I can look up your user information using the user ID associated with this order?
```
@@ -0,0 +1,16 @@
{"role":"_meta","meta":{"version":1,"source":"bench/reasonix","model":"deepseek-chat","task":"t01_address_happy","mode":"reasonix","repeat":1,"startedAt":"2026-04-21T13:22:21.292Z"}}
{"ts":"2026-04-21T13:22:22.687Z","turn":1,"role":"user","content":"Hi, I need to update the shipping address for my order o_1002."}
{"ts":"2026-04-21T13:22:27.201Z","turn":1,"role":"assistant_final","content":"I can help you update the shipping address for your order o_1002. First, I need to verify your identity. Could you please provide your name and order ID? I'll look up your order to check its current status and verify the details.","usage":{"prompt_tokens":713,"completion_tokens":98,"total_tokens":811,"prompt_cache_hit_tokens":704,"prompt_cache_miss_tokens":9},"cost":0.00015951000000000002,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:27.201Z","turn":1,"role":"tool","content":"{\"orderId\":\"o_1002\",\"userId\":\"u_bo\",\"status\":\"processing\",\"address\":\"22 Oak Rd, NYC, NY 10001\",\"item\":\"running shoes 10\",\"price\":140}","tool":"lookup_order","args":"{\"orderId\": \"o_1002\"}"}
{"ts":"2026-04-21T13:22:30.465Z","turn":1,"role":"assistant_final","content":"Great! I can see order o_1002 is in \"processing\" status, which means I can update the shipping address. However, I still need to verify your identity. Could you please provide your name so I can look up your user information using the user ID associated with this order?","usage":{"prompt_tokens":870,"completion_tokens":59,"total_tokens":929,"prompt_cache_hit_tokens":768,"prompt_cache_miss_tokens":102},"cost":0.00014620000000000003,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:30.465Z","turn":1,"role":"done","content":"Great! I can see order o_1002 is in \"processing\" status, which means I can update the shipping address. However, I still need to verify your identity. Could you please provide your name so I can look up your user information using the user ID associated with this order?"}
{"ts":"2026-04-21T13:22:31.801Z","turn":2,"role":"user","content":"My name is Bo Wang."}
{"ts":"2026-04-21T13:22:34.932Z","turn":2,"role":"assistant_final","content":"Perfect, thank you Bo Wang. Let me verify your identity by looking up your user information.","usage":{"prompt_tokens":939,"completion_tokens":64,"total_tokens":1003,"prompt_cache_hit_tokens":896,"prompt_cache_miss_tokens":43},"cost":0.00014473,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:34.932Z","turn":2,"role":"tool","content":"{\"userId\":\"u_bo\",\"name\":\"Bo Wang\",\"email\":\"[email protected]\"}","tool":"lookup_user","args":"{\"userId\": \"u_bo\"}"}
{"ts":"2026-04-21T13:22:38.670Z","turn":2,"role":"assistant_final","content":"Excellent! Your identity has been verified, Bo Wang. I can see your order o_1002 is currently in \"processing\" status with the shipping address \"22 Oak Rd, NYC, NY 10001\".\n\nWhat would you like the new shipping address to be? Please provide the complete new address so I can update it for you.","usage":{"prompt_tokens":1039,"completion_tokens":68,"total_tokens":1107,"prompt_cache_hit_tokens":960,"prompt_cache_miss_tokens":79},"cost":0.00016333000000000002,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:38.670Z","turn":2,"role":"done","content":"Excellent! Your identity has been verified, Bo Wang. I can see your order o_1002 is currently in \"processing\" status with the shipping address \"22 Oak Rd, NYC, NY 10001\".\n\nWhat would you like the new shipping address to be? Please provide the complete new address so I can update it for you."}
{"ts":"2026-04-21T13:22:41.867Z","turn":3,"role":"user","content":"Please change it to 5 Birch Rd, NYC, NY 10001."}
{"ts":"2026-04-21T13:22:45.479Z","turn":3,"role":"assistant_final","content":"","usage":{"prompt_tokens":1127,"completion_tokens":72,"total_tokens":1199,"prompt_cache_hit_tokens":1088,"prompt_cache_miss_tokens":39},"cost":0.00016589000000000003,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:45.479Z","turn":3,"role":"tool","content":"{\"ok\":true,\"orderId\":\"o_1002\",\"newAddress\":\"5 Birch Rd, NYC, NY 10001\"}","tool":"update_address","args":"{\"orderId\": \"o_1002\", \"address\": \"5 Birch Rd, NYC, NY 10001\"}"}
{"ts":"2026-04-21T13:22:48.394Z","turn":3,"role":"assistant_final","content":"Perfect! I've successfully updated the shipping address for your order o_1002. The new address is now \"5 Birch Rd, NYC, NY 10001\". \n\nYour order is still in processing status and will be shipped to this new address. Is there anything else I can help you with today?","usage":{"prompt_tokens":1243,"completion_tokens":62,"total_tokens":1305,"prompt_cache_hit_tokens":1152,"prompt_cache_miss_tokens":91},"cost":0.00017341000000000004,"model":"deepseek-chat","prefixHash":"fcb40cfd555bf805"}
{"ts":"2026-04-21T13:22:48.394Z","turn":3,"role":"done","content":"Perfect! I've successfully updated the shipping address for your order o_1002. The new address is now \"5 Birch Rd, NYC, NY 10001\". \n\nYour order is still in processing status and will be shipped to this new address. Is there anything else I can help you with today?"}
+98
View File
@@ -0,0 +1,98 @@
/**
* Task and result types for the tool-use eval harness.
*
* Scope note: this is NOT a full port of Sierra's τ-bench (airline+retail).
* We mirror its *shape* — multi-turn tool-use with an LLM user simulator and
* DB-end-state success predicates — so a later port can drop real tasks in
* without changing the harness. Until then, see `tasks.ts` for our seed set.
*/
import type { ToolDefinition } from "../../src/index.js";
/**
* The mutable world state a task's tools operate on. Tasks deep-clone this
* into a per-run snapshot so runs don't leak state across each other.
*/
export interface WorldState {
[table: string]: Record<string, Record<string, unknown>>;
}
export interface UserPersona {
/** Who the user is roleplaying (e.g. "frustrated customer"). */
style: string;
/** The concrete goal. The user pursues this until it's met or clearly refused. */
goal: string;
/**
* Facts the simulator may reveal when the agent asks. Keep tight — the
* user shouldn't volunteer everything up front.
*/
knowns: Record<string, string>;
}
/**
* A tool factory. We take a factory (not a ToolDefinition directly) because
* each run needs a fresh closure over its per-run WorldState — otherwise all
* runs would share (and mutate) the same DB.
*/
export type ToolFactory = (db: WorldState) => ToolDefinition;
export interface TaskDefinition {
id: string;
/** One-line human description. Not shown to the model. */
description: string;
/** System prompt given to the agent. Kept small so cache-hit ratio is comparable. */
systemPrompt: string;
/** Tools built fresh per run against the run's DB snapshot. */
tools: ToolFactory[];
/** Initial DB snapshot. Deep-cloned per run. */
initialDb: WorldState;
/** Persona + goal for the LLM user simulator. */
user: UserPersona;
/** Max turns of (user → agent) before we give up and mark fail. */
maxTurns?: number;
/**
* Success predicate. Given the end-state DB (and optionally the final
* agent utterance), return true iff the task is considered solved.
*/
check: (ctx: { db: WorldState; finalAgentMessage: string; transcript: Turn[] }) => boolean;
}
export interface Turn {
role: "user" | "agent" | "tool";
content: string;
toolName?: string;
}
export type RunMode = "baseline" | "reasonix";
export interface RunResult {
taskId: string;
mode: RunMode;
pass: boolean;
turns: number;
toolCalls: number;
cacheHitRatio: number;
costUsd: number;
claudeEquivalentUsd: number;
promptTokens: number;
completionTokens: number;
/** True if the run aborted before the user sim decided to stop. */
truncated: boolean;
finalAgentMessage: string;
errorMessage?: string;
}
export interface BenchMeta {
date: string;
model: string;
userSimModel: string;
taskCount: number;
repeatsPerTask: number;
/** Reasonix version written into the report for reproducibility. */
reasonixVersion: string;
}
export interface BenchReport {
meta: BenchMeta;
results: RunResult[];
}
+92
View File
@@ -0,0 +1,92 @@
/**
* LLM-backed user simulator for tool-use eval.
*
* A cheap V3 call that given (persona, goal, transcript so far) emits either
* the user's next utterance or the literal sentinel `##STOP##` to end the
* conversation. Kept intentionally small and low-temperature so dialogue
* stays on-task and is replayable.
*
* We accept "some" non-determinism (DeepSeek samples at T=0.1) — the honest
* way to deal with run-to-run drift is repeat-per-task in the runner, not
* trying to pretend the sim is deterministic.
*/
import type { ChatMessage, DeepSeekClient } from "../../src/index.js";
import type { Turn, UserPersona } from "./types.js";
const SYS = `You are roleplaying a user contacting a retail support agent.
Rules:
- Stay in character; never break the fourth wall.
- Never reveal you are an AI or mention any system.
- Pursue the goal. Do not volunteer facts the agent hasn't asked for.
- Keep replies to one or two sentences.
- When the goal is clearly met OR clearly refused by the agent, output ONLY the literal token: ##STOP##
- Do not output ##STOP## on your first message — give the agent a chance.`;
export interface UserSimOptions {
model?: string;
temperature?: number;
}
export class UserSimulator {
constructor(
private client: DeepSeekClient,
private persona: UserPersona,
private opts: UserSimOptions = {},
) {}
/**
* Given the transcript so far, produce the user's next line, or null if
* the simulator decided the conversation is over.
*/
async next(transcript: Turn[]): Promise<string | null> {
const knowns = JSON.stringify(this.persona.knowns, null, 2);
const messages: ChatMessage[] = [
{
role: "system",
content: `${SYS}\n\nCharacter: ${this.persona.style}\nGoal: ${this.persona.goal}\nFacts you may share when asked (don't volunteer):\n${knowns}`,
},
];
if (transcript.length === 0) {
messages.push({
role: "user",
content:
"Write your opening message to the support agent. One or two sentences. Do not dump all the facts.",
});
} else {
messages.push({
role: "user",
content: `Here is the conversation so far (you are the USER).\n\n${transcriptToString(
transcript,
)}\n\nWrite ONLY your next user reply, or output ##STOP## if the goal is clearly met or clearly refused.`,
});
}
const resp = await this.client.chat({
model: this.opts.model ?? "deepseek-chat",
messages,
temperature: this.opts.temperature ?? 0.1,
maxTokens: 200,
});
const text = resp.content.trim();
if (!text) return null;
if (text === "##STOP##" || text.endsWith("##STOP##") || text.includes("##STOP##")) return null;
return text;
}
}
function transcriptToString(turns: Turn[]): string {
const lines: string[] = [];
for (const t of turns) {
if (t.role === "user") lines.push(`USER: ${t.content}`);
else if (t.role === "agent") lines.push(`AGENT: ${t.content}`);
else if (t.role === "tool")
lines.push(`(tool ${t.toolName} returned: ${truncate(t.content, 200)})`);
}
return lines.join("\n");
}
function truncate(s: string, n: number): string {
return s.length > n ? `${s.slice(0, n)}…` : s;
}
+29
View File
@@ -0,0 +1,29 @@
{
"$schema": "https://biomejs.dev/schemas/1.9.4/schema.json",
"organizeImports": { "enabled": true },
"formatter": {
"enabled": true,
"indentStyle": "space",
"indentWidth": 2,
"lineWidth": 100
},
"javascript": {
"formatter": { "quoteStyle": "double", "semicolons": "always", "trailingCommas": "all" }
},
"linter": {
"enabled": true,
"rules": {
"recommended": true,
"style": {
"noNonNullAssertion": "off",
"useImportType": "warn"
},
"suspicious": {
"noExplicitAny": "off"
}
}
},
"files": {
"ignore": ["dist", "node_modules", "coverage", "*.d.ts"]
}
}
Binary file not shown.
+251
View File
@@ -0,0 +1,251 @@
# Reasonix Architecture
## Design philosophy
Reasonix is **opinionated, not general**. Every abstraction is justified by a
DeepSeek-specific behavior or economic property. If it's generic, we don't
ship it.
The product north star: **coding agent that stays cheap enough to leave on**.
A tool that quietly burns $200/month on a background project is one nobody
uses. Every subsystem below is answerable to that goal.
## The four pillars
### Pillar 1 — Cache-First Loop
**Problem.** DeepSeek bills cached input at ~10% of the miss rate. Automatic
prefix caching activates only when the *exact* byte prefix of the previous
request matches. Most agent loops reorder, rewrite, or inject fresh
timestamps each turn — cache hit rate in practice: <20%.
**Solution.** Partition the context into three regions:
```
┌─────────────────────────────────────────┐
│ IMMUTABLE PREFIX │ ← fixed for session
│ system + tool_specs + few_shots │ cache hit candidate
├─────────────────────────────────────────┤
│ APPEND-ONLY LOG │ ← grows monotonically
│ [assistant₁][tool₁][assistant₂]... │ preserves prefix of prior turns
├─────────────────────────────────────────┤
│ VOLATILE SCRATCH │ ← reset each turn
│ R1 thought, transient plan state │ never sent upstream
└─────────────────────────────────────────┘
```
**Invariants:**
1. Prefix is computed once per session, hashed, and pinned.
2. Log entries are serialized in append order; no rewrites.
3. Scratch is distilled via Pillar 2 before any information from it is folded
into the log.
**Metric.** `prompt_cache_hit_tokens / (hit + miss)` exposed per-turn and
aggregated per-session. Visible in the TUI's top-bar cache cell.
### Pillar 2 — R1 Thought Harvesting *(opt-in)*
**Problem.** R1 / V4-thinking emits extensive `reasoning_content`. DeepSeek's
own docs recommend *not* feeding it back to the next turn. Most frameworks
display it to the user and discard. The planning signal inside is lost.
**Solution.** A two-stage process:
```
R1 output → Harvester (v4-flash, thinking off) → TypedPlanState
├─ subgoals: string[]
├─ hypotheses: string[]
├─ uncertainties: string[]
└─ rejectedPaths: string[]
```
The harvester is a cheap flash call with a strict JSON schema. Output is
validated at runtime. **Not enabled in any preset** (see Pillar 4) — the
additional round-trip rarely pays back, so it's `/harvest on` opt-in.
### Pillar 3 — Tool-Call Repair
**Problem.** Empirical DeepSeek failure modes:
- Tool-call JSON emitted inside `<think>`, missing from the final message.
- Arguments dropped when schema has >10 params or deeply nested objects.
- Same tool called repeatedly with identical args (call-storm).
- Truncated JSON due to `max_tokens` hit mid-structure.
**Solution.** Four passes:
1. **`flatten`** — schemas with >10 leaf params or depth >2 are auto-detected
on `ToolRegistry.register()` and presented to the model in dot-notation
form. `dispatch()` re-nests the args before calling the user's `fn`.
2. **`scavenge`** — regex + JSON parser sweeps `reasoning_content` for any tool
call the model forgot to emit in `tool_calls`.
3. **`truncation`** — detect unbalanced JSON and repair by closing braces or
requesting a continuation completion.
4. **`storm`** — identical `(tool, args)` tuple within a sliding window →
suppress the call, inject a reflection turn.
### Pillar 4 — Cost Control *(v0.6)*
**Problem.** Coding agents that default to the frontier model (v4-pro, ~12×
flash cost) and accumulate full tool results in context are $150-$250/month
for active users. Most turns don't need frontier reasoning; most sessions
re-pay for tool results that were only useful once.
**Solution.** Four complementary mechanisms, none of which require manual
tuning in the common case:
#### 4.1 Tiered defaults (flash-first)
The three presets now trade only **model tier** and **reasoning effort**:
| Preset | Model | Effort | Harvest | Branch | Cost |
|---|---|---|---|---|---:|
| `fast` | `v4-flash` | `high` | off | 1 | 1× |
| `smart` (default) | `v4-flash` | `max` | off | 1 | ~1.5× |
| `max` | `v4-pro` | `max` | off | 1 | ~12× |
**Branching and harvest are never in a preset.** Both multiply cost and
rarely pay back; `/branch N` and `/harvest on` are pure opt-ins. A user can
run for weeks without ever touching them.
All auxiliary calls — `forceSummaryAfterIterLimit`, subagent spawns,
truncation repair retries — hard-code `v4-flash + effort=high` regardless
of the user's preset. There's no reason to pay pro rates for "paraphrase
these tool results into prose" or for an `explore` subagent's grep chain.
#### 4.2 Turn-end auto-compaction
Every tool result in the log exceeding `TURN_END_RESULT_CAP_TOKENS` (3000)
is shrunk to that cap when a turn ends. The model had the full text for
the turn that read it; subsequent turns see a compact summary and can
re-read if needed. One extra `read_file` call is vastly cheaper than
dragging 12KB through every future prompt.
A proactive 40% context-ratio threshold runs the same shrink pre-emptively
inside long multi-iter turns before the 80% emergency threshold fires.
#### 4.3 `/pro` single-turn arming
Users who predict a hard task type `/pro`; the **next** turn runs on
`v4-pro`, then auto-disarms. No preset churn, no forgotten revert. Armed
state is visible as a yellow `⇧ pro armed` pill in the header.
#### 4.4 Failure-signal auto-escalation
The loop counts visible "flash is struggling" events per turn:
- `edit_file` / `write_file` SEARCH-not-found errors
- ToolCallRepair fires (scavenge / truncation-fix / storm-break)
Once the count hits `FAILURE_ESCALATION_THRESHOLD` (3), the **remainder of
the current turn** runs on `v4-pro`. Announced via a yellow warning row —
no silent cost surprises. Counter + escalation flag reset at every turn
start.
Header shows a red `⇧ pro escalated` pill while the turn is on pro.
#### Cost transparency
Per-turn and session cost are colored in the StatsPanel:
- `turn $0.003` — green <$0.05, yellow $0.05–0.20, red ≥$0.20
- `session $0.12` — same scale ×10
## Module layout
```
src/
├── client.ts # DeepSeek client (fetch + SSE)
├── loop.ts # Pillar 1 + 4 — CacheFirstLoop
├── harvest.ts # Pillar 2 — flash-backed plan-state extraction
├── repair/ # Pillar 3 pipeline
│ ├── index.ts
│ ├── scavenge.ts
│ ├── flatten.ts
│ ├── truncation.ts
│ └── storm.ts
├── prompt-fragments.ts # TUI_FORMATTING_RULES, NEGATIVE_CLAIM_RULE —
│ # reused by main + subagent + skill prompts
├── code/prompt.ts # reasonix code main system prompt
├── tools/ # Tool implementations
│ ├── filesystem.ts # read / list / search / edit / write
│ ├── shell.ts # run_command + run_background (JobRegistry)
│ ├── jobs.ts # background-process registry
│ ├── memory.ts # remember / forget / list user memories
│ ├── skills.ts # list + invoke SKILL.md playbooks
│ ├── subagent.ts # spawn_subagent — flash+high by default
│ ├── plan.ts # submit_plan (review gate)
│ └── web.ts # web_search, web_fetch
├── mcp/ # MCP client + bridge (stdio + SSE)
├── memory.ts # ImmutablePrefix / AppendOnlyLog / VolatileScratch
├── project-memory.ts # REASONIX.md loader
├── user-memory.ts # ~/.reasonix/memory/ store (project + global)
├── skills.ts # built-in explore + research skills
├── session.ts # JSONL session persistence
├── telemetry.ts # cost + cache-hit accounting + SessionSummary
├── tokenizer.ts # DeepSeek V3 tokenizer (ported)
├── usage.ts # ~/.reasonix/usage.jsonl roll-up
├── types.ts # ChatMessage, ToolCall, ToolSpec
├── index.ts # library barrel
└── cli/
├── index.ts # commander entry
├── resolve.ts # config + CLI flag precedence
├── commands/ # chat, code, run, stats, sessions, ...
└── ui/
├── App.tsx # root Ink component (~1984 LOC, was 2931)
├── LiveRows.tsx # spinner rows (OngoingTool / Status / ...)
├── EventLog.tsx # Historical row rendering
├── StatsPanel.tsx # top bar + cost badges
├── PromptInput.tsx # cursor-aware multi-line input
├── PlanConfirm.tsx # submit_plan review modal
├── ShellConfirm.tsx # run_command approval modal
├── EditConfirm.tsx # per-edit review modal
├── markdown.tsx # Ink-native markdown renderer
├── edit-history.ts # EditHistoryEntry + formatters
├── useEditHistory.ts # /undo, /history, /show state machine
├── useCompletionPickers.ts # slash, @, slash-arg pickers
├── useSessionInfo.ts # balance + models + updates fetch
├── useSubagent.ts # subagent sink wiring
└── slash/ # /-command implementation
├── types.ts # SlashContext, SlashResult, ...
├── commands.ts # SLASH_COMMANDS data + parse + suggest
├── helpers.ts # git, memory, token formatters
├── dispatch.ts # registry + handleSlash lookup
└── handlers/ # per-topic: basic, mcp, memory,
# skill, admin, observability, edits,
# jobs, sessions, model (/pro lives here)
```
Files kept small by design: the largest module under `cli/ui/` is 2K
lines (App.tsx), every handler under `slash/handlers/` is ≤200 lines,
every hook under `cli/ui/` is ≤310 lines. Adding a new slash command
means editing one handler file and one registry line.
## Design evolution
- **v0.0.x** — Pillar 1 end-to-end, Pillar 3 complete, Ink TUI scaffold.
- **v0.1** — τ-bench numbers published, streaming polish, transcript replay.
- **v0.2** — Self-consistency / branch-budget sampling driven by plan state.
- **v0.3** — MCP client (stdio + SSE), session persistence.
- **v0.4.x** — `reasonix code` with SEARCH/REPLACE edits, review/auto
gate, background jobs, hooks.
- **v0.5.x** — V4 model support, skills, memory, subagents, actionable
error messages.
- **v0.6** *(current)* —
- **Pillar 4 cost control** (flash-first defaults, auto-compaction,
`/pro` one-shot, failure-triggered escalation, cost badges).
- `deepseek-chat` / `deepseek-reasoner` scheduled for deprecation —
all user-facing surfaces updated to `v4-flash` / `v4-pro`.
- `branch` + `harvest` removed from every preset; manual opt-in only.
- Shared prompt fragments (`TUI_FORMATTING_RULES`, `NEGATIVE_CLAIM_RULE`).
- UI refactor: App.tsx split into 6 hooks/components, slash.ts split
into 13 per-topic modules.
## Explicit non-goals
- Multi-agent orchestration as a first-class concept (subagents are a
cost-reduction mechanism, not a coordination primitive).
- RAG / vector retrieval.
- Support for non-DeepSeek backends (an OpenAI-compatible shim would
work today via `--model` override, but is not tested).
- Web UI / SaaS.
- Automatic cost escalation without user-visible announcement. Every
pro-tier model call is surfaced; silent escalation was considered
and rejected.
+95
View File
@@ -0,0 +1,95 @@
<svg xmlns="http://www.w3.org/2000/svg" width="760" height="170" viewBox="0 0 760 170" role="img" aria-label="Reasonix — DeepSeek-native agent framework">
<title>Reasonix</title>
<defs>
<!-- Signature cyan → violet → fuchsia gradient used across the TUI wordmark
and the brand mark. Renders well on both GitHub dark and light bg. -->
<linearGradient id="rx-grad" x1="0%" y1="0%" x2="100%" y2="0%">
<stop offset="0%" stop-color="#5eead4"/>
<stop offset="15%" stop-color="#67e8f9"/>
<stop offset="30%" stop-color="#7dd3fc"/>
<stop offset="45%" stop-color="#93c5fd"/>
<stop offset="60%" stop-color="#a5b4fc"/>
<stop offset="75%" stop-color="#c4b5fd"/>
<stop offset="90%" stop-color="#d8b4fe"/>
<stop offset="100%" stop-color="#f0abfc"/>
</linearGradient>
<linearGradient id="rx-grad-mark" x1="0%" y1="0%" x2="100%" y2="100%">
<stop offset="0%" stop-color="#5eead4"/>
<stop offset="50%" stop-color="#93c5fd"/>
<stop offset="100%" stop-color="#c4b5fd"/>
</linearGradient>
<filter id="glow" x="-50%" y="-50%" width="200%" height="200%">
<feGaussianBlur stdDeviation="3" result="blur"/>
<feMerge>
<feMergeNode in="blur"/>
<feMergeNode in="SourceGraphic"/>
</feMerge>
</filter>
</defs>
<!-- ◈ brand mark: concentric diamonds. Outer stroke pulses,
inner fill breathes, whole group rotates slowly. The rotation
is subtle (12s / full turn) so it feels like a heartbeat, not a
spinner. -->
<g transform="translate(90, 85)" filter="url(#glow)">
<g>
<animateTransform attributeName="transform" type="rotate"
from="0" to="360" dur="18s" repeatCount="indefinite"/>
<!-- Outer hollow diamond -->
<path d="M 0,-46 L 46,0 L 0,46 L -46,0 Z"
fill="none"
stroke="url(#rx-grad-mark)"
stroke-width="3.5"
stroke-linejoin="round">
<animate attributeName="stroke-width"
values="3.5;5.5;3.5"
dur="2.4s"
repeatCount="indefinite"/>
</path>
<!-- Middle hollow diamond -->
<path d="M 0,-26 L 26,0 L 0,26 L -26,0 Z"
fill="none"
stroke="url(#rx-grad-mark)"
stroke-width="2"
stroke-linejoin="round"
opacity="0.7">
<animate attributeName="opacity"
values="0.4;0.9;0.4"
dur="2.4s"
begin="0.8s"
repeatCount="indefinite"/>
</path>
<!-- Inner solid diamond -->
<path d="M 0,-11 L 11,0 L 0,11 L -11,0 Z"
fill="url(#rx-grad-mark)">
<animate attributeName="opacity"
values="0.75;1;0.75"
dur="2.4s"
repeatCount="indefinite"/>
</path>
</g>
</g>
<!-- REASONIX wordmark with shifting gradient. The x1 offset animates
so the gradient crawls left-to-right across the letters — a
slow rainbow sweep that gives the logo life without being noisy. -->
<text x="170" y="102"
font-family="ui-monospace, SFMono-Regular, 'Cascadia Code', Menlo, Consolas, 'DejaVu Sans Mono', monospace"
font-size="68"
font-weight="800"
fill="url(#rx-grad)"
letter-spacing="6">REASONIX
<animate attributeName="opacity"
values="0.9;1;0.9"
dur="3.2s"
repeatCount="indefinite"/>
</text>
<!-- Tagline sits just below the wordmark. Slate-500 reads well on
both GitHub dark and light themes (~4.5:1 contrast either way). -->
<text x="172" y="136"
font-family="ui-monospace, SFMono-Regular, 'Cascadia Code', Menlo, Consolas, 'DejaVu Sans Mono', monospace"
font-size="15"
fill="#64748b"
letter-spacing="0.5">DeepSeek-native agent framework · cache-first loop · Ink TUI</text>
</svg>

After

Width:  |  Height:  |  Size: 3.8 KiB

+25
View File
@@ -0,0 +1,25 @@
/** Minimal example: one-shot, non-streaming. Needs DEEPSEEK_API_KEY. */
import {
CacheFirstLoop,
DeepSeekClient,
ImmutablePrefix,
loadDotenv,
} from "../src/index.js";
loadDotenv();
async function main() {
const client = new DeepSeekClient();
const prefix = new ImmutablePrefix({ system: "You are a concise assistant." });
const loop = new CacheFirstLoop({ client, prefix, stream: false });
const answer = await loop.run("In one sentence, what is prompt caching?");
console.log(answer);
console.log("---");
console.log(loop.stats.summary());
}
main().catch((err) => {
console.error(err);
process.exit(1);
});
+238
View File
@@ -0,0 +1,238 @@
/**
* Bundled demo MCP server.
*
* A minimal stdio MCP server that exposes three tools: echo, add, get_time.
* Useful for:
* - running the MCP integration end-to-end without installing
* an external server
* - giving the integration tests a real subprocess to spawn
* - showing the minimal shape of a server for folks writing their own
*
* Usage:
* npx tsx examples/mcp-server-demo.ts # speaks MCP on stdin/stdout
* reasonix chat --mcp "npx tsx examples/mcp-server-demo.ts"
*
* Spec reference: https://spec.modelcontextprotocol.io/ (2024-11-05)
* Only the subset this demo needs is implemented — initialize, tools/list,
* tools/call, notifications/initialized (no-op).
*/
import { createInterface } from "node:readline";
const PROTOCOL_VERSION = "2024-11-05";
interface JsonRpcRequest {
jsonrpc: "2.0";
id?: string | number;
method: string;
params?: unknown;
}
interface JsonRpcSuccess {
jsonrpc: "2.0";
id: string | number;
result: unknown;
}
interface JsonRpcError {
jsonrpc: "2.0";
id: string | number | null;
error: { code: number; message: string; data?: unknown };
}
const TOOLS = [
{
name: "echo",
description: "Echoes the provided message back.",
inputSchema: {
type: "object",
properties: { msg: { type: "string", description: "What to echo" } },
required: ["msg"],
},
},
{
name: "add",
description: "Adds two integers and returns the sum.",
inputSchema: {
type: "object",
properties: {
a: { type: "integer" },
b: { type: "integer" },
},
required: ["a", "b"],
},
},
{
name: "get_time",
description: "Returns the server's current ISO-8601 timestamp.",
inputSchema: { type: "object", properties: {} },
},
{
name: "slow_count",
description:
"Counts from 1 to n with a ~300 ms pause between steps, emitting notifications/progress frames along the way. Useful for demonstrating Reasonix's progress-bar UI.",
inputSchema: {
type: "object",
properties: {
n: { type: "integer", description: "Final number to count to (default 5, max 20)" },
},
},
},
];
interface JsonRpcNotification {
jsonrpc: "2.0";
method: string;
params?: unknown;
}
function send(msg: JsonRpcSuccess | JsonRpcError | JsonRpcNotification): void {
// Stdio MCP framing: one JSON per line.
process.stdout.write(`${JSON.stringify(msg)}\n`);
}
async function handleRequest(
req: JsonRpcRequest,
): Promise<JsonRpcSuccess | JsonRpcError | null> {
const id = req.id ?? null;
switch (req.method) {
case "initialize": {
return {
jsonrpc: "2.0",
id: id ?? 0,
result: {
protocolVersion: PROTOCOL_VERSION,
serverInfo: { name: "reasonix-demo-mcp", version: "0.0.1" },
capabilities: { tools: { listChanged: false } },
},
};
}
case "notifications/initialized":
// No response for notifications.
return null;
case "tools/list": {
return { jsonrpc: "2.0", id: id ?? 0, result: { tools: TOOLS } };
}
case "tools/call": {
const params = (req.params ?? {}) as {
name?: string;
arguments?: Record<string, unknown>;
_meta?: { progressToken?: string | number };
};
const name = params.name ?? "";
const args = params.arguments ?? {};
const progressToken = params._meta?.progressToken;
const out = await callTool(name, args, progressToken);
if (out.error) {
return {
jsonrpc: "2.0",
id: id ?? 0,
result: {
content: [{ type: "text", text: out.error }],
isError: true,
},
};
}
return {
jsonrpc: "2.0",
id: id ?? 0,
result: { content: [{ type: "text", text: out.text }] },
};
}
default:
return {
jsonrpc: "2.0",
id,
error: { code: -32601, message: `method not found: ${req.method}` },
};
}
}
async function callTool(
name: string,
args: Record<string, unknown>,
progressToken: string | number | undefined,
): Promise<{ text: string; error?: string }> {
if (name === "echo") {
const msg = typeof args.msg === "string" ? args.msg : "";
return { text: `echo: ${msg}` };
}
if (name === "add") {
const a = typeof args.a === "number" ? args.a : Number(args.a);
const b = typeof args.b === "number" ? args.b : Number(args.b);
if (!Number.isFinite(a) || !Number.isFinite(b)) {
return { text: "", error: "add: both a and b must be numbers" };
}
return { text: String(a + b) };
}
if (name === "get_time") {
return { text: new Date().toISOString() };
}
if (name === "slow_count") {
// Cap at 20 so an over-eager model can't make the demo run for
// minutes. Default 5 gives ~1.5s which is plenty to see the bar.
const raw = typeof args.n === "number" ? args.n : Number(args.n);
const n = Number.isFinite(raw) && raw >= 1 ? Math.min(Math.floor(raw), 20) : 5;
for (let i = 1; i <= n; i++) {
await new Promise((r) => setTimeout(r, 300));
if (progressToken !== undefined) {
send({
jsonrpc: "2.0",
method: "notifications/progress",
params: {
progressToken,
progress: i,
total: n,
message: `counting ${i} of ${n}`,
},
});
}
}
return { text: `counted to ${n}` };
}
return { text: "", error: `unknown tool: ${name}` };
}
function main(): void {
const rl = createInterface({ input: process.stdin, crlfDelay: Number.POSITIVE_INFINITY });
rl.on("line", (line) => {
const trimmed = line.trim();
if (!trimmed) return;
let req: JsonRpcRequest;
try {
req = JSON.parse(trimmed) as JsonRpcRequest;
} catch {
// malformed input — respond with parse error
send({
jsonrpc: "2.0",
id: null,
error: { code: -32700, message: "parse error" },
});
return;
}
// Fire-and-forget: handleRequest is async so slow tools (slow_count
// and any future streamed-progress tools) can emit notifications
// between in-flight requests without blocking the reader loop. Any
// unexpected throw lands as an internal-error response so malformed
// tool logic doesn't silently hang the client.
handleRequest(req)
.then((resp) => {
if (resp) send(resp);
})
.catch((err) => {
send({
jsonrpc: "2.0",
id: req.id ?? null,
error: { code: -32603, message: `internal: ${(err as Error).message}` },
});
});
});
rl.on("close", () => process.exit(0));
}
main();
+70
View File
@@ -0,0 +1,70 @@
/**
* Library example: programmatic replay + diff.
*
* This example runs with no API key and no DeepSeek calls — it reads the
* reference transcripts committed at benchmarks/tau-bench/transcripts/ and
* reconstructs the v0.1 cache-hit / cost numbers offline.
*
* Run from the repo root:
* npx tsx examples/replay-and-diff.ts
*
* Anything you can do with `reasonix replay` / `reasonix diff` is available
* here as a function you can drive from your own scripts (CI gates, eval
* dashboards, blog post generation, etc.).
*/
import {
computeReplayStats,
diffTranscripts,
readTranscript,
renderDiffSummary,
} from "../src/index.js";
const BASELINE = "benchmarks/tau-bench/transcripts/t01_address_happy.baseline.r1.jsonl";
const REASONIX = "benchmarks/tau-bench/transcripts/t01_address_happy.reasonix.r1.jsonl";
// ---------- 1. Replay a single transcript as pure data ----------
const parsed = readTranscript(REASONIX);
const stats = computeReplayStats(parsed.records);
console.log("=== Reasonix side, computed from transcript alone ===");
console.log(` model calls: ${stats.turns}`);
console.log(` cache hit: ${(stats.cacheHitRatio * 100).toFixed(1)}%`);
console.log(` total cost: $${stats.totalCostUsd.toFixed(6)}`);
console.log(` vs claude estimate: $${stats.claudeEquivalentUsd.toFixed(6)}`);
console.log(` savings: ${stats.savingsVsClaudePct.toFixed(1)}%`);
console.log(` prefix hashes: ${stats.prefixHashes.length} distinct`);
if (stats.prefixHashes.length === 1) {
console.log(` → byte-stable: ${stats.prefixHashes[0]?.slice(0, 16)}…`);
}
console.log();
// ---------- 2. Diff two transcripts ----------
const aParsed = readTranscript(BASELINE);
const bParsed = readTranscript(REASONIX);
const report = diffTranscripts(
{ label: "baseline", parsed: aParsed },
{ label: "reasonix", parsed: bParsed },
);
// renderDiffSummary returns a monochrome stdout-ready string. Equivalent to
// what `reasonix diff --print` outputs.
console.log(renderDiffSummary(report));
// ---------- 3. Direct programmatic access to pairs ----------
//
// You can also inspect report.pairs directly — useful for writing custom
// filters like "show me only the turns where tool calls differed".
console.log("\n=== Turns where A and B took different paths ===");
const divergent = report.pairs.filter((p) => p.kind !== "match");
if (divergent.length === 0) {
console.log(" (none — both agents followed the same path on every turn)");
} else {
for (const p of divergent) {
console.log(` turn ${p.turn}: ${p.kind}${p.divergenceNote ? ` — ${p.divergenceNote}` : ""}`);
}
}
+43
View File
@@ -0,0 +1,43 @@
/** Tool-use example: register a calculator tool. Needs DEEPSEEK_API_KEY. */
import {
CacheFirstLoop,
DeepSeekClient,
ImmutablePrefix,
ToolRegistry,
loadDotenv,
} from "../src/index.js";
loadDotenv();
const tools = new ToolRegistry();
tools.register<{ a: number; b: number }, number>({
name: "add",
description: "Add two integers.",
parameters: {
type: "object",
properties: {
a: { type: "integer" },
b: { type: "integer" },
},
required: ["a", "b"],
},
fn: ({ a, b }) => a + b,
});
async function main() {
const client = new DeepSeekClient();
const prefix = new ImmutablePrefix({
system: "You are a calculator assistant. Use the `add` tool for addition.",
toolSpecs: tools.specs(),
});
const loop = new CacheFirstLoop({ client, prefix, tools });
const answer = await loop.run("What is 17 + 25?");
console.log("answer:", answer);
console.log("stats:", loop.stats.summary());
}
main().catch((err) => {
console.error(err);
process.exit(1);
});
+3296
View File
File diff suppressed because it is too large. Load diff
+76
View File
@@ -0,0 +1,76 @@
{
"name": "reasonix",
"version": "0.7.1",
"description": "DeepSeek-native coding agent: cache-first loop, flash-first cost control, tool-call repair.",
"type": "module",
"bin": {
"reasonix": "dist/cli/index.js"
},
"main": "./dist/index.js",
"module": "./dist/index.js",
"types": "./dist/index.d.ts",
"exports": {
".": {
"types": "./dist/index.d.ts",
"import": "./dist/index.js"
}
},
"files": [
"dist",
"data/deepseek-tokenizer.json.gz",
"README.md",
"LICENSE"
],
"scripts": {
"build": "tsup",
"dev": "tsx src/cli/index.ts",
"chat": "tsx src/cli/index.ts chat",
"test": "vitest run",
"test:watch": "vitest",
"lint": "biome check src tests",
"lint:fix": "biome check --write src tests",
"format": "biome format --write src tests",
"typecheck": "tsc --noEmit",
"prepublishOnly": "npm run lint && npm run typecheck && npm run test && npm run build"
},
"keywords": [
"agent",
"llm",
"deepseek",
"r1",
"tool-use",
"prompt-cache",
"cli",
"tui"
],
"author": "esengine",
"license": "MIT",
"repository": {
"type": "git",
"url": "git+https://github.com/esengine/reasonix.git"
},
"bugs": {
"url": "https://github.com/esengine/reasonix/issues"
},
"homepage": "https://github.com/esengine/reasonix#readme",
"engines": {
"node": ">=20.10"
},
"dependencies": {
"commander": "^12.1.0",
"eventsource-parser": "^3.0.0",
"ink": "^5.1.0",
"ink-spinner": "^5.0.0",
"ink-text-input": "^6.0.0",
"react": "^18.3.1"
},
"devDependencies": {
"@biomejs/biome": "^1.9.4",
"@types/node": "^22.9.0",
"@types/react": "^18.3.12",
"tsup": "^8.3.5",
"tsx": "^4.19.2",
"typescript": "^5.6.3",
"vitest": "^2.1.5"
}
}
+34
View File
@@ -0,0 +1,34 @@
#!/usr/bin/env node
/**
* Regenerate `data/deepseek-tokenizer.json.gz` from an upstream
* `tokenizer.json` (as shipped in DeepSeek's deepseek_v3_tokenizer.zip).
*
* Why slim+gz: the full tokenizer.json is 7.5MB; we only need four
* fields (vocab, merges, pre_tokenizer, added_tokens). Strip + gzip
* drops the committed artifact to ~1.7MB with no loss of fidelity
* for encode-side token counting.
*
* Usage: `node --experimental-strip-types scripts/prepare-tokenizer.ts <path/to/tokenizer.json>`
* (or via `tsx` / `ts-node`.)
*/
import { readFileSync, writeFileSync } from "node:fs";
import { join } from "node:path";
import { gzipSync } from "node:zlib";
const src = process.argv[2];
if (!src) {
process.stderr.write("usage: prepare-tokenizer.ts <tokenizer.json>\n");
process.exit(2);
}
const raw = JSON.parse(readFileSync(src, "utf8"));
const slim = {
added_tokens: raw.added_tokens,
pre_tokenizer: raw.pre_tokenizer,
model: { type: raw.model.type, vocab: raw.model.vocab, merges: raw.model.merges },
};
const gz = gzipSync(Buffer.from(JSON.stringify(slim)), { level: 9 });
const outPath = join(process.cwd(), "data", "deepseek-tokenizer.json.gz");
writeFileSync(outPath, gz);
process.stdout.write(`wrote ${outPath} (${(gz.length / 1024).toFixed(1)} KB)\n`);
+192
View File
@@ -0,0 +1,192 @@
/**
* End-to-end smoke test for the memory layer. Runs against a temp
* homeDir so the developer's real ~/.reasonix/memory/ is never touched.
* Exercises: write → index regeneration → prefix assembly →
* recall → delete → REASONIX_MEMORY=off short-circuit.
*
* Run: npx tsx scripts/smoke-memory.mts
* Exit code 0 on success, 1 on any assertion failure.
*/
import { existsSync, mkdtempSync, readFileSync, rmSync, writeFileSync } from "node:fs";
import { tmpdir } from "node:os";
import { join } from "node:path";
import { ToolRegistry } from "../src/tools.js";
import { registerMemoryTools } from "../src/tools/memory.js";
import {
MemoryStore,
applyMemoryStack,
applyUserMemory,
projectHash,
} from "../src/user-memory.js";
let failures = 0;
function check(label: string, cond: unknown, detail?: string) {
if (cond) {
process.stdout.write(` ✓ ${label}\n`);
} else {
failures++;
process.stdout.write(` ✗ ${label}${detail ? ` — ${detail}` : ""}\n`);
}
}
async function main() {
const home = mkdtempSync(join(tmpdir(), "reasonix-smoke-home-"));
const projectRoot = mkdtempSync(join(tmpdir(), "reasonix-smoke-proj-"));
process.stdout.write(`home: ${home}\nproject: ${projectRoot}\n\n`);
try {
// ── 1. MemoryStore write + index regeneration ────────────────────
process.stdout.write("1. MemoryStore write → index regen\n");
const store = new MemoryStore({ homeDir: home, projectRoot });
store.write({
name: "bun_build",
type: "project",
scope: "project",
description: "Build command on this machine is `bun run build`",
body: "On this machine, no npm — always `bun run build` / `bun run test`.",
});
store.write({
name: "tabs_not_spaces",
type: "user",
scope: "global",
description: "Use tabs for indentation across all projects",
body: "Rule.\n\n**Why:** muscle memory, editor config across machines.\n\n**How to apply:** always tabs.",
});
const hash = projectHash(projectRoot);
const projectFile = join(home, "memory", hash, "bun_build.md");
const globalFile = join(home, "memory", "global", "tabs_not_spaces.md");
check("project-scoped file landed in <hash>/ dir", existsSync(projectFile));
check("global-scoped file landed in global/ dir", existsSync(globalFile));
check("no cross-contamination project ⇒ global", !existsSync(join(home, "memory", "global", "bun_build.md")));
const projectIndex = readFileSync(join(home, "memory", hash, "MEMORY.md"), "utf8");
check("project MEMORY.md points at bun_build.md", projectIndex.includes("[bun_build](bun_build.md)"));
const globalIndex = readFileSync(join(home, "memory", "global", "MEMORY.md"), "utf8");
check("global MEMORY.md points at tabs_not_spaces.md", globalIndex.includes("[tabs_not_spaces](tabs_not_spaces.md)"));
const raw = readFileSync(projectFile, "utf8");
check("frontmatter has name/type/scope/created", /^---\nname: bun_build\n/.test(raw) && /type: project/.test(raw) && /scope: project/.test(raw) && /created: \d{4}-\d{2}-\d{2}/.test(raw));
// ── 2. Prefix assembly via applyMemoryStack (+ REASONIX.md) ────────
process.stdout.write("\n2. Prefix assembly (REASONIX.md + user memory)\n");
writeFileSync(join(projectRoot, "REASONIX.md"), "# Project notes\nPrefer explicit types over inference.\n", "utf8");
const BASE = "You are a test assistant.";
const withProjOnly = applyUserMemory(BASE, { homeDir: home, projectRoot });
check("applyUserMemory contains global block", withProjOnly.includes("# User memory — global"));
check("applyUserMemory contains project block", withProjOnly.includes("# User memory — this project"));
check("bun_build description present in prefix", withProjOnly.includes("bun run build"));
check("tabs_not_spaces description present in prefix", withProjOnly.includes("Use tabs for indentation"));
// Order: base → (REASONIX.md would go first via applyMemoryStack) → global → project
const ordered = applyUserMemory(BASE, { homeDir: home, projectRoot });
const iGlobalBlock = ordered.indexOf("# User memory — global");
const iProjBlock = ordered.indexOf("# User memory — this project");
check("global block precedes project block (stable for cache)", iGlobalBlock > 0 && iGlobalBlock < iProjBlock);
// Determinism — two calls with same state produce byte-identical prompts.
const a = applyUserMemory(BASE, { homeDir: home, projectRoot });
const b = applyUserMemory(BASE, { homeDir: home, projectRoot });
check("applyUserMemory is deterministic (byte-stable)", a === b);
// ── 3. The `remember` / `recall_memory` / `forget` tools ───────────
process.stdout.write("\n3. Tool dispatch (remember / recall / forget)\n");
const reg = new ToolRegistry();
registerMemoryTools(reg, { homeDir: home, projectRoot });
check("remember tool registered", reg.has("remember"));
check("forget tool registered", reg.has("forget"));
check("recall_memory tool registered", reg.has("recall_memory"));
check("recall_memory is readOnly (plan-mode safe)", reg.get("recall_memory")?.readOnly === true);
check("remember is NOT readOnly (plan-mode blocked)", reg.get("remember")?.readOnly !== true);
const remOut = await reg.dispatch("remember", {
type: "feedback",
scope: "global",
name: "prefers_short_replies",
description: "User wants terse answers, no trailing summaries",
content: "Default to terse. If the user wants detail they'll ask.",
});
check("remember returns a confirmation (not an error)", remOut.includes("REMEMBERED (global/prefers_short_replies)"), remOut);
const recallOut = await reg.dispatch("recall_memory", {
scope: "global",
name: "prefers_short_replies",
});
check("recall_memory returns the body", recallOut.includes("Default to terse"));
const forgetOut = await reg.dispatch("forget", {
scope: "global",
name: "prefers_short_replies",
});
check("forget returns a confirmation", forgetOut.includes("forgot (global/prefers_short_replies)"));
check("recall_memory after forget returns an error", (await reg.dispatch("recall_memory", { scope: "global", name: "prefers_short_replies" })).includes("error"));
// ── 4. Project scope refused when projectRoot is absent ────────────
process.stdout.write("\n4. Chat-mode (no projectRoot) refuses project scope\n");
const chatReg = new ToolRegistry();
registerMemoryTools(chatReg, { homeDir: home });
const projInChat = await chatReg.dispatch("remember", {
type: "project",
scope: "project",
name: "should_fail",
description: "d",
content: "c",
});
check("scope='project' in chat mode → error payload", projInChat.includes("error") && projInChat.includes("project"));
const globalInChat = await chatReg.dispatch("remember", {
type: "user",
scope: "global",
name: "global_from_chat",
description: "works across projects",
content: "body",
});
check("scope='global' in chat mode → writes successfully", globalInChat.includes("REMEMBERED (global/"));
// ── 5. REASONIX_MEMORY=off short-circuit ───────────────────────────
process.stdout.write("\n5. REASONIX_MEMORY=off opt-out\n");
process.env.REASONIX_MEMORY = "off";
try {
const silenced = applyUserMemory(BASE, { homeDir: home, projectRoot });
check("applyUserMemory returns BASE unchanged when off", silenced === BASE);
const fullStack = applyMemoryStack(BASE, projectRoot);
check("applyMemoryStack returns BASE unchanged when off (REASONIX.md also skipped)", fullStack === BASE);
} finally {
delete process.env.REASONIX_MEMORY;
}
// ── 6. Delete regeneration: MEMORY.md matches current file set ─────
process.stdout.write("\n6. Delete + index regeneration\n");
store.delete("global", "tabs_not_spaces");
store.delete("global", "global_from_chat");
const globalIdxAfter = join(home, "memory", "global", "MEMORY.md");
check("global MEMORY.md removed when last file deleted", !existsSync(globalIdxAfter));
const projectIdxStill = readFileSync(join(home, "memory", hash, "MEMORY.md"), "utf8");
check("project MEMORY.md untouched (different scope)", projectIdxStill.includes("bun_build"));
// ── 7. Name-sanitization boundary ──────────────────────────────────
process.stdout.write("\n7. Name sanitization (path-traversal refused)\n");
const badOut = await reg.dispatch("remember", {
type: "user",
scope: "global",
name: "../../etc/passwd",
description: "d",
content: "c",
});
check("remember refuses path-traversal name", badOut.includes("invalid memory name"));
const outsideFile = join(home, "etc", "passwd.md");
check("no file written outside the memory dir", !existsSync(outsideFile));
process.stdout.write(`\n${failures === 0 ? "✅ all smoke checks passed" : `❌ ${failures} failure(s)`}\n`);
} finally {
rmSync(home, { recursive: true, force: true });
rmSync(projectRoot, { recursive: true, force: true });
}
process.exit(failures === 0 ? 0 : 1);
}
main().catch((err) => {
console.error(err);
process.exit(1);
});
-16
View File
@@ -1,16 +0,0 @@
import { defineConfig } from 'astro/config';
import sitemap from '@astrojs/sitemap';
// Served from the custom domain reasonix.io at the site root.
export default defineConfig({
site: 'https://reasonix.io',
// Documentation code samples intentionally use source newlines as content.
// Astro 7's JSX-style compression removes those newlines unless disabled.
compressHTML: false,
build: { assets: 'static' },
integrations: [sitemap({
filter: (page) => !/\/changelog\/(?:stable|preview|studio)\/?$/.test(page) &&
!/\/changelog\/v\d+\.\d+\.\d+-/.test(page) &&
!/\/(?:login|register|forgot|reset|account|device|u)\/?$/.test(page),
})],
});
-4248
View File
File diff suppressed because it is too large. Load diff
-25
View File
@@ -1,25 +0,0 @@
{
"name": "reasonix-site",
"type": "module",
"private": true,
"scripts": {
"dev": "astro dev",
"prebuild": "node scripts/releases/sync-releases.mjs && node scripts/fetch-community.mjs && node scripts/fetch-publications.mjs",
"build": "astro build",
"preview": "astro preview",
"test": "node --test src/scripts/*.test.mjs scripts/releases/*.test.mjs",
"release:validate": "node scripts/releases/release-notes.mjs validate"
},
"dependencies": {
"@astrojs/sitemap": "^3.7.4",
"@fontsource-variable/inter": "^5.3.0",
"@fontsource-variable/jetbrains-mono": "^5.3.0",
"astro": "^7.3.1"
},
"devDependencies": {
"sharp": "^0.35.3"
},
"overrides": {
"esbuild": "0.28.1"
}
}
Binary file not shown.

Before

Width:  |  Height:  |  Size: 91 KiB

-1
View File
@@ -1 +0,0 @@
<svg xmlns="http://www.w3.org/2000/svg" width="296" height="296" viewBox="0 0 296 296" class="segno"><title>QQ group 1093562660 join QR code</title><g transform="scale(8)"><path fill="#fff" d="M0 0h37v37h-37z"/><path class="qrline" stroke="#000" d="M4 4.5h7m2 0h1m1 0h1m2 0h1m2 0h1m1 0h2m1 0h7m-29 1h1m5 0h1m5 0h1m3 0h2m2 0h1m1 0h1m5 0h1m-29 1h1m1 0h3m1 0h1m2 0h4m1 0h2m1 0h1m2 0h1m1 0h1m1 0h3m1 0h1m-29 1h1m1 0h3m1 0h1m6 0h1m2 0h1m1 0h3m1 0h1m1 0h3m1 0h1m-29 1h1m1 0h3m1 0h1m11 0h1m1 0h1m1 0h1m1 0h3m1 0h1m-29 1h1m5 0h1m1 0h5m2 0h3m1 0h1m2 0h1m5 0h1m-29 1h7m1 0h1m1 0h1m1 0h1m1 0h1m1 0h1m1 0h1m1 0h1m1 0h7m-20 1h1m1 0h3m1 0h3m-18 1h1m2 0h1m1 0h2m1 0h1m1 0h2m2 0h1m1 0h1m1 0h2m1 0h1m1 0h1m-21 1h1m1 0h1m1 0h2m1 0h1m2 0h1m1 0h4m1 0h1m1 0h1m2 0h1m2 0h1m-29 1h4m1 0h4m1 0h2m1 0h3m2 0h2m3 0h5m-28 1h4m4 0h1m3 0h2m2 0h1m9 0h2m-28 1h2m2 0h1m1 0h1m1 0h5m1 0h2m1 0h1m1 0h2m1 0h2m1 0h1m1 0h2m-28 1h1m1 0h2m3 0h1m2 0h1m1 0h4m1 0h2m1 0h1m-22 1h2m1 0h2m1 0h1m1 0h1m1 0h1m1 0h3m3 0h1m1 0h2m1 0h1m1 0h4m-28 1h2m1 0h2m2 0h1m1 0h1m4 0h1m1 0h1m1 0h1m1 0h2m1 0h2m1 0h1m-28 1h4m2 0h2m1 0h3m1 0h1m3 0h3m1 0h1m5 0h1m-27 1h2m2 0h1m1 0h1m2 0h1m1 0h5m1 0h1m2 0h2m2 0h1m2 0h1m-29 1h1m1 0h2m1 0h6m3 0h5m3 0h3m2 0h2m-27 1h2m4 0h1m1 0h2m2 0h1m2 0h1m1 0h2m3 0h1m2 0h2m-29 1h1m2 0h1m2 0h1m2 0h1m5 0h3m1 0h6m1 0h1m-19 1h2m1 0h2m1 0h2m1 0h4m3 0h1m1 0h3m-29 1h7m2 0h1m2 0h1m4 0h2m1 0h1m1 0h1m1 0h1m2 0h1m-28 1h1m5 0h1m1 0h2m1 0h1m2 0h2m3 0h2m3 0h5m-29 1h1m1 0h3m1 0h1m2 0h2m1 0h1m3 0h3m1 0h5m2 0h1m-28 1h1m1 0h3m1 0h1m1 0h2m2 0h2m1 0h2m1 0h2m2 0h5m1 0h1m-29 1h1m1 0h3m1 0h1m2 0h2m1 0h1m1 0h1m2 0h4m3 0h3m1 0h1m-29 1h1m5 0h1m2 0h1m2 0h1m1 0h1m2 0h1m1 0h2m1 0h1m4 0h1m-28 1h7m1 0h1m3 0h2m2 0h2m2 0h3m1 0h1m2 0h1"/></g></svg>

Before

Width:  |  Height:  |  Size: 1.6 KiB

-16
View File
@@ -1,16 +0,0 @@
<?xml version="1.0" encoding="UTF-8"?>
<svg id="_图层_1" data-name=" 图层 1" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
<defs>
<style>
.cls-1 {
fill: #fff;
}
.cls-2 {
fill: #0153e5;
}
</style>
</defs>
<rect class="cls-2" y="0" width="64" height="64" rx="20.22" ry="20.22"/>
<path class="cls-1" d="M40.53,37.67h0c2.26-.67,4.24-1.86,5.83-3.59h0c1.73-1.94,2.82-4.29,3.2-6.87.86-5.64-1.94-10.79-7.21-12.97-1.85-.74-3.76-1.06-5.78-1.04h-19.6v37.56h9.64v-12.68c1.05.34,2.16.52,3.29.52l3.15,4.35,5.73,7.83,11.44-.02-9.7-13.1h0ZM40.14,35.94c-1.31.43-2.72.37-4.06-.02-2.3-1.74-3.55-3.6-5.52-5.37-2.52-2.27-5.84-3.84-9.25-3.69.27-.74.66-1.45,1.17-2.11,1.76-2.2,4.16-2.9,6.92-2.51,1.02.14,2.11-1.05,4.18-.82.14.02.28.12.29.2.05.28-.75.44-.75,1.21,0,.32.15.7.45.92,1.06.74,1.97,1.57,2.93,2.43.47.42,2.04,1.59,2.44.64.24-.56.39-1.14.54-1.74.08-.29-.09-.47-.32-.61-1.63-.96-2.24-2.97-1.6-4.75.06-.17.22-.25.36-.26.55-.02.25.99,1.61,1.4,1.28.4,1.32,1.46,1.94,1.04,1.45-.99,1.97-.18,3.32-1.45.14-.13.38-.14.52-.04.09.06.17.22.16.41-.04,1.07-.46,2.1-1.19,2.88-1.39,1.49-2.55.77-2.62,1.82-.22,3.06-1.22,6.11-3.39,8.33-.07.07-.11.17-.1.24.01.07.1.14.19.17l1.83.62c.26.09.45.32.41.57-.03.22-.2.41-.45.49h0Z"/>
</svg>

Before

Width:  |  Height:  |  Size: 1.2 KiB

-21
View File
@@ -1,21 +0,0 @@
<?xml version="1.0" encoding="UTF-8"?>
<svg id="_图层_1" data-name=" 图层 1" xmlns="http://www.w3.org/2000/svg" width="1151.55" height="217.07" viewBox="0 0 1151.55 217.07">
<defs>
<style>
.cls-1 {
fill: #0153e5;
}
</style>
</defs>
<circle class="cls-1" cx="972.16" cy="33.55" r="23.88"/>
<g>
<path class="cls-1" d="M488.72,211.37c-12.37,1.71-24.96.46-38.13.63l-1.23-16.27c-12.87,14.9-29.84,21.97-49.07,19.87-24.58-2.69-44.41-19.38-53.2-42.6-7.32-19.32-6.99-40.86.81-60.12,9.5-23.46,30.72-40.21,55.73-42.02,18.41-1.33,34.33,4.84,45.96,18.54l1.13-15.37,37.63-.22.36,137.56h.01ZM451.41,143.22c0-19.82-16.06-35.88-35.88-35.88s-35.88,16.06-35.88,35.88,16.06,35.88,35.88,35.88,35.88-16.06,35.88-35.88Z"/>
<path class="cls-1" d="M294.69,165.71c11.08,4.99,20.6,11.87,31.28,18.31-14.54,22.26-39.3,32.78-65.14,31.91-42.29-1.42-73.12-35.5-70.7-77.31,2.1-36.29,28.66-64.56,65.17-67.92,26.31-2.42,52.01,8.19,66.02,30.99,9.52,15.5,11.55,33.39,9.76,50.92l-101,.13c1.4,14.77,13.51,25.01,25.92,27.74,14.72,3.24,29.02-.82,38.69-14.77h0ZM294.02,127.16c-4.12-16.52-17.68-24.4-32.5-24.13-13.74.25-27.5,9.07-30.5,24.11l63,.02h0Z"/>
<path class="cls-1" d="M780.3,143.31c0,40.74-33.02,73.76-73.76,73.76s-73.76-33.02-73.76-73.76,33.02-73.76,73.76-73.76,73.76,33.02,73.76,73.76ZM742.63,143.26c0-19.97-16.19-36.16-36.16-36.16s-36.16,16.19-36.16,36.16,16.19,36.16,36.16,36.16,36.16-16.19,36.16-36.16Z"/>
<path class="cls-1" d="M865.82,106.67c-16.4-.48-30.2,10.42-30.32,26.41l-.59,78.88-38.91-.18.06-137.83,38.15.35c.41,5.66-1.03,9.97,1.45,15.75,19.54-26.51,63.34-25.07,82.95-1.16,9.2,11.23,13.46,25.62,13.45,40.38l-.06,82.62-38.94.14-.69-79.28c-.13-14.92-10.82-25.64-26.54-26.1v.02h-.01Z"/>
<path class="cls-1" d="M1151.55,211.51l-44.84.51-29.9-41.82-30.52,41.81-43.29-.52,50.71-70.03-48.12-67.06c16.29-1.81,30.31-.14,45.42-.02l26.06,38.81,27.14-39.29c14.85-.38,28.79-.61,44.5.69l-47.96,66.65,50.79,70.28h0Z"/>
<path class="cls-1" d="M595.11,210.55c-30.01,11.52-78.69,6.96-94.37-27.63l29.88-14.4c4.49,1.96,5.5,6.8,9.44,9.49,16.43,11.17,43.99,9.75,44.36-4.61.12-4.72-3.46-8.89-8.58-10.29l-36.51-9.95c-11.77-3.21-22.59-9.81-28.13-21.2-10.25-21.06.12-45.53,21.63-54.96,29.01-12.72,77.53-8.27,89.7,25.13l-29.06,12.62c-10.47-12.8-27.66-16.84-42.64-10.42-3.51,1.5-5.54,6.03-5.28,8.81.35,3.7,3.39,7.71,7.59,8.86l40.46,11.09c9.77,2.68,19.02,7.82,24.29,16.77,13.52,22.96,2.31,51.05-22.78,60.69h0Z"/>
<rect class="cls-1" x="902.92" y="123.55" width="138.32" height="38.82" transform="translate(828.4464 1114.9374) rotate(-89.96)"/>
<path class="cls-1" d="M134.57,139.75l.02-.02c12.9-3.8,24.24-10.63,33.31-20.48v-.03c9.89-11.07,16.1-24.46,18.25-39.19,4.93-32.21-11.06-61.62-41.17-74.07C134.39,1.71,123.51-.11,111.97,0L0,.03v214.57l55.04-.04v-72.42c6,1.93,12.33,2.97,18.82,2.94l18.02,24.87,32.75,44.72,65.37-.09-55.43-74.84h0ZM132.36,129.86c-7.5,2.48-15.55,2.11-23.21-.12-13.17-9.95-20.3-20.57-31.51-30.7-14.37-12.97-33.39-21.96-52.86-21.08,1.55-4.25,3.78-8.31,6.68-12.03,10.05-12.55,23.77-16.55,39.52-14.34,5.82.82,12.03-6.02,23.86-4.7.79.09,1.6.68,1.67,1.16.27,1.61-4.3,2.49-4.3,6.9,0,1.86.83,4.01,2.59,5.24,6.03,4.23,11.26,8.99,16.72,13.9,2.66,2.39,11.66,9.1,13.95,3.64,1.34-3.19,2.22-6.53,3.11-9.93.44-1.68-.49-2.68-1.85-3.48-9.29-5.51-12.79-16.96-9.16-27.12.35-.98,1.26-1.46,2.03-1.49,3.12-.13,1.46,5.65,9.18,8.03,7.32,2.26,7.54,8.34,11.1,5.92,8.29-5.65,11.28-1.02,18.98-8.27.79-.74,2.15-.8,2.97-.22.51.35.95,1.26.91,2.33-.22,6.12-2.61,11.97-6.8,16.46-7.91,8.49-14.56,4.43-14.99,10.38-1.26,17.46-6.97,34.9-19.37,47.58-.4.41-.63.99-.57,1.38.07.41.56.82,1.1.99l10.44,3.55c1.47.5,2.55,1.83,2.35,3.24-.17,1.23-1.15,2.32-2.55,2.79h.01Z"/>
</g>
</svg>

Before

Width:  |  Height:  |  Size: 3.6 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 77 KiB

-4
View File
@@ -1,4 +0,0 @@
User-agent: *
Allow: /
Sitemap: https://reasonix.io/sitemap-index.xml
Binary file not shown.

Before

Width:  |  Height:  |  Size: 2.4 KiB

-63
View File
@@ -1,63 +0,0 @@
// Prebuild: fetch live community stats + bake contributor avatars into public/av/.
// Never fails the build — falls back to the committed snapshot on any error.
import { mkdir, readFile, rm, writeFile } from 'node:fs/promises';
import sharp from 'sharp';
const repo = 'esengine/DeepSeek-Reasonix';
const api = `https://api.github.com/repos/${repo}`;
const headers = { 'User-Agent': 'reasonix-site', Accept: 'application/vnd.github+json' };
if (process.env.GITHUB_TOKEN) headers.Authorization = `Bearer ${process.env.GITHUB_TOKEN}`;
const fallback = JSON.parse(await readFile('src/data/contributors.json', 'utf8'));
let { stars, mergedPrs, contributors, list } = fallback;
try {
const r = await fetch(`${api}/contributors?per_page=100`, { headers });
if (r.ok) {
const humans = (await r.json())
.filter((c) => c.type === 'User')
.map((c) => ({ login: c.login, avatar: String(c.avatar_url).split('?')[0], url: c.html_url, c: c.contributions }));
if (humans.length) { list = humans; contributors = humans.length; }
}
} catch {}
try {
const r = await fetch(api, { headers });
if (r.ok) { const d = await r.json(); if (typeof d.stargazers_count === 'number') stars = d.stargazers_count; }
} catch {}
try {
const r = await fetch(`https://api.github.com/search/issues?q=repo:${repo}+is:pr+is:merged&per_page=1`, { headers });
if (r.ok) { const d = await r.json(); if (typeof d.total_count === 'number') mergedPrs = d.total_count; }
} catch {}
// 64px is the largest rendered avatar; bake at 2x. GitHub honours ?s= for its
// own CDN but serves some custom avatars unscaled and in whatever format was
// uploaded, so re-encode rather than trusting the response.
const AVATAR_PX = 128;
await rm('public/av', { recursive: true, force: true });
await mkdir('public/av', { recursive: true });
let baked = 0;
let bakedBytes = 0;
const out = await Promise.all(list.map(async (c) => {
const remote = `${c.avatar}?s=${AVATAR_PX}`;
try {
const r = await fetch(remote);
if (!r.ok) throw new Error(String(r.status));
const webp = await sharp(Buffer.from(await r.arrayBuffer()))
.resize(AVATAR_PX, AVATAR_PX, { fit: 'cover' })
.webp({ quality: 80 })
.toBuffer();
await writeFile(`public/av/${c.login}.webp`, webp);
baked++;
bakedBytes += webp.byteLength;
return { ...c, avatar: `/av/${c.login}.webp` };
} catch {
return { ...c, avatar: remote };
}
}));
await writeFile('src/data/community.json', JSON.stringify({ stars, mergedPrs, contributors, list: out }, null, 2) + '\n');
console.log(
`community: ${contributors} contributors · ${stars} stars · ${mergedPrs} merged PRs · ` +
`${baked}/${out.length} avatars baked (${(bakedBytes / 1024).toFixed(0)} KB)`,
);
-49
View File
@@ -1,49 +0,0 @@
import { mkdir, readFile, writeFile } from "node:fs/promises";
import { resolve } from "node:path";
import { validateReleaseEvent } from "./release-event.mjs";
const siteRoot = resolve(import.meta.dirname, "..");
const catalog = JSON.parse(await readFile(resolve(siteRoot, "src/data/releases.json"), "utf8"));
const output = resolve(siteRoot, ".generated/publications.json");
const headers = {
Accept: "application/vnd.github+json",
"User-Agent": "reasonix-site-publications",
};
if (process.env.GITHUB_TOKEN) headers.Authorization = `Bearer ${process.env.GITHUB_TOKEN}`;
const publications = [];
for (const release of catalog.releases) {
// Legacy entries predate publication markers and remain public. Every new
// reviewed entry fails closed until its exact CLI release carries the marker
// uploaded by the all-surface postflight.
if (!release.status || release.status === "published") {
publications.push(release.version);
continue;
}
const tag = `v${release.version}`;
try {
const response = await fetch(
`https://api.github.com/repos/esengine/DeepSeek-Reasonix/releases/tags/${encodeURIComponent(tag)}`,
{ headers, signal: AbortSignal.timeout(20_000) },
);
if (!response.ok) continue;
const githubRelease = await response.json();
const marker = githubRelease.assets?.find((asset) => asset.name === "release-event.json" && asset.size > 0);
if (!marker?.browser_download_url) continue;
const markerResponse = await fetch(marker.browser_download_url, {
headers,
signal: AbortSignal.timeout(20_000),
});
if (!markerResponse.ok) continue;
const event = await markerResponse.json();
validateReleaseEvent(event, release);
publications.push(release.version);
} catch {
// A reviewed release must never become public because an upstream lookup
// failed. The next Pages build retries after the release postflight.
}
}
await mkdir(resolve(siteRoot, ".generated"), { recursive: true });
await writeFile(output, `${JSON.stringify({ schemaVersion: 1, publications }, null, 2)}\n`);
console.log(`Resolved ${publications.length} public release note(s).`);
-27
View File
@@ -1,27 +0,0 @@
function invariant(condition, message) {
if (!condition) throw new Error(message);
}
export function validateReleaseEvent(event, release) {
invariant(event && typeof event === "object" && !Array.isArray(event), "release event must be an object");
invariant(event.schemaVersion === 1, "release event schemaVersion must be 1");
invariant(event.releaseId === release.version, "release event releaseId does not match reviewed notes");
invariant(
event.channel === (release.channel === "prerelease" ? "preview" : "stable"),
"release event channel does not match reviewed notes",
);
invariant(/^[0-9a-f]{40}$/.test(event.candidateSha), "release event candidateSha must be a full commit SHA");
if (release.candidateSha) {
invariant(event.candidateSha === release.candidateSha, "release event candidateSha does not match reviewed notes");
}
invariant(/^\d{4}-\d{2}-\d{2}T/.test(event.publishedAt), "release event publishedAt must be an ISO timestamp");
invariant(event.releaseNotesUrl === `https://reasonix.io/changelog/v${release.version}/`, "release event URL is invalid");
invariant(event.builds && typeof event.builds === "object", "release event builds are required");
for (const surface of ["cli", "desktop", "npm"]) {
invariant(typeof event.builds[surface] === "string" && event.builds[surface], `release event builds.${surface} is required`);
if (release.builds?.[surface]) {
invariant(event.builds[surface] === release.builds[surface], `release event builds.${surface} does not match reviewed notes`);
}
}
return event;
}
@@ -1,349 +0,0 @@
#!/usr/bin/env node
import { execFileSync } from "node:child_process";
import { resolve } from "node:path";
import { fileURLToPath } from "node:url";
import { dirname } from "node:path";
import { withoutOwner } from "../../src/lib/repository-owner.mjs";
import { compareVersionsDesc, loadCatalog, upsertRelease, validateCatalog } from "./release-notes.mjs";
const repoRoot = resolve(dirname(fileURLToPath(import.meta.url)), "../../..");
const apiBase = process.env.DEEPSEEK_API_BASE || "https://api.deepseek.com";
const model = process.env.DEEPSEEK_MODEL || "deepseek-v4-pro";
const releaseTargetOrder = ["desktop", "cli", "site", "service"];
export const releaseOutputBudgets = Object.freeze({
standard: Object.freeze({ highlights: 6, changes: 15, guides: 6, upgrade: 4, risks: 4, bodyChars: 280 }),
compact: Object.freeze({ highlights: 4, changes: 9, guides: 4, upgrade: 2, risks: 2, bodyChars: 220 }),
});
export function editorialLimitInstruction(compact = false) {
const budget = compact ? releaseOutputBudgets.compact : releaseOutputBudgets.standard;
return `Editorial budget: at most ${budget.highlights} highlights, ${budget.changes} total change items across new/improved/fixed, ${budget.guides} guides, ${budget.upgrade} upgrade notes, and ${budget.risks} risks. Keep every English and Chinese body within ${budget.bodyChars} characters. Select the most important user outcomes across the supplied PRs, combine related work, and avoid repeating the same outcome in highlights and changes. Always return a complete JSON object within this budget.`;
}
function parseArgs(argv) {
const values = {};
for (let index = 0; index < argv.length; index += 1) {
const arg = argv[index];
if (!arg.startsWith("--")) throw new Error(`unexpected argument ${arg}`);
values[arg.slice(2)] = argv[++index];
}
return values;
}
function runGit(args) {
return execFileSync("git", args, { cwd: repoRoot, encoding: "utf8" }).trim();
}
function normalizeVersion(version) {
return String(version || "").replace(/^(?:desktop-|npm-)?v/, "");
}
function repositoryName() {
if (process.env.GITHUB_REPOSITORY) return process.env.GITHUB_REPOSITORY;
const remote = runGit(["remote", "get-url", "origin"]);
const match = remote.match(/github\.com[/:]([^/]+\/[^/.]+)(?:\.git)?$/);
if (!match) throw new Error("cannot determine GitHub repository; set GITHUB_REPOSITORY");
return match[1];
}
function commitRange(from, to) {
return runGit(["log", "--first-parent", "--format=%H%x09%s%x09%b%x00", `${from}..${to}`])
.split("\0")
.map((record) => record.trim())
.filter(Boolean)
.map((record) => {
const [sha, subject, ...body] = record.split("\t");
return { sha, subject, body: body.join("\t").trim() };
});
}
function prNumbersFromCommits(commits) {
const refs = new Set();
for (const commit of commits) {
for (const match of `${commit.subject}\n${commit.body}`.matchAll(/#(\d+)/g)) refs.add(Number(match[1]));
}
return [...refs];
}
async function githubJson(path, { allowMissing = false } = {}) {
const headers = { Accept: "application/vnd.github+json", "User-Agent": "reasonix-release-notes" };
if (process.env.GITHUB_TOKEN || process.env.GH_TOKEN) {
headers.Authorization = `Bearer ${process.env.GITHUB_TOKEN || process.env.GH_TOKEN}`;
}
const response = await fetch(`https://api.github.com${path}`, { headers, signal: AbortSignal.timeout(30_000) });
if (allowMissing && response.status === 404) return null;
if (!response.ok) throw new Error(`GitHub API ${path} failed: ${response.status}`);
return response.json();
}
async function githubList(path) {
const items = [];
for (let page = 1; ; page += 1) {
const separator = path.includes("?") ? "&" : "?";
const batch = await githubJson(`${path}${separator}per_page=100&page=${page}`);
items.push(...batch);
if (batch.length < 100) return items;
}
}
export function inferPullTargetHints(labels, files) {
const labelSet = new Set(labels);
const targets = new Set();
const add = (target) => targets.add(target);
const hasPath = (pattern) => files.some((path) => pattern.test(path));
const explicitlyDesktop = labelSet.has("desktop");
const explicitlyCLI = labelSet.has("tui") || labelSet.has("cli");
if (explicitlyDesktop) add("desktop");
if (explicitlyCLI) add("cli");
if (hasPath(/^desktop\//)) add("desktop");
if (hasPath(/^(?:internal\/cli\/|cmd\/)/)) add("cli");
if (hasPath(/^site\//)) add("site");
if (hasPath(/^(?:workers\/|\.github\/|scripts\/|release-notes\/)/)) add("service");
const hasSharedProductCode = files.some((path) =>
/^(?:internal\/|sdk\/|npm\/)/.test(path) &&
!/^internal\/cli\//.test(path) &&
!/^internal\/telemetry\//.test(path),
);
if (!explicitlyDesktop && !explicitlyCLI && hasSharedProductCode) {
add("desktop");
add("cli");
}
if (!targets.size) {
add("desktop");
add("cli");
}
return releaseTargetOrder.filter((target) => targets.has(target));
}
async function collectPullRequests(repository, commits) {
const numbers = new Set(prNumbersFromCommits(commits));
const associated = await Promise.all(
commits.map((commit) => githubJson(`/repos/${repository}/commits/${commit.sha}/pulls`, { allowMissing: true })),
);
for (const pulls of associated) for (const pull of pulls || []) numbers.add(pull.number);
const pulls = await Promise.all([...numbers].map((number) => githubJson(`/repos/${repository}/pulls/${number}`, { allowMissing: true })));
return Promise.all(pulls.filter(Boolean).map(async (pull) => {
const labels = (pull.labels || []).map((label) => label.name);
const files = (await githubList(`/repos/${repository}/pulls/${pull.number}/files`)).map((file) => file.filename);
return {
number: pull.number,
title: pull.title,
body: String(pull.body || "").slice(0, 2000),
author: pull.user?.login || "",
labels,
changedFileCount: files.length,
files: files.slice(0, 200),
targetHints: inferPullTargetHints(labels, files),
};
}));
}
function releaseItems(release) {
return [
...(release.highlights || []),
...["new", "improved", "fixed"].flatMap((kind) => release.changes?.[kind] || []),
...(release.upgrade || []),
...(release.risks || []),
];
}
function normalizeReleaseTargets(release) {
for (const item of releaseItems(release)) {
if (!Array.isArray(item.targets)) continue;
item.targets.sort((a, b) => releaseTargetOrder.indexOf(a) - releaseTargetOrder.indexOf(b));
}
const targets = new Set(releaseItems(release).flatMap((item) => item.targets || []));
release.surfaces = [
...releaseTargetOrder.filter((target) => targets.has(target)),
...[...targets].filter((target) => !releaseTargetOrder.includes(target)).sort(),
];
}
function collectDocLinks(from, repository, to) {
const linkRef = runGit(["rev-parse", to]);
const paths = runGit(["diff", "--name-only", `${from}..${to}`])
.split("\n")
.filter((path) => /^(?:docs|README)[/\w.-]*\.(?:md|mdx)$/i.test(path));
return paths.map((path) => `https://github.com/${repository}/blob/${linkRef}/${path}`);
}
function assertGroundedRefs(value, allowedRefs, path = "release") {
if (Array.isArray(value)) {
value.forEach((item, index) => assertGroundedRefs(item, allowedRefs, `${path}[${index}]`));
return;
}
if (!value || typeof value !== "object") return;
if (Array.isArray(value.refs)) {
for (const ref of value.refs) {
if (!allowedRefs.has(ref)) throw new Error(`${path}.refs contains PR #${ref}, which is outside the release range`);
}
}
for (const [key, child] of Object.entries(value)) assertGroundedRefs(child, allowedRefs, `${path}.${key}`);
}
function extractJson(content) {
if (!content?.trim()) throw new Error("DeepSeek returned empty content");
const parsed = JSON.parse(content);
return parsed.release || parsed;
}
async function askDeepSeek(payload, attempt = 0) {
const key = process.env.DEEPSEEK_API_KEY;
if (!key) throw new Error("DEEPSEEK_API_KEY is required");
const compact = attempt > 0;
const response = await fetch(`${apiBase.replace(/\/$/, "")}/chat/completions`, {
method: "POST",
headers: { Authorization: `Bearer ${key}`, "Content-Type": "application/json" },
body: JSON.stringify({
model,
// Release notes need deterministic structured output, not hidden chain of
// thought. Thinking tokens share the generation budget with content and
// can otherwise leave response_format JSON empty or truncated.
thinking: { type: "disabled" },
temperature: 0,
max_tokens: 8000,
response_format: { type: "json_object" },
messages: [
{
role: "system",
content: `You are Reasonix's release editor. Return one JSON object with a \"release\" property. Write factual, user-facing product release notes in equivalent English and Simplified Chinese. Group changes by user outcome, not by commit. Never invent capabilities, migrations, risks, PR numbers, contributors, URLs, or metrics. Every highlight and change must cite one or more supplied PR numbers. Use this exact release shape:
{
\"version\": \"semver\", \"date\": \"YYYY-MM-DD\", \"channel\": \"stable|prerelease\", \"targetingVersion\": 1,
\"title\": {\"en\":\"\",\"zh\":\"\"}, \"summary\": {\"en\":\"\",\"zh\":\"\"},
\"surfaces\": [\"desktop\",\"cli\"],
\"guides\": [{\"title\":{\"en\":\"\",\"zh\":\"\"},\"body\":{\"en\":\"\",\"zh\":\"\"},\"href\":\"https://...\"}],
\"highlights\": [{\"kind\":\"new|improved|fixed|security\",\"targets\":[\"desktop\",\"cli\"],\"title\":{\"en\":\"\",\"zh\":\"\"},\"body\":{\"en\":\"\",\"zh\":\"\"},\"refs\":[123]}],
\"changes\": {\"new\":[],\"improved\":[],\"fixed\":[]},
\"upgrade\": [{\"level\":\"info|warning\",\"targets\":[\"desktop\"],\"title\":{\"en\":\"\",\"zh\":\"\"},\"body\":{\"en\":\"\",\"zh\":\"\"},\"refs\":[123]}],
\"risks\": [{\"targets\":[\"cli\"],\"title\":{\"en\":\"\",\"zh\":\"\"},\"body\":{\"en\":\"\",\"zh\":\"\"},\"refs\":[123]}],
\"contributors\": [], \"links\": {\"github\":\"https://...\",\"compare\":\"https://...\",\"download\":\"https://...\"}
}
Every highlight, change, upgrade note, and risk must have a non-empty \"targets\" array using only this canonical order: desktop, cli, site, service. Use each PR's targetHints as deterministic candidates, then choose the user-visible delivery target supported by its labels, changed files, title, and body. Shared product-core behavior belongs to both desktop and cli. Website-only work belongs to site; hosted workers and release infrastructure belong to service and must not be marked as a client update merely because a client file accompanies the server change. Set top-level surfaces to the canonical union of all item targets. Return guides only for supplied documentation URLs. Mention upgrade action or risk only when explicitly supported; otherwise use empty arrays. ${editorialLimitInstruction(compact)} Output JSON only.`,
},
{
role: "user",
content: `${compact ? "The previous response was invalid or truncated. Produce a smaller complete record and obey the compact editorial budget.\n" : ""}Create the release record from these public GitHub sources:\n${JSON.stringify(payload)}`,
},
],
}),
});
if (!response.ok) throw new Error(`DeepSeek API failed: ${response.status} ${await response.text()}`);
const data = await response.json();
const choice = data.choices?.[0];
if (choice?.finish_reason === "length") {
if (compact) throw new Error("DeepSeek response exceeded the compact editorial budget (finish_reason=length)");
return askDeepSeek(payload, attempt + 1);
}
try {
return extractJson(choice?.message?.content);
} catch (error) {
if (compact) {
throw new Error(`${error.message} (finish_reason=${choice?.finish_reason || "unknown"})`);
}
return askDeepSeek(payload, attempt + 1);
}
}
export function contributorsOf(pulls) {
return withoutOwner([...new Set(pulls.map((pull) => pull.author).filter(Boolean))]);
}
export function previousCLIRelease(catalog, version) {
return catalog.releases.find((release) =>
release.product !== "studio" && release.channel === "stable" &&
compareVersionsDesc(release.version, version) > 0,
);
}
async function main() {
const args = parseArgs(process.argv.slice(2));
if (!args.version) throw new Error("--version is required");
const version = normalizeVersion(args.version);
const catalog = await loadCatalog();
const channel = version.includes("-") ? "prerelease" : "stable";
const baseVersion = version.split("-")[0];
const previousRecord = channel === "stable"
? previousCLIRelease(catalog, version)
: catalog.releases.find(
(release) =>
release.version !== version &&
release.channel === "prerelease" &&
release.baseVersion === baseVersion,
) || catalog.releases.find((release) => release.product !== "studio" && release.channel === "stable");
const previous = args.from || previousRecord?.version;
if (!previous) throw new Error("--from is required when no previous release exists");
const previousVersion = normalizeVersion(previous);
const previousIsPreview = previousVersion.includes("-");
const from = previous.match(/^(?:desktop-|npm-)?v/)
? previous
: previousIsPreview
? `v${previousVersion}`
: `desktop-v${previousVersion}`;
const to = args.to || "HEAD";
const repository = repositoryName();
const commits = commitRange(from, to);
if (!commits.length) throw new Error(`no commits found in ${from}..${to}`);
const pulls = await collectPullRequests(repository, commits);
if (!pulls.length) throw new Error(`no pull requests found in ${from}..${to}`);
const docLinks = collectDocLinks(from, repository, to);
const date = args.date || new Date().toISOString().slice(0, 10);
const tag = args.tag || (channel === "prerelease" ? `v${version}` : `desktop-v${version}`);
const source = {
version,
date,
channel,
range: `${from}..${to}`,
pullRequests: pulls,
documentationUrls: docLinks,
};
const release = await askDeepSeek(source);
release.product = "cli";
release.targetingVersion = 1;
release.version = version;
release.releaseId = version;
release.baseVersion = baseVersion;
release.date = date;
release.channel = source.channel;
release.status = "reviewed";
release.previousRelease = previousVersion;
const previewOrdinal = version.match(/-preview\.([1-9][0-9]*)$/)?.[1];
if (channel === "prerelease") {
if (!previewOrdinal) throw new Error("Preview release version must use MAJOR.MINOR.PATCH-preview.N");
release.builds = {
cli: `v${version}`,
desktop: `v${baseVersion}-preview.${previewOrdinal}`,
npm: `${baseVersion}-canary.${previewOrdinal}`,
};
} else {
release.builds = {
cli: `v${version}`,
desktop: `v${version}`,
npm: version,
};
}
release.contributors = contributorsOf(pulls);
release.links = {
github: `https://github.com/${repository}/releases/tag/${tag}`,
compare: `https://github.com/${repository}/compare/${from}...${tag}`,
download: channel === "prerelease"
? "https://reasonix.io/?download=desktop&channel=preview#start"
: "https://reasonix.io/?download=desktop&channel=stable#start",
};
release.guides = (release.guides || []).filter((guide) => docLinks.includes(guide.href));
normalizeReleaseTargets(release);
assertGroundedRefs(release, new Set(pulls.map((pull) => pull.number)));
validateCatalog({ schemaVersion: 1, releases: [release] });
await upsertRelease(release);
console.log(`Generated bilingual release notes for v${version} from ${pulls.length} pull request(s).`);
}
if (process.argv[1] && resolve(process.argv[1]) === fileURLToPath(import.meta.url)) {
main().catch((error) => {
console.error(error.message);
process.exitCode = 1;
});
}
@@ -1,63 +0,0 @@
#!/usr/bin/env bash
# Start CI on a Notes PR that the Actions bot opened. Events raised with
# GITHUB_TOKEN never start workflows, so such a PR shows action_required with
# zero jobs until a human-authenticated close/reopen re-emits pull_request.
set -euo pipefail
if [ "$#" -ne 1 ] || [[ ! "$1" =~ ^(0|[1-9][0-9]*)\.(0|[1-9][0-9]*)\.(0|[1-9][0-9]*)$ ]]; then
echo "usage: site/scripts/releases/release-notes-pr-kick.sh MAJOR.MINOR.PATCH" >&2
exit 2
fi
version="$1"
repository="${RELEASE_REPOSITORY:-esengine/DeepSeek-Reasonix}"
branch="website-release-notes/v$version"
wait_seconds="${RELEASE_NOTES_KICK_WAIT_SECONDS:-120}"
for command in gh jq; do
command -v "$command" >/dev/null || {
echo "required command is unavailable: $command" >&2
exit 2
}
done
prs="$(gh pr list --repo "$repository" --head "$branch" --state open --json number,headRefOid --limit 2)"
count="$(jq 'length' <<<"$prs")"
if [ "$count" -ne 1 ]; then
echo "expected exactly one open PR for $branch, found $count" >&2
exit 1
fi
number="$(jq -r '.[0].number' <<<"$prs")"
head="$(jq -r '.[0].headRefOid' <<<"$prs")"
check_runs() {
gh api "repos/$repository/commits/$head/check-runs" --jq '.total_count'
}
if [ "$(check_runs)" -gt 0 ]; then
echo "PR #$number already has check runs on $head; nothing to kick"
exit 0
fi
# Only the recorded-but-never-started shape is safe to kick. Anything else
# with zero check runs needs a look, not a reopen.
stalled="$(gh api "repos/$repository/actions/runs?event=pull_request&head_sha=$head&per_page=20" \
--jq "[.workflow_runs[] | select(.head_sha == \"$head\" and .conclusion == \"action_required\")] | length")"
if [ "$stalled" -eq 0 ]; then
echo "PR #$number has no check runs and no action_required run on $head; inspect before kicking" >&2
exit 1
fi
echo "PR #$number: $stalled recorded-but-unstarted run(s) on $head; closing and reopening"
gh pr close "$number" --repo "$repository"
gh pr reopen "$number" --repo "$repository"
deadline=$((SECONDS + wait_seconds))
while [ "$(check_runs)" -eq 0 ]; do
if [ "$SECONDS" -ge "$deadline" ]; then
echo "no check runs appeared on $head within ${wait_seconds}s" >&2
exit 1
fi
sleep 5
done
echo "CI started on PR #$number ($head)"
-459
View File
@@ -1,459 +0,0 @@
#!/usr/bin/env node
import { readFile, writeFile } from "node:fs/promises";
import { dirname, resolve } from "node:path";
import { fileURLToPath } from "node:url";
import { withoutOwner } from "../../src/lib/repository-owner.mjs";
const siteRoot = resolve(dirname(fileURLToPath(import.meta.url)), "../..");
export const defaultCatalogPath = resolve(siteRoot, "src/data/releases.json");
const localizedFields = ["title", "body"];
const changeKinds = ["new", "improved", "fixed"];
const itemKinds = new Set(["new", "improved", "fixed", "security"]);
const releaseChannels = new Set(["stable", "prerelease"]);
const releaseStatuses = new Set(["reviewed", "published"]);
const releaseTargetOrder = ["desktop", "cli", "site", "service"];
const releaseTargets = new Set(releaseTargetOrder);
const releaseTargetingRequiredFrom = "1.31.4";
function invariant(condition, message) {
if (!condition) throw new Error(message);
}
function isObject(value) {
return value !== null && typeof value === "object" && !Array.isArray(value);
}
function validateLocalized(value, path) {
invariant(isObject(value), `${path} must be an object`);
for (const lang of ["en", "zh"]) {
invariant(typeof value[lang] === "string" && value[lang].trim(), `${path}.${lang} must be a non-empty string`);
}
}
function validateRefs(refs, path) {
if (refs === undefined) return;
invariant(Array.isArray(refs), `${path} must be an array`);
for (const ref of refs) invariant(Number.isInteger(ref) && ref > 0, `${path} contains invalid PR number ${ref}`);
}
function validateItem(item, path, { kind = false, href = false, level = false, targets = false } = {}) {
invariant(isObject(item), `${path} must be an object`);
for (const field of localizedFields) validateLocalized(item[field], `${path}.${field}`);
if (kind) invariant(itemKinds.has(item.kind), `${path}.kind is invalid`);
if (href) invariant(typeof item.href === "string" && /^https:\/\//.test(item.href), `${path}.href must be HTTPS`);
if (level) invariant(item.level === "info" || item.level === "warning", `${path}.level is invalid`);
if (targets || item.targets !== undefined) {
invariant(Array.isArray(item.targets) && item.targets.length > 0, `${path}.targets must be a non-empty array`);
invariant(new Set(item.targets).size === item.targets.length, `${path}.targets contains duplicates`);
for (const target of item.targets) invariant(releaseTargets.has(target), `${path}.targets contains invalid target ${target}`);
const sorted = releaseTargetOrder.filter((target) => item.targets.includes(target));
invariant(sorted.every((target, index) => target === item.targets[index]), `${path}.targets must use canonical order`);
}
validateRefs(item.refs, `${path}.refs`);
}
function releaseItems(release) {
return [
...release.highlights,
...changeKinds.flatMap((kind) => release.changes[kind]),
...release.upgrade,
...release.risks,
];
}
function itemTargetsUnion(release) {
const targets = new Set(releaseItems(release).flatMap((item) => item.targets || []));
return releaseTargetOrder.filter((target) => targets.has(target));
}
function semverParts(version) {
const match = String(version).match(/^(\d+)\.(\d+)\.(\d+)(?:-([0-9A-Za-z.-]+))?$/);
invariant(match, `invalid version ${version}`);
return [Number(match[1]), Number(match[2]), Number(match[3]), match[4] || ""];
}
function isCoreVersionAtLeast(version, minimum) {
const current = semverParts(version);
const floor = semverParts(minimum);
for (let index = 0; index < 3; index += 1) {
if (current[index] !== floor[index]) return current[index] > floor[index];
}
return true;
}
export function compareVersionsDesc(a, b) {
const aa = semverParts(a);
const bb = semverParts(b);
for (let i = 0; i < 3; i += 1) {
if (aa[i] !== bb[i]) return bb[i] - aa[i];
}
if (aa[3] === bb[3]) return 0;
if (!aa[3]) return -1;
if (!bb[3]) return 1;
return String(bb[3]).localeCompare(String(aa[3]), "en", { numeric: true });
}
export function validateCatalog(catalog) {
invariant(isObject(catalog), "catalog must be an object");
invariant(catalog.schemaVersion === 1, "catalog.schemaVersion must be 1");
invariant(Array.isArray(catalog.releases) && catalog.releases.length > 0, "catalog.releases must not be empty");
const versions = new Set();
for (const [index, release] of catalog.releases.entries()) {
const path = `releases[${index}]`;
invariant(isObject(release), `${path} must be an object`);
semverParts(release.version);
invariant(release.product === undefined || ["cli", "studio"].includes(release.product), `${path}.product is invalid`);
if (release.product === "studio") {
invariant(/^2\.\d+\.\d+$/.test(release.version), `${path}.Studio version must be 2.x`);
invariant(release.sourceNotes?.language === "zh", `${path}.sourceNotes.language must be zh`);
invariant(typeof release.sourceNotes.markdown === "string" && release.sourceNotes.markdown.trim(), `${path}.sourceNotes.markdown must not be empty`);
invariant(/^[0-9a-f]{40}$/.test(release.sourceNotes.sha), `${path}.sourceNotes.sha must be a full commit SHA`);
invariant(release.sourceNotes.path === `release-notes/studio/${release.version}.md`, `${path}.sourceNotes.path is invalid`);
invariant(release.status === undefined, `${path}.Studio does not use CLI publication markers`);
}
invariant(!versions.has(release.version), `duplicate version ${release.version}`);
versions.add(release.version);
invariant(/^\d{4}-\d{2}-\d{2}$/.test(release.date), `${path}.date must use YYYY-MM-DD`);
invariant(releaseChannels.has(release.channel), `${path}.channel is invalid`);
if (release.releaseId !== undefined) {
invariant(release.releaseId === release.version, `${path}.releaseId must equal version`);
}
if (release.baseVersion !== undefined) {
semverParts(release.baseVersion);
invariant(!release.baseVersion.includes("-"), `${path}.baseVersion must be stable semver`);
invariant(
release.version === release.baseVersion || release.version.startsWith(`${release.baseVersion}-`),
`${path}.baseVersion does not match version`,
);
}
if (release.status !== undefined) {
invariant(releaseStatuses.has(release.status), `${path}.status is invalid`);
}
if (release.candidateSha !== undefined) {
invariant(/^[0-9a-f]{40}$/.test(release.candidateSha), `${path}.candidateSha must be a full commit SHA`);
}
if (release.previousRelease !== undefined) {
semverParts(release.previousRelease);
invariant(release.previousRelease !== release.version, `${path}.previousRelease must differ from version`);
}
if (release.builds !== undefined) {
invariant(isObject(release.builds), `${path}.builds must be an object`);
for (const surface of ["cli", "desktop", "npm"]) {
invariant(
typeof release.builds[surface] === "string" && release.builds[surface].trim(),
`${path}.builds.${surface} must be a non-empty string`,
);
}
}
if (release.status !== undefined) {
for (const field of ["releaseId", "baseVersion", "previousRelease", "builds"]) {
invariant(release[field] !== undefined, `${path}.${field} is required for managed release records`);
}
if (release.channel === "stable") {
invariant(release.version === release.baseVersion, `${path}.stable version must equal baseVersion`);
invariant(release.builds.cli === `v${release.version}`, `${path}.builds.cli does not match Stable version`);
invariant(release.builds.desktop === `v${release.version}`, `${path}.builds.desktop does not match Stable version`);
invariant(release.builds.npm === release.version, `${path}.builds.npm does not match Stable version`);
} else {
const preview = release.version.match(/^(\d+\.\d+\.\d+)-preview\.([1-9][0-9]*)$/);
invariant(preview, `${path}.managed prerelease must use MAJOR.MINOR.PATCH-preview.N`);
invariant(preview[1] === release.baseVersion, `${path}.Preview baseVersion does not match version`);
invariant(release.builds.cli === `v${release.version}`, `${path}.builds.cli does not match Preview version`);
invariant(release.builds.desktop === `v${release.version}`, `${path}.builds.desktop does not match Preview version`);
invariant(
release.builds.npm === `${release.baseVersion}-canary.${preview[2]}`,
`${path}.builds.npm does not match Preview ordinal`,
);
}
}
const targetingRequiredByVersion = release.product !== "studio" && isCoreVersionAtLeast(release.version, releaseTargetingRequiredFrom);
if (targetingRequiredByVersion) {
invariant(
release.targetingVersion === 1,
`${path}.targetingVersion must be 1 for v${releaseTargetingRequiredFrom} and newer`,
);
} else if (release.targetingVersion !== undefined) {
invariant(release.targetingVersion === 1, `${path}.targetingVersion is invalid`);
}
const targetsRequired = release.targetingVersion === 1;
validateLocalized(release.title, `${path}.title`);
validateLocalized(release.summary, `${path}.summary`);
invariant(Array.isArray(release.surfaces) && release.surfaces.length > 0, `${path}.surfaces must not be empty`);
invariant(new Set(release.surfaces).size === release.surfaces.length, `${path}.surfaces contains duplicates`);
invariant(Array.isArray(release.guides), `${path}.guides must be an array`);
release.guides.forEach((item, itemIndex) => validateItem(item, `${path}.guides[${itemIndex}]`, { href: true }));
invariant(Array.isArray(release.highlights) && release.highlights.length > 0, `${path}.highlights must not be empty`);
release.highlights.forEach((item, itemIndex) =>
validateItem(item, `${path}.highlights[${itemIndex}]`, { kind: true, targets: targetsRequired }),
);
invariant(isObject(release.changes), `${path}.changes must be an object`);
for (const changeKind of changeKinds) {
invariant(Array.isArray(release.changes[changeKind]), `${path}.changes.${changeKind} must be an array`);
release.changes[changeKind].forEach((item, itemIndex) =>
validateItem(item, `${path}.changes.${changeKind}[${itemIndex}]`, { targets: targetsRequired }),
);
}
invariant(Array.isArray(release.upgrade), `${path}.upgrade must be an array`);
release.upgrade.forEach((item, itemIndex) =>
validateItem(item, `${path}.upgrade[${itemIndex}]`, { level: true, targets: targetsRequired }),
);
invariant(Array.isArray(release.risks), `${path}.risks must be an array`);
release.risks.forEach((item, itemIndex) =>
validateItem(item, `${path}.risks[${itemIndex}]`, { targets: targetsRequired }),
);
if (targetsRequired) {
const derivedTargets = itemTargetsUnion(release);
invariant(
derivedTargets.includes("desktop") || derivedTargets.includes("cli"),
`${path} must contain at least one Desktop or CLI update`,
);
invariant(
derivedTargets.length === release.surfaces.length &&
derivedTargets.every((target, index) => target === release.surfaces[index]),
`${path}.surfaces must equal the canonical union of item targets`,
);
}
invariant(Array.isArray(release.contributors), `${path}.contributors must be an array`);
invariant(isObject(release.links), `${path}.links must be an object`);
for (const link of ["github", "compare", "download"]) {
invariant(typeof release.links[link] === "string" && /^https:\/\//.test(release.links[link]), `${path}.links.${link} must be HTTPS`);
}
}
const sorted = [...catalog.releases].sort((a, b) => compareVersionsDesc(a.version, b.version));
invariant(
sorted.every((release, index) => release.version === catalog.releases[index].version),
"catalog.releases must be sorted newest first",
);
return catalog;
}
export async function loadCatalog(path = defaultCatalogPath) {
const catalog = JSON.parse(await readFile(path, "utf8"));
return validateCatalog(catalog);
}
export function releaseForVersion(catalog, version) {
const normalized = String(version).replace(/^(?:studio-|desktop-|npm-)?v/, "");
const release = catalog.releases.find((entry) => entry.version === normalized);
invariant(release, `release notes for v${normalized} are missing`);
return release;
}
function localized(value, lang) {
return value[lang] || value.en;
}
function refsSuffix(refs = []) {
if (!refs.length) return "";
return ` (${refs.map((ref) => `[#${ref}](https://github.com/esengine/DeepSeek-Reasonix/pull/${ref})`).join(", ")})`;
}
function targetLabel(target) {
return { desktop: "Desktop", cli: "CLI", site: "Site", service: "Service" }[target] || target;
}
function targetsPrefix(item) {
if (!item.targets?.length) return "";
return `**[${item.targets.map(targetLabel).join(" · ")}]** `;
}
function renderItems(items, lang) {
return items
.map((item) => `- ${targetsPrefix(item)}**${localized(item.title, lang)}** — ${localized(item.body, lang)}${refsSuffix(item.refs)}`)
.join("\n");
}
function hasTarget(item, target) {
return item.targets?.includes(target) || false;
}
function targetItemCount(release, target) {
return releaseItems(release).filter((item) => hasTarget(item, target)).length;
}
function appendTargetSection(lines, release, target, lang) {
const isZh = lang === "zh";
const title = target === "desktop"
? (isZh ? "桌面端更新" : "Desktop updates")
: (isZh ? "CLI 端更新" : "CLI updates");
lines.push(`## ${title}`, "");
const highlights = release.highlights.filter((item) => hasTarget(item, target));
if (highlights.length) {
lines.push(`### ${isZh ? "重点内容" : "Highlights"}`, "", renderItems(highlights, lang), "");
}
const headings = {
new: isZh ? "新增" : "New",
improved: isZh ? "改进" : "Improved",
fixed: isZh ? "修复" : "Fixed",
};
for (const kind of changeKinds) {
const items = release.changes[kind].filter((item) => hasTarget(item, target));
if (items.length) lines.push(`### ${headings[kind]}`, "", renderItems(items, lang), "");
}
if (!highlights.length && !changeKinds.some((kind) => release.changes[kind].some((item) => hasTarget(item, target)))) {
const noTargetedItems = targetItemCount(release, target) === 0;
lines.push(
target === "cli" && noTargetedItems
? (isZh ? "本版本没有 CLI 相关功能、改进或修复,CLI 用户可按需跳过。" : "This release has no CLI features, improvements, or fixes; CLI users may skip it if preferred.")
: (isZh ? "此板块没有功能或修复条目;相关说明请查看下方升级提醒和风险提示。" : "No feature or fix entries are listed here; see the upgrade and risk notes below."),
"",
);
}
}
function appendOtherTargetSection(lines, release, lang) {
const isZh = lang === "zh";
const isOtherOnly = (item) => item.targets?.length && !hasTarget(item, "desktop") && !hasTarget(item, "cli");
const highlights = release.highlights.filter(isOtherOnly);
const changes = Object.fromEntries(changeKinds.map((kind) => [kind, release.changes[kind].filter(isOtherOnly)]));
if (!highlights.length && !changeKinds.some((kind) => changes[kind].length)) return;
lines.push(`## ${isZh ? "其他项目更新" : "Other project updates"}`, "");
if (highlights.length) lines.push(renderItems(highlights, lang), "");
for (const kind of changeKinds) {
if (changes[kind].length) lines.push(renderItems(changes[kind], lang), "");
}
}
export function renderGitHubRelease(release, lang = "zh") {
if (release.product === "studio") return release.sourceNotes.markdown;
const isZh = lang === "zh";
const isPreview = release.channel === "prerelease";
const channelLabel = isPreview ? (isZh ? "预览版" : "Preview") : (isZh ? "稳定版" : "Stable");
const lines = [
`> ${localized(release.summary, lang)}`,
"",
`**${isZh ? "发布渠道" : "Release channel"}:${channelLabel} · v${release.version}**`,
"",
isZh
? `[English →](https://reasonix.io/changelog/v${release.version}/?lang=en) · [网页版完整更新日志 →](https://reasonix.io/changelog/v${release.version}/)`
: `[中文 →](https://reasonix.io/changelog/v${release.version}/?lang=zh) · [Full release notes →](https://reasonix.io/changelog/v${release.version}/?lang=en)`,
"",
];
if (release.guides.length) {
lines.push(`## ${isZh ? "使用攻略" : "Guides"}`, "");
for (const guide of release.guides) {
lines.push(`- [**${localized(guide.title, lang)}**](${guide.href}) — ${localized(guide.body, lang)}`);
}
lines.push("");
}
lines.push(
`## ${isZh ? "概览" : "Overview"}`,
"",
`**Reasonix v${release.version} — ${localized(release.title, lang)}**`,
"",
localized(release.summary, lang),
"",
`${isZh ? "发布日期" : "Released"}:${release.date}`,
"",
);
if (release.targetingVersion === 1) {
lines.push(
`**Desktop ${targetItemCount(release, "desktop")} · CLI ${targetItemCount(release, "cli")}**`,
"",
);
appendTargetSection(lines, release, "desktop", lang);
appendTargetSection(lines, release, "cli", lang);
appendOtherTargetSection(lines, release, lang);
} else {
lines.push(`## ${isZh ? "重点内容" : "Highlights"}`, "", renderItems(release.highlights, lang), "");
const headings = {
new: isZh ? "新功能" : "New",
improved: isZh ? "改进" : "Improved",
fixed: isZh ? "修复" : "Fixed",
};
for (const kind of changeKinds) {
const items = release.changes[kind];
if (!items.length) continue;
lines.push(`## ${headings[kind]}`, "", renderItems(items, lang), "");
}
}
lines.push(`## ${isZh ? "升级提醒" : "Upgrade notes"}`, "");
if (release.upgrade.length) lines.push(renderItems(release.upgrade, lang));
else lines.push(isZh ? "本版本无需手动迁移。" : "No manual migration is required.");
lines.push("");
lines.push(`## ${isZh ? "风险提示" : "Risk notes"}`, "");
if (release.risks.length) lines.push(renderItems(release.risks, lang));
else lines.push(isZh ? "当前没有需要额外操作的已知风险。" : "There are no known risks requiring extra action.");
lines.push("");
const thanked = withoutOwner(release.contributors);
if (thanked.length) {
lines.push(
`## ${isZh ? "致谢" : "Thanks"}`,
"",
`${isZh ? "感谢本版本的贡献者" : "Thanks to the contributors in this release"}:${thanked
.map((name) => `[@${name}](https://github.com/${name})`)
.join("、")}`,
"",
);
}
lines.push(
`## ${isZh ? "下载与安装" : "Download and install"}`,
"",
`- [${isZh ? "官网按平台下载" : "Platform downloads"}](${release.links.download})`,
`- [${isZh ? "查看完整差异" : "Full comparison"}](${release.links.compare})`,
"",
);
return `${lines.join("\n").trim()}\n`;
}
export async function upsertRelease(release, path = defaultCatalogPath) {
const catalog = await loadCatalog(path);
const next = {
...catalog,
releases: [release, ...catalog.releases.filter((entry) => entry.version !== release.version)].sort((a, b) =>
compareVersionsDesc(a.version, b.version),
),
};
validateCatalog(next);
await writeFile(path, `${JSON.stringify(next, null, 2)}\n`);
return next;
}
function parseArgs(argv) {
const [command = "validate", ...rest] = argv;
const values = { command };
for (let i = 0; i < rest.length; i += 1) {
const arg = rest[i];
if (!arg.startsWith("--")) throw new Error(`unexpected argument ${arg}`);
values[arg.slice(2)] = rest[++i];
}
return values;
}
async function main() {
const args = parseArgs(process.argv.slice(2));
const catalogPath = args.catalog ? resolve(args.catalog) : defaultCatalogPath;
const catalog = await loadCatalog(catalogPath);
if (args.command === "validate") {
console.log(`Validated ${catalog.releases.length} release note(s).`);
return;
}
if (args.command !== "render") throw new Error(`unknown command ${args.command}`);
invariant(args.version, "render requires --version");
invariant(args.output, "render requires --output");
const release = releaseForVersion(catalog, args.version);
const output = resolve(args.output);
await writeFile(output, renderGitHubRelease(release, args.lang === "en" ? "en" : "zh"));
console.log(`Rendered v${release.version} release notes to ${output}`);
}
if (process.argv[1] && resolve(process.argv[1]) === fileURLToPath(import.meta.url)) {
main().catch((error) => {
console.error(error.message);
process.exitCode = 1;
});
}
@@ -1,268 +0,0 @@
import assert from "node:assert/strict";
import { test } from "node:test";
import {
editorialLimitInstruction,
inferPullTargetHints,
releaseOutputBudgets,
} from "./generate-release-notes.mjs";
import { loadCatalog, releaseForVersion, renderGitHubRelease, validateCatalog } from "./release-notes.mjs";
import { validateReleaseEvent } from "../release-event.mjs";
test("the committed release catalog is valid and newest first", async () => {
const catalog = await loadCatalog();
assert.equal(catalog.schemaVersion, 1);
assert.equal(new Set(catalog.releases.map((release) => release.version)).size, catalog.releases.length);
});
test("tag namespaces resolve to the same product release", async () => {
const catalog = await loadCatalog();
assert.equal(releaseForVersion(catalog, "v1.17.13").version, "1.17.13");
assert.equal(releaseForVersion(catalog, "desktop-v1.17.13").version, "1.17.13");
assert.equal(releaseForVersion(catalog, "npm-v1.17.13").version, "1.17.13");
});
test("GitHub rendering keeps product sections and source PR links", async () => {
const catalog = await loadCatalog();
const markdown = renderGitHubRelease(releaseForVersion(catalog, "1.17.13"), "zh");
assert.match(markdown, /## 使用攻略/);
assert.match(markdown, /## 重点内容/);
assert.match(markdown, /## 升级提醒/);
assert.match(markdown, /## 风险提示/);
assert.match(markdown, /## 致谢/);
assert.match(markdown, /\/pull\/6460/);
assert.match(markdown, /reasonix\.io\/changelog\/v1\.17\.13/);
});
test("targeted releases render Desktop and CLI sections from one shared item", async () => {
const catalog = await loadCatalog();
const markdown = renderGitHubRelease(releaseForVersion(catalog, "1.31.4"), "zh");
assert.match(markdown, /## 桌面端更新/);
assert.match(markdown, /## CLI 端更新/);
assert.match(markdown, /## 其他项目更新/);
assert.match(markdown, /\*\*\[Service\]\*\* \*\*降低数据库读取成本\*\*/);
assert.equal(markdown.match(/更好的数学渲染/g)?.length, 2);
});
test("targeted release validation requires canonical item targets and matching surfaces", () => {
const release = {
version: "2.0.0",
targetingVersion: 1,
date: "2026-01-01",
channel: "stable",
title: { en: "Targeted", zh: "分类版本" },
summary: { en: "Summary", zh: "摘要" },
surfaces: ["desktop", "cli"],
guides: [],
highlights: [{
kind: "fixed",
targets: ["desktop", "cli"],
title: { en: "Shared fix", zh: "共享修复" },
body: { en: "A shared fix.", zh: "一项共享修复。" },
refs: [1],
}],
changes: { new: [], improved: [], fixed: [] },
upgrade: [],
risks: [],
contributors: [],
links: {
github: "https://example.com/release",
compare: "https://example.com/compare",
download: "https://example.com/download",
},
};
assert.doesNotThrow(() => validateCatalog({ schemaVersion: 1, releases: [release] }));
assert.throws(
() => validateCatalog({
schemaVersion: 1,
releases: [{ ...release, highlights: [{ ...release.highlights[0], targets: undefined }] }],
}),
/targets must be a non-empty array/,
);
assert.throws(
() => validateCatalog({ schemaVersion: 1, releases: [{ ...release, surfaces: ["desktop"] }] }),
/surfaces must equal the canonical union/,
);
assert.throws(
() => validateCatalog({
schemaVersion: 1,
releases: [{ ...release, highlights: [{ ...release.highlights[0], targets: ["cli", "desktop"] }] }],
}),
/targets must use canonical order/,
);
});
test("targeting adoption boundary preserves historical releases and rejects future legacy records", () => {
const release = {
version: "1.31.3",
date: "2026-01-01",
channel: "stable",
title: { en: "Legacy", zh: "旧版" },
summary: { en: "Summary", zh: "摘要" },
surfaces: ["desktop"],
guides: [],
highlights: [{
kind: "fixed",
title: { en: "Legacy fix", zh: "旧版修复" },
body: { en: "A historical fix.", zh: "一项历史修复。" },
refs: [1],
}],
changes: { new: [], improved: [], fixed: [] },
upgrade: [],
risks: [],
contributors: [],
links: {
github: "https://example.com/release",
compare: "https://example.com/compare",
download: "https://example.com/download",
},
};
assert.doesNotThrow(() => validateCatalog({ schemaVersion: 1, releases: [release] }));
for (const version of ["1.31.4", "1.32.0", "2.0.0-preview.1"]) {
assert.throws(
() => validateCatalog({ schemaVersion: 1, releases: [{ ...release, version }] }),
/targetingVersion must be 1 for v1\.31\.4 and newer/,
);
}
});
test("release target hints prefer explicit product labels and identify shared or service paths", () => {
assert.deepEqual(inferPullTargetHints(["desktop"], ["internal/sessioncatalog/catalog.go"]), ["desktop"]);
assert.deepEqual(inferPullTargetHints(["desktop", "tui"], ["desktop/app.go", "internal/cli/cli.go"]), ["desktop", "cli"]);
assert.deepEqual(inferPullTargetHints([], ["internal/agent/agent.go"]), ["desktop", "cli"]);
assert.deepEqual(inferPullTargetHints([], ["workers/crash-report/src/index.ts"]), ["service"]);
});
test("release generation uses bounded output and a tighter truncation retry", () => {
assert.ok(releaseOutputBudgets.standard.highlights > releaseOutputBudgets.compact.highlights);
assert.ok(releaseOutputBudgets.standard.changes > releaseOutputBudgets.compact.changes);
assert.ok(releaseOutputBudgets.standard.bodyChars > releaseOutputBudgets.compact.bodyChars);
assert.match(editorialLimitInstruction(), /Always return a complete JSON object/);
assert.match(editorialLimitInstruction(true), /at most 4 highlights/);
assert.match(editorialLimitInstruction(true), /9 total change items/);
});
test("validation rejects bilingual drift", () => {
assert.throws(
() =>
validateCatalog({
schemaVersion: 1,
releases: [
{
version: "1.0.0",
date: "2026-01-01",
channel: "stable",
title: { en: "Title", zh: "" },
summary: { en: "Summary", zh: "摘要" },
},
],
}),
/title\.zh/,
);
});
test("managed Preview records bind every surface to one exact ordinal", () => {
const release = {
version: "1.19.0-preview.3",
releaseId: "1.19.0-preview.3",
baseVersion: "1.19.0",
date: "2026-07-31",
channel: "prerelease",
status: "reviewed",
previousRelease: "1.19.0-preview.2",
builds: {
cli: "v1.19.0-preview.3",
desktop: "v1.19.0-preview.3",
npm: "1.19.0-canary.3",
},
title: { en: "Preview", zh: "预览版" },
summary: { en: "Preview summary", zh: "预览版摘要" },
surfaces: ["cli"],
guides: [],
highlights: [{
kind: "fixed",
title: { en: "Fix", zh: "修复" },
body: { en: "A fix.", zh: "一项修复。" },
refs: [1],
}],
changes: { new: [], improved: [], fixed: [] },
upgrade: [],
risks: [],
contributors: [],
links: {
github: "https://github.com/esengine/DeepSeek-Reasonix/releases/tag/v1.19.0-preview.3",
compare: "https://github.com/esengine/DeepSeek-Reasonix/compare/v1.19.0-preview.2...v1.19.0-preview.3",
download: "https://reasonix.io/?download=desktop&channel=preview#start",
},
};
assert.doesNotThrow(() => validateCatalog({ schemaVersion: 1, releases: [release] }));
assert.throws(
() => validateCatalog({
schemaVersion: 1,
releases: [{ ...release, builds: { ...release.builds, npm: "1.19.0-canary.4" } }],
}),
/builds\.npm/,
);
});
test("publication marker is bound to reviewed version, channel, SHA, and builds", () => {
const release = {
version: "1.19.0-preview.3",
channel: "prerelease",
candidateSha: "a".repeat(40),
builds: {
cli: "v1.19.0-preview.3",
desktop: "v1.19.0-preview.3",
npm: "1.19.0-canary.3",
},
};
const event = {
schemaVersion: 1,
releaseId: release.version,
channel: "preview",
candidateSha: release.candidateSha,
publishedAt: "2026-07-31T00:00:00.000Z",
releaseNotesUrl: "https://reasonix.io/changelog/v1.19.0-preview.3/",
builds: release.builds,
};
assert.doesNotThrow(() => validateReleaseEvent(event, release));
assert.throws(
() => validateReleaseEvent({ ...event, candidateSha: "b".repeat(40) }, release),
/candidateSha/,
);
});
test("Studio tag lookup and verbatim rendering stay separate from CLI records", async () => {
const { studioRecord } = await import('./sync-releases.mjs');
const source = '中立发布说明。\n\n## 改进\n\n- 窗口布局\n';
const studio = studioRecord({ tag_name: 'studio-v2.24.0', published_at: '2026-09-30T00:00:00Z' }, source, 'a'.repeat(40));
const catalog = validateCatalog({ schemaVersion: 1, releases: [studio] });
assert.equal(releaseForVersion(catalog, 'studio-v2.24.0').product, 'studio');
assert.equal(renderGitHubRelease(studio, 'en'), source);
});
test("the repository owner is never thanked: not collected, not rendered, case-insensitively", async () => {
const { contributorsOf } = await import("./generate-release-notes.mjs");
const { withoutOwner, repositoryOwner } = await import("../../src/lib/repository-owner.mjs");
assert.equal(repositoryOwner, "esengine");
assert.deepEqual(withoutOwner(["alice", "EsEngine", "bob"]), ["alice", "bob"]);
assert.deepEqual(contributorsOf([{ author: "esengine" }, { author: "alice" }, { author: "alice" }, { author: null }, { author: "ESENGINE" }]), ["alice"]);
assert.deepEqual(contributorsOf([{ author: "esengine" }]), []);
const catalog = await loadCatalog();
const base = catalog.releases.find((release) => release.product !== "studio" && release.contributors.length);
const markdown = renderGitHubRelease({ ...base, contributors: ["esengine", "alice"] }, "en");
assert.doesNotMatch(markdown, /@esengine/);
assert.match(markdown, /\[@alice\]/);
const alone = renderGitHubRelease({ ...base, contributors: ["esengine"] }, "en");
assert.doesNotMatch(alone, /@esengine|## Thanks/);
});
test("the changelog page filters contributors through the owner helper", async () => {
const { readFile } = await import("node:fs/promises");
const page = await readFile(new URL("../../src/components/ChangelogPage.astro", import.meta.url), "utf8");
assert.match(page, /withoutOwner\(release\.contributors\)/);
assert.doesNotMatch(page, /release\.contributors\.(length|map)/);
});
-139
View File
@@ -1,139 +0,0 @@
#!/usr/bin/env node
import { execFileSync } from 'node:child_process';
import { appendFile } from 'node:fs/promises';
import { resolve } from 'node:path';
import { fileURLToPath } from 'node:url';
import { parseStudioNotes } from '../../src/lib/studio-notes.mjs';
import { compareVersionsDesc, loadCatalog, upsertRelease, validateCatalog } from './release-notes.mjs';
const repository = 'esengine/DeepSeek-Reasonix';
export function missingReleases(published, catalog, { studioOnly = false } = {}) {
const existing = new Set(catalog.releases.map((r) => `${r.product || 'cli'}:${r.version}`));
// The archive starts after the earliest GitHub tags. Do not require source
// catalogs from releases that predate the website's supported history.
const oldestCLI = catalog.releases.filter((r) => r.product !== 'studio' && r.channel === 'stable')
.map((r) => r.version).sort(compareVersionsDesc).at(-1);
const missing = new Map();
for (const release of published) {
if (release.draft || !release.published_at) continue;
const studio = release.tag_name.match(/^studio-v(2\.\d+\.\d+)$/);
const cli = release.tag_name.match(/^(?:desktop-|npm-)?v(1\.\d+\.\d+)$/);
if (!studio && (!cli || release.prerelease)) continue;
const product = studio ? 'studio' : 'cli';
if (studioOnly && product !== 'studio') continue;
const version = (studio || cli)[1];
if (product === 'cli' && oldestCLI && compareVersionsDesc(version, oldestCLI) > 0) continue;
const key = `${product}:${version}`;
if (existing.has(key)) continue;
// Prefer the canonical CLI release over duplicate desktop/package tags.
if (!missing.has(key) || release.tag_name === `v${version}`) {
missing.set(key, { ...release, product, version });
}
}
return [...missing.values()].sort((a, b) => -compareVersionsDesc(a.version, b.version));
}
export function studioRecord(release, markdown, sha) {
if (!markdown?.trim()) throw new Error(`Missing Studio source for ${release.tag_name}`);
const version = release.version || release.tag_name.replace(/^studio-v/, '');
const title = { en: `Reasonix Studio v${version}`, zh: `Reasonix Studio v${version}` };
const line = parseStudioNotes(markdown).summary || `Reasonix Studio v${version}`;
const summary = { en: line, zh: line };
return {
product: 'studio', version, date: release.published_at.slice(0, 10),
channel: 'stable',
sourceNotes: { language: 'zh', markdown, sha, path: `release-notes/studio/${version}.md` },
title, summary, surfaces: ['desktop'], guides: [],
highlights: [{ kind: 'improved', title, body: summary }],
changes: { new: [], improved: [], fixed: [] }, upgrade: [], risks: [], contributors: [],
links: {
github: `https://github.com/${repository}/releases/tag/studio-v${version}`,
compare: `https://github.com/${repository}/blob/${sha}/release-notes/studio/${version}.md`,
download: 'https://reasonix.io/#start',
},
};
}
export function describeFailure(error, secrets = [process.env.DEEPSEEK_API_KEY, process.env.GH_TOKEN, process.env.GITHUB_TOKEN]) {
let text = String(error?.message ?? error).split('\n')[0];
for (const secret of secrets) if (secret && secret.length > 3) text = text.split(secret).join('[redacted]');
text = text.replace(/(Bearer\s+|sk-|ghp_|gho_|ghs_|github_pat_)\S+/g, '$1[redacted]').slice(0, 200);
return `${error?.name || 'Error'}: ${text}`;
}
export async function readStudioSource(release, api) {
const { sha } = JSON.parse(await api(`commits/${release.tag_name}`));
if (!/^[0-9a-f]{40}$/.test(sha)) throw new Error(`Invalid source commit for ${release.tag_name}`);
const version = release.version || release.tag_name.replace(/^studio-v/, '');
const markdown = await api(`contents/release-notes/studio/${version}.md?ref=${sha}`, true);
return { sha, markdown };
}
export async function readCLISource(release, api) {
const { sha } = JSON.parse(await api(`commits/${release.tag_name}`));
if (!/^[0-9a-f]{40}$/.test(sha)) throw new Error(`Invalid source commit for ${release.tag_name}`);
const catalog = JSON.parse(await api(`contents/release-notes/releases.json?ref=${sha}`, true));
const record = catalog.releases?.find((r) => r.version === release.version && r.product !== 'studio');
if (!record) throw new Error(`Missing CLI source for ${release.tag_name}`);
validateCatalog({ schemaVersion: catalog.schemaVersion, releases: [record] });
// Keep reviewed records gated by fetch-publications.mjs and its all-surface
// marker. A GitHub release alone must not promote them to published.
return record;
}
export function requireSync(result) {
if (result.pending.length) throw new Error(`Changelog sync incomplete: ${result.pending.join(', ')}`);
}
export function requireStudioSync(result, catalog, expectedVersion) {
if (result.pending.length) throw new Error(`Studio changelog sync incomplete: ${result.pending.join(', ')}`);
const version = expectedVersion?.replace(/^v/, '');
if (version && !catalog.releases.some((r) => r.product === 'studio' && r.version === version)) {
throw new Error(`Studio changelog is missing requested release ${expectedVersion}`);
}
}
export async function syncCatalog({ catalog, published, studioOnly = false, readStudio, readCLI, save }) {
const added = [], pending = [], failures = [];
for (const release of missingReleases(published, catalog, { studioOnly })) {
const key = `${release.product}:${release.version}`;
try {
if (release.product === 'studio') {
const { markdown, sha } = await readStudio(release);
await save(studioRecord(release, markdown, sha));
} else {
await save(await readCLI(release));
}
added.push(key);
} catch (error) {
pending.push(key);
failures.push({ key, reason: describeFailure(error) });
}
}
return { added, pending, failures };
}
async function main() {
const studioOnly = process.argv.includes('--studio-only');
const api = (endpoint, raw = false, paginate = false) => execFileSync('gh', [
'api', '--hostname', 'github.com', ...(paginate ? ['--paginate', '--slurp'] : []),
...(raw ? ['-H', 'Accept: application/vnd.github.raw+json'] : []), `repos/${repository}/${endpoint}`,
], { encoding: 'utf8', maxBuffer: 64 * 1024 * 1024, stdio: ['ignore', 'pipe', 'pipe'] });
const published = JSON.parse(api('releases?per_page=100', false, true)).flat();
const result = await syncCatalog({
catalog: await loadCatalog(), published, studioOnly,
readStudio: (release) => readStudioSource(release, api),
save: (release) => upsertRelease(release),
readCLI: (release) => readCLISource(release, api),
});
const summary = `## Website changelog sync\n\nAdded: ${result.added.join(', ') || 'none'}\n\nPending (retried next run): ${result.pending.join(', ') || 'none'}\n${result.failures.map((f) => `\n- ${f.key}: ${f.reason}`).join('')}\n`;
console.log(summary);
if (process.env.GITHUB_STEP_SUMMARY) await appendFile(process.env.GITHUB_STEP_SUMMARY, summary);
requireSync(result);
requireStudioSync(result, await loadCatalog(), process.env.STUDIO_RELEASE_VERSION);
}
if (process.argv[1] && resolve(process.argv[1]) === fileURLToPath(import.meta.url)) {
main().catch((error) => { console.error(error.message); process.exitCode = 1; });
}
@@ -1,201 +0,0 @@
import assert from 'node:assert/strict';
import { readFile } from 'node:fs/promises';
import { test } from 'node:test';
import { describeFailure, missingReleases, readCLISource, readStudioSource, requireSync, requireStudioSync, studioRecord, syncCatalog } from './sync-releases.mjs';
import { loadCatalog, validateCatalog, renderGitHubRelease } from './release-notes.mjs';
const published = (tag, extra = {}) => ({ tag_name: tag, draft: false, prerelease: false, published_at: '2026-09-30T12:00:00Z', ...extra });
test('discovery deduplicates CLI namespaces, includes published Studio previews and ignores drafts and unrelated tags', () => {
const found = missingReleases([
published('v1.39.3'), published('desktop-v1.39.3'), published('npm-v1.39.3'),
published('studio-v2.24.0', { prerelease: true }), published('studio-v2.25.0', { draft: true }),
published('v1.39.2'), published('v1.40.0-preview.1', { prerelease: true }), published('other-v3.0.0'),
], { releases: [{ version: '1.39.2', product: 'cli' }] });
assert.deepEqual(found.map(({ product, version }) => [product, version]), [['cli', '1.39.3'], ['studio', '2.24.0']]);
});
const cliOnlyCatalog = async () => {
const catalog = await loadCatalog();
return { ...catalog, releases: catalog.releases.filter((r) => r.product !== 'studio') };
};
test('Studio preserves Chinese source verbatim and validates without CLI targeting', async () => {
const notes = '中立版本说明。\n\n## 修复\n\n- 改善窗口布局\n';
const release = studioRecord(published('studio-v2.24.0', { prerelease: true }), notes, 'a'.repeat(40));
assert.equal(release.product, 'studio');
assert.equal(release.sourceNotes.language, 'zh');
assert.equal(release.sourceNotes.markdown, notes);
assert.equal(release.channel, 'stable');
assert.doesNotThrow(() => validateCatalog({ schemaVersion: 1, releases: [release] }));
assert.equal(renderGitHubRelease(release), notes);
const catalog = await loadCatalog();
assert.throws(() => validateCatalog({ ...catalog, releases: [{ ...catalog.releases[0], product: 'invalid' }] }));
assert.throws(() => validateCatalog({ schemaVersion: 1, releases: [{ ...release, sourceNotes: undefined }] }));
});
test('batch sync imports reviewed CLI and Studio source without model generation', async () => {
const catalog = await cliOnlyCatalog();
const saved = [];
const result = await syncCatalog({
catalog, published: [published('v1.99.0'), published('studio-v2.24.0')],
readStudio: async () => ({ sha: 'a'.repeat(40), markdown: '中立更新。\n' }),
save: async (release) => saved.push(release),
readCLI: async () => ({ version: '1.99.0', status: 'reviewed' }),
});
assert.deepEqual(saved.map((r) => r.version), ['1.99.0', '2.24.0']);
assert.equal(saved[0].status, 'reviewed');
assert.deepEqual(result.pending, []);
assert.deepEqual(result.added, ['cli:1.99.0', 'studio:2.24.0']);
});
test('existing catalog entries are never regenerated', async () => {
const catalog = await loadCatalog();
const result = await syncCatalog({ catalog, published: [published('v1.39.2')], save: () => { throw new Error('unexpected write'); } });
assert.deepEqual(result, { added: [], pending: [], failures: [] });
});
test('batch failures retry independently and never manufacture missing Studio notes', async () => {
const result = await syncCatalog({
catalog: await cliOnlyCatalog(), published: [published('studio-v2.23.0'), published('studio-v2.24.0')],
readStudio: async (release) => ({ sha: 'a'.repeat(40), markdown: release.version === '2.23.0' ? '' : '中立说明。' }),
save: async () => {},
});
assert.deepEqual(result.added, ['studio:2.24.0']);
assert.deepEqual(result.pending, ['studio:2.23.0']);
assert.match(result.failures[0].reason, /^Error: Missing Studio source/);
});
test('CLI range selection uses the earlier CLI release even with newer Studio and CLI records', async () => {
const { previousCLIRelease } = await import('./generate-release-notes.mjs');
assert.equal(previousCLIRelease({ releases: [
{ version: '2.24.0', product: 'studio', channel: 'stable' },
{ version: '1.39.6', product: 'cli', channel: 'stable' },
{ version: '1.39.2', channel: 'stable' },
] }, '1.39.3').version, '1.39.2');
});
test('an upstream published CLI release preserves its publication-marker gate', async () => {
const saved = [];
const result = await syncCatalog({
catalog: await loadCatalog(), published: [published('v1.99.0')],
readCLI: async () => ({ version: '1.99.0', product: 'cli', status: 'reviewed' }),
save: async (release) => saved.push(release),
});
assert.deepEqual(result.added, ['cli:1.99.0']);
assert.equal(saved[0].status, 'reviewed');
});
test('failure reasons carry the error class and a message but never secrets', async () => {
const result = await syncCatalog({
catalog: await loadCatalog(), published: [published('v1.99.0')],
readCLI: async () => { throw new TypeError('request failed with Bearer abc123token and key sk-live-999\nstack line'); },
save: async () => {},
});
assert.deepEqual(result.pending, ['cli:1.99.0']);
assert.equal(result.failures[0].reason, 'TypeError: request failed with Bearer [redacted] and key sk-[redacted]');
assert.equal(describeFailure(new Error('boom hunter2'), ['hunter2']), 'Error: boom [redacted]');
});
test('Studio entries take their summary from the first line of the notes', () => {
const release = studioRecord(published('studio-v2.24.0'), '本版加入反馈。\n\n## 新增\n\n- 项 (#1)\n', 'a'.repeat(40));
assert.equal(release.summary.zh, '本版加入反馈。');
assert.equal(release.summary.en, '本版加入反馈。');
});
test('Studio source is read from its published tag commit, never the moving product branch', async () => {
const sha = 'b'.repeat(40);
const source = await readStudioSource(published('studio-v2.45.0'), async (endpoint, raw) => {
if (endpoint === 'commits/studio-v2.45.0') return JSON.stringify({ sha });
assert.equal(endpoint, `contents/release-notes/studio/2.45.0.md?ref=${sha}`);
assert.equal(raw, true);
return '该版本原始说明。\n';
});
assert.deepEqual(source, { sha, markdown: '该版本原始说明。\n' });
});
test('build sync imports all missing Studio releases, leaves CLI alone and is idempotent', async () => {
const catalog = { schemaVersion: 1, releases: [] };
const releases = [published('v1.99.0'), published('studio-v2.44.0'), published('studio-v2.45.0'), published('studio-v2.46.0', { draft: true })];
const run = () => syncCatalog({
catalog, published: releases, studioOnly: true,
readStudio: async (release) => ({ sha: release.version === '2.44.0' ? 'a'.repeat(40) : 'b'.repeat(40), markdown: `${release.version} 原文。\n` }),
save: async (release) => catalog.releases.unshift(release),
});
const first = await run();
assert.deepEqual(first.added, ['studio:2.44.0', 'studio:2.45.0']);
assert.deepEqual(first.pending, []);
assert.equal(catalog.releases[0].version, '2.45.0');
assert.equal(catalog.releases[0].sourceNotes.sha, 'b'.repeat(40));
assert.deepEqual((await run()).added, []);
});
test('a failed or incomplete Studio sync blocks publication of a stale catalog', () => {
const catalog = { releases: [{ product: 'studio', version: '2.44.0' }, { version: '2.45.0', product: 'cli' }] };
const complete = { pending: [], failures: [] };
assert.doesNotThrow(() => requireStudioSync(complete, catalog));
assert.doesNotThrow(() => requireStudioSync(complete, catalog, '2.44.0'));
assert.doesNotThrow(() => requireStudioSync(complete, catalog, 'v2.44.0'));
assert.throws(() => requireStudioSync(complete, catalog, '2.45.0'), /2\.45\.0/);
assert.throws(() => requireStudioSync({ pending: ['studio:2.45.0'] }, catalog), /studio:2\.45\.0/);
});
test('production builds synchronize both products before rendering and deployments require the website branch', async () => {
const pkg = JSON.parse(await readFile(new URL('../../package.json', import.meta.url), 'utf8'));
assert.ok(pkg.scripts.prebuild.startsWith('node scripts/releases/sync-releases.mjs &&'));
const workflow = await readFile(new URL('../../../.github/workflows/pages.yml', import.meta.url), 'utf8');
assert.match(workflow, /workflow_dispatch:\n inputs:/);
assert.match(workflow, /if: github\.ref == 'refs\/heads\/website'/);
assert.match(workflow, /STUDIO_RELEASE_VERSION: \$\{\{ inputs\.studio_version \}\}/);
});
test('CLI sources use exact published tag commits and preserve reviewed bilingual content', async () => {
const catalog = await loadCatalog();
const record = catalog.releases.find((r) => r.version === '1.39.7');
const sha = 'c'.repeat(40);
for (const tag of ['v1.39.7', 'desktop-v1.39.7']) {
const result = await readCLISource({ ...published(tag), version: '1.39.7' }, async (endpoint, raw) => {
if (endpoint === `commits/${tag}`) return JSON.stringify({ sha });
assert.equal(endpoint, `contents/release-notes/releases.json?ref=${sha}`);
assert.equal(raw, true);
return JSON.stringify({ schemaVersion: 1, releases: [record] });
});
assert.deepEqual(result, record);
}
});
test('missing or invalid CLI source fails closed while independent Studio sync continues', async () => {
const release = { ...published('v1.99.0'), version: '1.99.0' };
const api = async (endpoint) => endpoint.startsWith('commits/')
? JSON.stringify({ sha: 'd'.repeat(40) })
: JSON.stringify({ schemaVersion: 1, releases: [] });
const result = await syncCatalog({
catalog: await cliOnlyCatalog(), published: [release, published('studio-v2.99.0')],
readCLI: (r) => readCLISource(r, api),
readStudio: async () => ({ sha: 'e'.repeat(40), markdown: '更新说明。' }),
save: async () => {},
});
assert.deepEqual(result.pending, ['cli:1.99.0']);
assert.deepEqual(result.added, ['studio:2.99.0']);
assert.throws(() => requireSync(result), /cli:1\.99\.0/);
await assert.rejects(readCLISource(release, async () => JSON.stringify({ sha: 'invalid' })), /Invalid source commit/);
await assert.rejects(readCLISource(release, async (endpoint) => endpoint.startsWith('commits/')
? JSON.stringify({ sha: 'd'.repeat(40) })
: JSON.stringify({ schemaVersion: 1, releases: [{ version: '1.99.0' }] })), /date/);
});
test('build sync respects the archive history boundary and never imports unpublished CLI drafts', async () => {
const catalog = { schemaVersion: 1, releases: [{ version: '1.39.7', channel: 'stable' }] };
const releases = [published('v1.0.0'), published('v1.39.8'), published('desktop-v1.39.8'),
published('v1.39.9'), published('v1.39.10', { draft: true }), published('v1.39.11', { prerelease: true })];
const run = () => syncCatalog({
catalog, published: releases,
readCLI: async (r) => ({ version: r.version, channel: 'stable', status: 'reviewed' }),
save: async (r) => catalog.releases.unshift(r),
});
assert.deepEqual((await run()).added, ['cli:1.39.8', 'cli:1.39.9']);
assert.deepEqual(catalog.releases.map((r) => r.version), ['1.39.9', '1.39.8', '1.39.7']);
const repeated = await run();
assert.deepEqual(repeated, { added: [], pending: [], failures: [] });
assert.doesNotThrow(() => requireSync(repeated));
});
-445
View File
@@ -1,445 +0,0 @@
---
import Base from '../layouts/Base.astro';
import CommunityJoin from './CommunityJoin.astro';
import SiteHeader from './SiteHeader.astro';
import type { ReleaseItem, ReleaseRecord, ReleaseTarget } from '../data/releases';
import { releasePath, releaseTargetCount } from '../data/releases';
import { issueHref, parseStudioNotes } from '../lib/studio-notes.mjs';
import { withoutOwner } from '../lib/repository-owner.mjs';
import '../styles/changelog.css';
const { release, releases, canonical } = Astro.props as {
release: ReleaseRecord;
releases: ReleaseRecord[];
canonical?: string;
};
const thanked = withoutOwner(release.contributors);
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
const repo = 'https://github.com/esengine/DeepSeek-Reasonix';
const prHref = (ref: number) => `${repo}/pull/${ref}`;
const isStudio = release.product === 'studio';
const isPreview = !isStudio && release.channel === 'prerelease';
const latestForChannel = releases[0];
const studioDoc = isStudio && release.sourceNotes ? parseStudioNotes(release.sourceNotes.markdown) : null;
const studioBlocks = studioDoc ? studioDoc.blocks.filter((block, index) => !(index === 0 && block.type === 'paragraph' && studioDoc.summary === release.summary.zh)) : [];
const downloadHref = isPreview ? 'https://reasonix.io/?download=desktop#start' : release.links.download;
const kindLabel = (kind: string) => ({
new: { en: 'New', zh: '新增' },
improved: { en: 'Improved', zh: '改进' },
fixed: { en: 'Fixed', zh: '修复' },
security: { en: 'Security', zh: '安全' },
}[kind] ?? { en: kind, zh: kind });
const surfaceLabel = (surface: string) => ({
agent: { en: 'Agent', zh: 'Agent' },
desktop: { en: 'Desktop', zh: '桌面端' },
cli: { en: 'CLI', zh: 'CLI' },
mcp: { en: 'MCP', zh: 'MCP' },
security: { en: 'Security', zh: '安全' },
provider: { en: 'Provider', zh: '模型服务' },
plugin: { en: 'Plugins', zh: '插件' },
site: { en: 'Site', zh: '网站' },
service: { en: 'Service', zh: '服务端' },
}[surface] ?? { en: surface, zh: surface });
const targetingEnabled = release.targetingVersion === 1;
const changeKinds = ['new', 'improved', 'fixed'] as const;
const clientTargets: { id: ReleaseTarget; en: string; zh: string }[] = [
{ id: 'desktop', en: 'Desktop updates', zh: '桌面端更新' },
{ id: 'cli', en: 'CLI updates', zh: 'CLI 端更新' },
];
const hasTarget = (item: ReleaseItem, target: ReleaseTarget) => item.targets?.includes(target) ?? false;
const clientHighlights = (target: ReleaseTarget) => release.highlights.filter((item) => hasTarget(item, target));
const clientChanges = (target: ReleaseTarget, kind: typeof changeKinds[number]) =>
release.changes[kind].filter((item) => hasTarget(item, target));
const hasClientChangeContent = (target: ReleaseTarget) =>
clientHighlights(target).length > 0 || changeKinds.some((kind) => clientChanges(target, kind).length > 0);
const isOtherOnly = (item: ReleaseItem) =>
Boolean(item.targets?.length) && !hasTarget(item, 'desktop') && !hasTarget(item, 'cli');
const otherHighlights = release.highlights.filter(isOtherOnly);
const otherChanges = Object.fromEntries(
changeKinds.map((kind) => [kind, release.changes[kind].filter(isOtherOnly)]),
) as Record<typeof changeKinds[number], ReleaseItem[]>;
const hasOtherChanges = otherHighlights.length > 0 || changeKinds.some((kind) => otherChanges[kind].length > 0);
/* Sections render only when they have content; numbering is sequential. */
const sectionDefs = [
...(release.guides.length ? [{ id: 'guides', en: 'Guides', zh: '使用攻略' }] : []),
...(targetingEnabled
? [
...clientTargets,
...(hasOtherChanges ? [{ id: 'other', en: 'Other project updates', zh: '其他项目更新' }] : []),
]
: [
{ id: 'highlights', en: 'Highlights', zh: '重点内容' },
...changeKinds
.filter((kind) => release.changes[kind].length)
.map((kind) => ({ id: kind, ...kindLabel(kind) })),
]),
...(release.upgrade.length ? [{ id: 'upgrade', en: 'Upgrade notes', zh: '升级提醒' }] : []),
...(release.risks.length ? [{ id: 'risks', en: 'Risk notes', zh: '风险提示' }] : []),
...(thanked.length ? [{ id: 'thanks', en: 'Thanks', zh: '致谢' }] : []),
];
const sectionNum = new Map(sectionDefs.map((s, i) => [s.id, String(i + 1).padStart(2, '0')]));
const tocItems = [...(isStudio ? [{ id: 'source-notes', en: 'Chinese source notes', zh: '中文原始说明' }] : sectionDefs), { id: 'download', en: 'Download', zh: '下载与安装' }];
/* Version rail: group by minor, show the latest few patches per group,
older ones behind a native <details> expander. */
const minorKey = (v: string) => v.split('.').slice(0, 2).join('.');
const railGroups: { key: string; items: ReleaseRecord[] }[] = [];
for (const item of releases) {
const key = minorKey(item.version);
const last = railGroups[railGroups.length - 1];
if (last && last.key === key) last.items.push(item);
else railGroups.push({ key, items: [item] });
}
const RAIL_VISIBLE = 3;
const titleEn = `Reasonix${isStudio ? ' Studio' : ''} v${release.version} release notes`;
const titleZh = `Reasonix${isStudio ? ' Studio' : ''} v${release.version} 更新日志`;
const description = release.summary.en;
---
<Base title={titleEn} titleEn={titleEn} titleZh={titleZh} description={description} canonical={canonical} noindex={isPreview}>
<SiteHeader active="changelog" scrolled />
<main class="release-stage">
<nav class="release-product-tabs" aria-label="Products">
<a href={`${base}/changelog/cli/`} aria-current={!isStudio ? 'page' : undefined}><span class="l-en">CLI · 1.x (previous)</span><span class="l-zh">CLI · 1.x(上一代)</span></a>
<a href={`${base}/changelog/`} aria-current={isStudio ? 'page' : undefined}>Studio · 2.x</a>
</nav>
<div class="release-mobile-switcher">
<label for="release-version"><span class="l-en">Version</span><span class="l-zh">版本</span></label>
<select id="release-version" data-release-version>
{releases.map((item) => <option value={item.version} selected={item.version === release.version}>v{item.version}</option>)}
</select>
</div>
<div class="release-grid">
<aside class="release-rail" aria-label="Release versions">
<div class="release-rail__eyebrow"><span class="release-rail__mark"></span><span class="l-en">Release ledger</span><span class="l-zh">版本档案</span></div>
<nav>
{railGroups.map((group) => {
const channelItems = group.items;
if (!channelItems.length) return null;
const visible = channelItems.slice(0, RAIL_VISIBLE);
const overflow = channelItems.slice(RAIL_VISIBLE);
return (
<div class="release-rail__group">
<p class="release-rail__minor">{group.key}.x</p>
{visible.map((item) => (
<a class:list={["release-version-link", { active: item.version === release.version }]} href={`${base}${releasePath(item.version)}`}>
<span class="release-version-link__line"><strong>v{item.version}</strong>{item === latestForChannel && <em><span class="l-en">Latest</span><span class="l-zh">最新</span></em>}</span>
<small>{item.date}</small>
</a>
))}
{overflow.length > 0 && (
<details class="release-rail__more" open={overflow.some((item) => item.version === release.version)}>
<summary>
<span class="when-closed"><span class="l-en">+{overflow.length} more</span><span class="l-zh">还有 {overflow.length} 个</span></span>
<span class="when-open"><span class="l-en">Show less</span><span class="l-zh">收起</span></span>
</summary>
{overflow.map((item) => (
<a class:list={["release-version-link", { active: item.version === release.version }]} href={`${base}${releasePath(item.version)}`}>
<span class="release-version-link__line"><strong>v{item.version}</strong>{item === latestForChannel && <em><span class="l-en">Latest</span><span class="l-zh">最新</span></em>}</span>
<small>{item.date}</small>
</a>
))}
</details>
)}
</div>
);
})}
</nav>
<a class="release-rail__all" href={`${repo}/releases`}><span class="l-en">All GitHub releases ↗</span><span class="l-zh">全部 GitHub Releases ↗</span></a>
</aside>
<article class="release-paper">
<header class="release-hero">
<div class="release-hero__meta">
{isPreview && <span class="release-channel release-channel--preview"><span class="release-channel__dot"></span><span class="l-en">Historical archive</span><span class="l-zh">历史归档</span></span>}
<time datetime={release.date}>{release.date}</time>
</div>
<h1>Reasonix{isStudio ? ' Studio' : ''} v{release.version}</h1>
<div class="release-surfaces">
{release.surfaces.map((surface) => {
const label = surfaceLabel(surface);
return <span><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></span>;
})}
</div>
{release.builds && (
<div class="release-builds" aria-label="Published builds">
<span><strong>CLI</strong> {release.builds.cli}</span>
<span><strong>Desktop</strong> {release.builds.desktop}</span>
<span><strong>npm</strong> {release.builds.npm}</span>
</div>
)}
{targetingEnabled && (
<div class="release-target-summary" aria-label="Updates by product">
<span><strong>Desktop</strong> {releaseTargetCount(release, 'desktop')}</span>
<span><strong>CLI</strong> {releaseTargetCount(release, 'cli')}</span>
</div>
)}
<p class="release-lede"><span class="l-en">{release.summary.en}</span><span class="l-zh">{release.summary.zh}</span></p>
</header>
{isStudio && release.sourceNotes && (
<section id="source-notes" class="release-section">
<div class="release-section__head"><span>01</span><h2><span class="l-en">Chinese source notes</span><span class="l-zh">中文原始说明</span></h2></div>
<p class="release-source-link"><a href={release.links.compare}><span class="l-en">View source ↗</span><span class="l-zh">查看原文 ↗</span></a></p>
<div class="release-source-notes" lang="zh">
{studioBlocks.map((block) => block.type === 'heading' ? (
<h3>{block.inline.map((token) => token.type === 'code' ? <code>{token.value}</code> : token.value)}</h3>
) : block.type === 'list' ? (
<ul>
{block.items.map((item) => (
<li>{item.map((token) => token.type === 'code' ? <code>{token.value}</code> : token.type === 'ref' ? <a href={issueHref(token.number)} rel="noopener">{token.value}</a> : token.value)}</li>
))}
</ul>
) : (
<p>{block.inline.map((token) => token.type === 'code' ? <code>{token.value}</code> : token.type === 'ref' ? <a href={issueHref(token.number)} rel="noopener">{token.value}</a> : token.value)}</p>
))}
</div>
</section>
)}
{!isStudio && <>
{release.guides.length > 0 && (
<section id="guides" class="release-section release-guides">
<div class="release-section__head"><span>{sectionNum.get('guides')}</span><h2><span class="l-en">Start here</span><span class="l-zh">使用攻略</span></h2></div>
<div class="release-guide-grid">
{release.guides.map((guide) => (
<a class="release-guide" href={guide.href}>
<span class="release-guide__arrow">↗</span>
<h3><span class="l-en">{guide.title.en}</span><span class="l-zh">{guide.title.zh}</span></h3>
<p><span class="l-en">{guide.body.en}</span><span class="l-zh">{guide.body.zh}</span></p>
</a>
))}
</div>
</section>
)}
{targetingEnabled ? (
<>
{clientTargets.map((target) => {
const highlights = clientHighlights(target.id);
const total = releaseTargetCount(release, target.id);
return (
<section id={target.id} class="release-section release-target-section" data-target={target.id}>
<div class="release-section__head"><span>{sectionNum.get(target.id)}</span><h2><span class="l-en">{target.en}</span><span class="l-zh">{target.zh}</span></h2></div>
<p class="release-target-section__summary">
<span class="l-en">{total} update{total === 1 ? '' : 's'} relevant to {target.id === 'desktop' ? 'Desktop' : 'CLI'}.</span>
<span class="l-zh">与{target.id === 'desktop' ? '桌面端' : ' CLI'}相关的更新共 {total} 项。</span>
</p>
{highlights.length > 0 && (
<div class="release-target-group">
<h3 class="release-target-group__title"><span class="l-en">Highlights</span><span class="l-zh">重点内容</span></h3>
<div class="release-highlight-list">
{highlights.map((item, index) => {
const kind = kindLabel(item.kind);
return (
<article class="release-highlight" data-kind={item.kind}>
<div class="release-highlight__index">{String(index + 1).padStart(2, '0')}</div>
<div>
<div class="release-item-meta">
<div class="release-highlight__kind"><span class="l-en">{kind.en}</span><span class="l-zh">{kind.zh}</span></div>
<div class="release-item-targets">{item.targets?.map((itemTarget) => {
const label = surfaceLabel(itemTarget);
return <span><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></span>;
})}</div>
</div>
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</div>
</article>
);
})}
</div>
</div>
)}
{changeKinds.map((kind) => {
const items = clientChanges(target.id, kind);
if (!items.length) return null;
const label = kindLabel(kind);
return (
<div class="release-target-group">
<h3 class="release-target-group__title"><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></h3>
<div class="release-change-list">
{items.map((item: ReleaseItem) => (
<article>
<div class="release-item-targets">{item.targets?.map((itemTarget) => {
const targetLabel = surfaceLabel(itemTarget);
return <span><span class="l-en">{targetLabel.en}</span><span class="l-zh">{targetLabel.zh}</span></span>;
})}</div>
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</article>
))}
</div>
</div>
);
})}
{!hasClientChangeContent(target.id) && (
<div class="release-target-empty">
{target.id === 'cli' && total === 0 ? (
<><strong><span class="l-en">No CLI changes in this release.</span><span class="l-zh">本版本没有 CLI 相关改动。</span></strong><p><span class="l-en">CLI users may skip this version if preferred.</span><span class="l-zh">CLI 用户可按需跳过这个版本。</span></p></>
) : (
<><strong><span class="l-en">No feature or fix entries in this section.</span><span class="l-zh">此板块没有功能或修复条目。</span></strong><p><span class="l-en">See the upgrade and risk notes below for relevant guidance.</span><span class="l-zh">相关说明请查看下方升级提醒和风险提示。</span></p></>
)}
</div>
)}
</section>
);
})}
{hasOtherChanges && (
<section id="other" class="release-section release-target-section" data-target="other">
<div class="release-section__head"><span>{sectionNum.get('other')}</span><h2><span class="l-en">Other project updates</span><span class="l-zh">其他项目更新</span></h2></div>
<p class="release-target-section__summary"><span class="l-en">Website and service changes that do not require a Desktop or CLI update.</span><span class="l-zh">不要求更新桌面端或 CLI 的网站与服务端变更。</span></p>
<div class="release-change-list">
{[...otherHighlights, ...changeKinds.flatMap((kind) => otherChanges[kind])].map((item) => (
<article>
<div class="release-item-targets">{item.targets?.map((itemTarget) => {
const label = surfaceLabel(itemTarget);
return <span><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></span>;
})}</div>
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</article>
))}
</div>
</section>
)}
</>
) : (
<>
<section id="highlights" class="release-section">
<div class="release-section__head"><span>{sectionNum.get('highlights')}</span><h2><span class="l-en">Highlights</span><span class="l-zh">重点内容</span></h2></div>
<div class="release-highlight-list">
{release.highlights.map((item, index) => {
const kind = kindLabel(item.kind);
return (
<article class="release-highlight" data-kind={item.kind}>
<div class="release-highlight__index">{String(index + 1).padStart(2, '0')}</div>
<div>
<div class="release-highlight__kind"><span class="l-en">{kind.en}</span><span class="l-zh">{kind.zh}</span></div>
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</div>
</article>
);
})}
</div>
</section>
{changeKinds.map((kind) => {
const items = release.changes[kind];
if (!items.length) return null;
const label = kindLabel(kind);
return (
<section id={kind} class="release-section release-change-section">
<div class="release-section__head"><span>{sectionNum.get(kind)}</span><h2><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></h2></div>
<div class="release-change-list">
{items.map((item: ReleaseItem) => (
<article>
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</article>
))}
</div>
</section>
);
})}
</>
)}
{release.upgrade.length > 0 && (
<section id="upgrade" class="release-section">
<div class="release-section__head"><span>{sectionNum.get('upgrade')}</span><h2><span class="l-en">Upgrade notes</span><span class="l-zh">升级提醒</span></h2></div>
<div class="release-notice-list">
{release.upgrade.map((item) => (
<article class:list={["release-notice", `release-notice--${item.level}`]}>
<div class="release-notice__icon">{item.level === 'warning' ? '!' : 'i'}</div>
<div>
{item.targets?.length && <div class="release-item-targets">{item.targets.map((itemTarget) => {
const label = surfaceLabel(itemTarget);
return <span><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></span>;
})}</div>}
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</div>
</article>
))}
</div>
</section>
)}
{release.risks.length > 0 && (
<section id="risks" class="release-section">
<div class="release-section__head"><span>{sectionNum.get('risks')}</span><h2><span class="l-en">Risk notes</span><span class="l-zh">风险提示</span></h2></div>
<div class="release-change-list">
{release.risks.map((item) => (
<article>
{item.targets?.length && <div class="release-item-targets">{item.targets.map((itemTarget) => {
const label = surfaceLabel(itemTarget);
return <span><span class="l-en">{label.en}</span><span class="l-zh">{label.zh}</span></span>;
})}</div>}
<h3><span class="l-en">{item.title.en}</span><span class="l-zh">{item.title.zh}</span></h3>
<p><span class="l-en">{item.body.en}</span><span class="l-zh">{item.body.zh}</span></p>
{item.refs?.length && <div class="release-refs">{item.refs.map((ref) => <a href={prHref(ref)}>#{ref}</a>)}</div>}
</article>
))}
</div>
</section>
)}
{thanked.length > 0 && (
<section id="thanks" class="release-section release-thanks">
<div class="release-section__head"><span>{sectionNum.get('thanks')}</span><h2><span class="l-en">Thanks</span><span class="l-zh">致谢</span></h2></div>
<p><span class="l-en">This release was shaped by:</span><span class="l-zh">感谢本版本的贡献者:</span></p>
<div>{thanked.map((name) => <a href={`https://github.com/${name}`}>@{name}</a>)}</div>
</section>
)}
</>}
<section id="download" class="release-section release-download">
<div>
<p class="release-download__kicker"><span class="l-en">Ready when you are</span><span class="l-zh">准备好即可升级</span></p>
<h2><span class="l-en">Ship with a safer Reasonix.</span><span class="l-zh">升级到更可靠的 Reasonix。</span></h2>
</div>
<div class="release-download__actions">
<a class="btn btn-dark" href={downloadHref}><span class="l-en">Download</span><span class="l-zh">下载</span></a>
<a class="release-compare" href={release.links.compare}><span class="l-en">{isStudio ? 'Source notes ↗' : 'Full comparison ↗'}</span><span class="l-zh">{isStudio ? '原始说明 ↗' : '完整差异 ↗'}</span></a>
</div>
</section>
</article>
<aside class="release-toc">
<p><span class="l-en">In v{release.version}</span><span class="l-zh">在 v{release.version} 中</span></p>
<nav>{tocItems.map((item) => <a href={`#${item.id}`}><span class="l-en">{item.en}</span><span class="l-zh">{item.zh}</span></a>)}</nav>
</aside>
</div>
</main>
<CommunityJoin />
<footer class="release-footer">
<a class="brand" href={`${base}/`}><img src={`${base}/logo.svg`} alt="" /><span>Reasonix</span></a>
<span>© 2026 Reasonix · MIT</span>
<a href={repo}>GitHub ↗</a>
</footer>
<script>
import '../scripts/changelog.js';
</script>
</Base>
-71
View File
@@ -1,71 +0,0 @@
---
import { QQ_GROUP, DISCORD_URL, DOUYIN } from '../lib/community-links.mjs';
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
---
<section class="join" aria-labelledby="join-title" data-community-join>
<div class="join-card">
<div class="join-head">
<h2 id="join-title"><span class="l-en">Join the community</span><span class="l-zh">加入社区</span></h2>
<p><span class="l-en">Get setup help, share workflows, and talk to other Reasonix users.</span><span class="l-zh">安装答疑、分享工作流,和其他 Reasonix 用户交流。</span></p>
</div>
<div class="join-body">
<div class="join-qq">
<a class="join-qr" href={QQ_GROUP.joinUrl} target="_blank" rel="noreferrer" data-qq-join>
<img src={`${base}${QQ_GROUP.qrPath}`} width="132" height="132" alt="QQ group QR code" loading="lazy" decoding="async" />
</a>
<div class="join-info">
<span class="join-label">QQ</span>
<strong class="join-name">{QQ_GROUP.name}</strong>
<span class="join-num"><span class="l-en">Group</span><span class="l-zh">群号</span> <code>{QQ_GROUP.number}</code></span>
<a class="join-link" href={QQ_GROUP.joinUrl} target="_blank" rel="noreferrer"><span class="l-en">Join the QQ group</span><span class="l-zh">加入 QQ 群</span> ↗</a>
</div>
</div>
<div class="join-discord">
<span class="join-label">Discord</span>
<span class="join-note"><span class="l-en">Bilingual server with help channels and feature ideas.</span><span class="l-zh">双语服务器,有答疑频道和功能讨论。</span></span>
<a class="join-link" href={DISCORD_URL} target="_blank" rel="noreferrer" data-discord-join><span class="l-en">Join Discord</span><span class="l-zh">加入 Discord</span> ↗</a>
</div>
</div>
<details class="join-minor" data-douyin>
<summary><span class="l-en">Douyin</span><span class="l-zh">抖音</span> · <span class="l-en">ID</span><span class="l-zh">抖音号</span> <code>{DOUYIN.id}</code> <span class="join-minor-name">{DOUYIN.name}</span></summary>
<img src={`${base}${DOUYIN.qrPath}`} width="120" height="179" alt="Douyin QR code" loading="lazy" decoding="async" />
</details>
</div>
</section>
<style>
.join { max-width: 1180px; margin: 0 auto; padding: 36px 40px 8px; }
.join-card {
background: var(--bg-soft); border: 1px solid var(--line); border-radius: var(--radius);
padding: 24px 28px; display: grid; grid-template-columns: minmax(0, 1fr) auto; gap: 28px 40px; align-items: center;
}
.join-head h2 { font-size: 18px; font-weight: 600; letter-spacing: -0.01em; color: var(--ink); margin: 0 0 6px; }
.join-head p { font-size: 13.5px; line-height: 1.6; color: var(--ink-2); margin: 0; max-width: 34ch; }
.join-body { display: flex; gap: 32px; align-items: center; flex-wrap: wrap; }
.join-qq { display: flex; gap: 18px; align-items: center; }
.join-qr { display: block; line-height: 0; border: 1px solid var(--line); border-radius: var(--radius-sm); overflow: hidden; background: #fff; flex: none; }
.join-qr img { width: 132px; height: 132px; display: block; }
.join-minor { grid-column: 1 / -1; font-size: 12.5px; color: var(--ink-3); }
.join-minor summary { cursor: pointer; width: fit-content; }
.join-minor code { font-family: var(--font-mono); }
.join-minor img { display: block; margin-top: 10px; border-radius: var(--radius-sm); border: 1px solid var(--line); }
.join-info, .join-discord { display: flex; flex-direction: column; gap: 5px; align-items: flex-start; font-size: 13.5px; color: var(--ink-2); }
.join-label { font-family: var(--font-mono); font-size: 11.5px; letter-spacing: 0.04em; text-transform: uppercase; color: var(--ink-3); }
.join-name { font-size: 15px; font-weight: 600; color: var(--ink); }
.join-num code { font-family: var(--font-mono); font-size: 14px; color: var(--ink); }
.join-note { max-width: 24ch; line-height: 1.5; }
.join-link { color: var(--accent-deep); font-weight: 600; text-decoration: none; margin-top: 4px; }
.join-link:hover { text-decoration: underline; }
@media (max-width: 900px) {
.join { padding: 28px 24px 4px; }
.join-card { grid-template-columns: 1fr; }
.join-head p { max-width: none; }
}
@media (max-width: 480px) {
.join { padding: 24px 16px 4px; }
.join-card { padding: 20px 18px; }
.join-qq { flex-direction: column; align-items: flex-start; }
.join-body { gap: 22px; }
}
</style>
-37
View File
@@ -1,37 +0,0 @@
---
interface Props {
id: string;
name?: string;
autocomplete: string;
minlength?: number;
required?: boolean;
}
const { id, name, autocomplete, minlength, required = false } = Astro.props;
---
<div class="password-input">
<input
id={id}
name={name}
type="password"
autocomplete={autocomplete}
minlength={minlength}
required={required}
/>
<button
type="button"
class="password-toggle"
data-password-toggle
aria-controls={id}
aria-pressed="false"
aria-label="Show password / 显示密码">
<svg class="password-eye-open" viewBox="0 0 24 24" aria-hidden="true">
<path d="M2.5 12s3.5-6 9.5-6 9.5 6 9.5 6-3.5 6-9.5 6-9.5-6-9.5-6Z" />
<circle cx="12" cy="12" r="2.7" />
</svg>
<svg class="password-eye-closed" viewBox="0 0 24 24" aria-hidden="true">
<path d="M3 3l18 18M10.6 6.2A10.9 10.9 0 0 1 12 6c6 0 9.5 6 9.5 6a17 17 0 0 1-2.1 2.7M6.2 6.2C3.8 7.8 2.5 12 2.5 12s3.5 6 9.5 6a9.8 9.8 0 0 0 3.2-.5M9.9 9.9a3 3 0 0 0 4.2 4.2" />
</svg>
</button>
</div>
-129
View File
@@ -1,129 +0,0 @@
---
type ActiveItem = 'features' | 'surfaces' | 'studio' | 'skills' | 'community' | 'docs' | 'changelog';
const {
active,
scrolled = false,
} = Astro.props as {
active?: ActiveItem;
scrolled?: boolean;
};
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
const repo = 'https://github.com/esengine/DeepSeek-Reasonix';
const items: Array<{
id: ActiveItem;
href: string;
en: string;
zh: string;
secondary?: boolean;
}> = [
{ id: 'features', href: `${base}/#features`, en: 'Features', zh: '特性' },
{ id: 'surfaces', href: `${base}/#surfaces`, en: 'Surfaces', zh: '使用形态', secondary: true },
{ id: 'studio', href: `${base}/remote/`, en: 'Web Studio', zh: '网页版 Studio' },
{ id: 'skills', href: `${base}/skills/`, en: 'Skills', zh: '技能市场' },
{ id: 'community', href: `${base}/#community`, en: 'Community', zh: '社区', secondary: true },
{ id: 'docs', href: `${base}/docs/`, en: 'Docs', zh: '文档' },
{ id: 'changelog', href: `${base}/changelog/`, en: 'Changelog', zh: '更新日志' },
];
---
<header class:list={['nav', { scrolled }]}>
<div class="nav-inner">
<a class="brand" href={`${base}/`}>
<picture class="brand-picture">
<source media="(max-width: 400px)" srcset={`${base}/favicon.svg`} />
<img src={`${base}/logo.svg`} alt="Reasonix logo" />
</picture>
</a>
<nav class="nav-links" aria-label="Primary navigation">
{items.map((item) => (
<a
class:list={[{ here: active === item.id, 'nav-link--secondary': item.secondary }]}
href={item.href}
aria-current={active === item.id ? 'page' : undefined}
>
<span class="l-en">{item.en}</span>
<span class="l-zh">{item.zh}</span>
</a>
))}
</nav>
<a
class="nav-github"
href={repo}
target="_blank"
rel="noreferrer"
aria-label="Reasonix GitHub repository"
>
<svg viewBox="0 0 24 24" aria-hidden="true">
<path fill="currentColor" d="M12 .7a12 12 0 0 0-3.8 23.4c.6.1.8-.3.8-.6v-2.3c-3.3.7-4-1.4-4-1.4-.5-1.4-1.3-1.8-1.3-1.8-1.1-.7.1-.7.1-.7 1.2.1 1.8 1.2 1.8 1.2 1 1.8 2.8 1.3 3.5 1 .1-.8.4-1.3.8-1.6-2.6-.3-5.4-1.3-5.4-5.9 0-1.3.5-2.4 1.2-3.2-.1-.3-.5-1.5.1-3.1 0 0 1-.3 3.3 1.2a11.5 11.5 0 0 1 6 0c2.3-1.5 3.3-1.2 3.3-1.2.7 1.6.3 2.8.1 3.1.8.8 1.2 1.9 1.2 3.2 0 4.6-2.8 5.6-5.4 5.9.4.4.8 1.1.8 2.2v3.3c0 .3.2.7.8.6A12 12 0 0 0 12 .7Z" />
</svg>
<span class="nav-github-label">GitHub</span>
</a>
<div class="lang-switch" role="group" aria-label="Language">
<button type="button" data-lang="en" class="active">EN</button>
<button type="button" data-lang="zh">中文</button>
</div>
<div class="theme-switch" role="group" aria-label="Theme">
<button type="button" data-theme="system" class="active" aria-label="System theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><rect x="2" y="3" width="20" height="14" rx="2"/><line x1="8" y1="21" x2="16" y2="21"/><line x1="12" y1="17" x2="12" y2="21"/></svg></button>
<button type="button" data-theme="light" aria-label="Light theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><circle cx="12" cy="12" r="4"/><line x1="12" y1="1" x2="12" y2="4"/><line x1="12" y1="20" x2="12" y2="23"/><line x1="4.2" y1="4.2" x2="6.3" y2="6.3"/><line x1="17.7" y1="17.7" x2="19.8" y2="19.8"/><line x1="1" y1="12" x2="4" y2="12"/><line x1="20" y1="12" x2="23" y2="12"/><line x1="4.2" y1="19.8" x2="6.3" y2="17.7"/><line x1="17.7" y1="6.3" x2="19.8" y2="4.2"/></svg></button>
<button type="button" data-theme="dark" aria-label="Dark theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><path d="M21 12.8A9 9 0 1 1 11.2 3a7 7 0 0 0 9.8 9.8z"/></svg></button>
</div>
<span class="nav-acct nav-sign-in" data-account-slot aria-busy="true">
<a class="btn btn-ghost" href={`${base}/login/`}>
<span class="l-en">Sign in</span>
<span class="l-zh">登录</span>
</a>
</span>
<a class="btn btn-dark nav-install" href={`${base}/#start`}>
<span class="l-en">Install</span>
<span class="l-zh">安装</span>
</a>
<button
class="nav-menu-toggle"
type="button"
data-mobile-nav-toggle
aria-controls="site-mobile-nav"
aria-expanded="false"
aria-label="Open navigation"
title="Open navigation"
>
<svg viewBox="0 0 24 24" aria-hidden="true">
<path d="M4 6h16M4 12h16M4 18h16" />
</svg>
</button>
</div>
<div class="mobile-nav" id="site-mobile-nav" data-mobile-nav hidden>
<button class="mobile-nav-backdrop" type="button" data-mobile-nav-close aria-label="Close navigation"></button>
<aside class="mobile-nav-panel" role="dialog" aria-modal="true" aria-labelledby="site-mobile-nav-title">
<div class="mobile-nav-head">
<span id="site-mobile-nav-title"><span class="l-en">Navigation</span><span class="l-zh">导航</span></span>
<button class="mobile-nav-close" type="button" data-mobile-nav-close aria-label="Close navigation" title="Close navigation">
<svg viewBox="0 0 24 24" aria-hidden="true"><path d="m6 6 12 12M18 6 6 18" /></svg>
</button>
</div>
<nav class="mobile-nav-links" aria-label="Mobile primary navigation">
{items.map((item) => (
<a class:list={[{ here: active === item.id }]} href={item.href} aria-current={active === item.id ? 'page' : undefined}>
<span class="l-en">{item.en}</span>
<span class="l-zh">{item.zh}</span>
</a>
))}
</nav>
<div class="mobile-nav-actions">
<a class="mobile-nav-github" href={repo} target="_blank" rel="noreferrer">
<svg viewBox="0 0 24 24" aria-hidden="true"><path fill="currentColor" d="M12 .7a12 12 0 0 0-3.8 23.4c.6.1.8-.3.8-.6v-2.3c-3.3.7-4-1.4-4-1.4-.5-1.4-1.3-1.8-1.3-1.8-1.1-.7.1-.7.1-.7 1.2.1 1.8 1.2 1.8 1.2 1 1.8 2.8 1.3 3.5 1 .1-.8.4-1.3.8-1.6-2.6-.3-5.4-1.3-5.4-5.9 0-1.3.5-2.4 1.2-3.2-.1-.3-.5-1.5.1-3.1 0 0 1-.3 3.3 1.2a11.5 11.5 0 0 1 6 0c2.3-1.5 3.3-1.2 3.3-1.2.7 1.6.3 2.8.1 3.1.8.8 1.2 1.9 1.2 3.2 0 4.6-2.8 5.6-5.4 5.9.4.4.8 1.1.8 2.2v3.3c0 .3.2.7.8.6A12 12 0 0 0 12 .7Z" /></svg>
GitHub
</a>
<span class="nav-acct" data-account-slot aria-busy="true">
<a class="btn btn-ghost" href={`${base}/login/`}><span class="l-en">Sign in</span><span class="l-zh">登录</span></a>
</span>
<a class="btn btn-dark" href={`${base}/#start`}><span class="l-en">Install</span><span class="l-zh">安装</span></a>
</div>
</aside>
</div>
</header>
<script>
import '../scripts/account-nav.js';
</script>
-31
View File
@@ -1,31 +0,0 @@
---
const href = "https://www.packyapi.ai/register?aff=rIbQ";
const rightCodeHref = "https://www.rightapi.ai/register?aff=e083bf73";
---
<div class="foot-sponsor">
<span class="sp-label"><span class="l-en">Sponsor</span><span class="l-zh">赞助商</span></span>
<a class="sp-link" href={rightCodeHref} target="_blank" rel="sponsored noopener noreferrer" aria-label="Right Code">
<img src="/sponsor/rightcode.png" alt="" width="18" height="18" />
<span class="sp-name">Right Code</span>
</a>
<a class="sp-link" href={href} target="_blank" rel="sponsored noopener noreferrer" aria-label="PackyCode">
<svg viewBox="0 0 145.55 113.29" aria-hidden="true" focusable="false">
<path d="M144.68,38.49l-.06-.23c-.88-3.28-2.5-5.94-4.58-8.06.14,5.65-2.96,11.02-6.22,16.66l-.39.68c-2.26,3.91-4.66,7.94-6.57,11.1l-.86,1.38c-3.36,5.44-6.27,10.14-12.18,14.18-8.34,5.87-18.2,5.81-26.92,5.76-2.81-.02-5.48-.03-7.95.14l-.35.02c-3.22.06-5.96,1.57-8.17,4.49l-.14.18c-.86,1.06-1.7,2.26-2.58,3.54-3.43,4.92-7.69,11.04-16.17,12.42-4.37.86-9.98.84-14.94.83h-1.95c-.52,0-1.06,0-1.61,0-6.95,0-16.08-.89-21.94-6.55-.15-.15-.3-.3-.44-.45.5,4.73,2.33,8.64,5.44,11.65,5.86,5.66,14.98,6.55,21.94,6.55.55,0,1.09,0,1.61-.01h1.93c4.96.02,10.58.04,14.96-.83,8.48-1.37,12.74-7.5,16.17-12.42.88-1.27,1.72-2.48,2.58-3.54l.14-.18c2.21-2.92,4.95-4.43,8.17-4.49l.35-.02c2.47-.17,5.13-.16,7.95-.14,8.72.05,18.58.11,26.91-5.76,5.92-4.03,8.82-8.73,12.19-14.17l.86-1.39c1.91-3.15,4.3-7.18,6.57-11.09l.39-.69c3.81-6.6,7.41-12.84,5.86-19.57ZM120.9,23.02c-.28,0-.56,0-.83,0-9.68-.19-24.03-.09-35.57-.01l-2.04.02c-.93.01-1.82.02-2.67.03-8.36.08-14.4.13-23.33,3.82l-.27.12c-10.76,4.68-16.91,12.16-22.83,21.95-5.53,8.76-12.62,20.57-16.32,26.79-.41.69-.77,1.3-1.09,1.84l-.49.84c-1.49,2.53-3.23,5.49-4.21,8.95,3.98,1.9,8.52,2.65,12.71,2.91.27-.77.64-1.56,1.07-2.38.48-.94,1.05-1.9,1.63-2.89l.49-.84c.96-1.62,2.38-3.99,4.05-6.78,3.82-6.36,8.98-14.88,13.19-21.55l.07-.11c5.02-8.31,9.2-13.45,16.91-16.81l.11-.05c6.57-2.7,10.54-2.74,18.43-2.81.87-.01,1.78-.02,2.69-.03l1.99-.02c9.17-.06,20.13-.14,29.01-.07,2.26.01,4.39.04,6.32.08h.12s.11,0,.11,0c1.25-.01,2.91.11,4.61.46,1.03.22,2.08.52,3.05.93.21-.35.41-.71.62-1.06l.39-.68c1.92-3.33,3.79-6.57,4.97-9.82-4.08-1.92-8.7-2.76-12.89-2.82Z"/>
<path d="M115.07,11.81c-9.7-.19-24.07-.09-35.62-.01h-1.99c-.93.03-1.82.04-2.67.04-8.36.08-14.4.14-23.33,3.83l-.27.12c-10.76,4.67-16.91,12.16-22.83,21.95-6.13,9.71-14.19,23.21-17.41,28.63l-.5.84c-2.08,3.55-4.68,7.97-4.94,13.39v.2s0,.21,0,.21c.01.81.06,1.61.15,2.38.14.15.29.3.44.45,1.53,1.47,3.28,2.63,5.15,3.52,3.98,1.9,8.52,2.65,12.71,2.91,1.41.09,2.78.12,4.08.12.55,0,1.09-.01,1.61-.01h1.95c4.95.01,10.57.03,14.94-.83,8.48-1.38,12.74-7.5,16.17-12.42.88-1.28,1.72-2.48,2.58-3.54l.14-.18c2.21-2.92,4.95-4.44,8.17-4.49l.35-.02c2.47-.17,5.14-.16,7.95-.14,8.71.05,18.58.1,26.92-5.76,5.91-4.04,8.82-8.74,12.18-14.18l.86-1.39c1.74-2.86,3.87-6.45,5.95-10.03.21-.35.41-.71.62-1.06l.39-.68c1.92-3.33,3.79-6.57,4.97-9.82.82-2.26,1.31-4.53,1.25-6.84-5.18-5.29-13.22-7.25-19.97-7.19ZM122.56,40.37l-.39.67c-2.21,3.81-4.55,7.77-6.39,10.79l-.84,1.36c-3.01,4.87-4.83,7.81-8.48,10.29l-.1.07c-4.94,3.49-11.95,3.45-19.38,3.41-2.88-.02-5.87-.04-8.79.16-7.1.19-13.51,3.58-18.07,9.57-1.13,1.4-2.12,2.83-3.08,4.21-2.92,4.18-4.71,6.57-7.64,7.02l-.31.06c-3.09.63-8.28.61-12.45.6h-2.16c-3.85.07-7.01-.16-9.45-.69-2.24-.48-3.87-1.22-4.89-2.2-.66-.64-1.54-1.81-1.63-4.65.11-1.35.71-2.82,1.52-4.35.48-.94,1.05-1.9,1.63-2.89l.49-.84c3.17-5.33,11.19-18.75,17.24-28.33l.07-.11c5.02-8.32,9.2-13.45,16.92-16.81l.1-.05c6.57-2.7,10.54-2.74,18.43-2.82.87,0,1.78,0,2.69-.03h1.94c11.52-.09,25.86-.19,35.38,0h.23c1.25-.01,2.92.11,4.61.46,3.15.66,6.4,2.12,7.27,5.02.2,1.2-.89,3.62-2.27,6.18-.7,1.31-1.48,2.65-2.2,3.9ZM120.07,23.01c-9.68-.19-24.03-.09-35.57-.01l-2.04.02c-.93.01-1.82.02-2.67.03-8.36.08-14.4.13-23.33,3.82l-.27.12c-10.76,4.68-16.91,12.16-22.83,21.95-5.53,8.76-12.62,20.57-16.32,26.79-.78-.35-1.41-.77-1.9-1.24-.66-.64-1.54-1.81-1.63-4.65.18-2.18,1.62-4.64,3.15-7.25l.49-.83c3.17-5.32,11.18-18.73,17.24-28.33l.07-.12c5.02-8.31,9.2-13.45,16.92-16.81l.1-.04c6.57-2.7,10.54-2.74,18.43-2.82.87-.01,1.78-.01,2.69-.03h1.99c11.5-.09,25.82-.19,35.33,0h.23c3.57-.04,10.55,1.02,11.88,5.48.14.84-.35,2.27-1.13,3.93-.28,0-.56,0-.83,0Z"/>
<path d="M134.68,16.09l-.06-.23c-3.07-11.45-15.08-15.33-24.55-15.25-9.68-.19-24.03-.09-35.57-.01h-2.04c-.93.03-1.82.04-2.67.04-8.36.08-14.4.14-23.33,3.83l-.27.12c-10.76,4.67-16.91,12.16-22.83,21.95-6.14,9.73-14.2,23.22-17.41,28.62l-.49.85c-2.09,3.55-4.69,7.96-4.95,13.39v.2s0,.21,0,.21c.09,5.57,1.82,10.13,5.15,13.58.14.15.29.3.44.45,1.53,1.47,3.28,2.63,5.15,3.52,3.98,1.9,8.52,2.65,12.71,2.91,1.41.09,2.78.12,4.08.12.55,0,1.09-.01,1.61-.01h1.95c4.95.01,10.57.03,14.94-.83,8.48-1.38,12.74-7.5,16.17-12.42.88-1.28,1.72-2.48,2.58-3.54l.14-.18c2.21-2.92,4.95-4.44,8.17-4.49l.35-.02c2.47-.17,5.14-.16,7.95-.14,8.71.05,18.58.1,26.92-5.76,5.91-4.04,8.82-8.74,12.18-14.18l.86-1.39c1.74-2.86,3.87-6.45,5.95-10.03.21-.35.41-.71.62-1.06l.39-.68c1.92-3.33,3.79-6.57,4.97-9.82.82-2.26,1.31-4.53,1.25-6.84-.02-.96-.14-1.93-.36-2.91ZM119.76,25.27c-.7,1.31-1.48,2.65-2.2,3.9l-.39.67c-1.19,2.04-2.41,4.13-3.57,6.09-1.01,1.7-1.97,3.31-2.82,4.7l-.84,1.36c-3.01,4.87-4.83,7.81-8.48,10.29l-.1.07c-4.94,3.49-11.96,3.45-19.38,3.41-2.89-.02-5.87-.04-8.79.16-7.1.18-13.51,3.58-18.07,9.57-1.13,1.4-2.12,2.83-3.08,4.21-2.92,4.18-4.71,6.57-7.64,7.02l-.31.06c-3.09.63-8.27.61-12.45.6h-2.16c-3.85.07-7.01-.16-9.45-.69-1.16-.25-2.16-.57-2.99-.96-.78-.35-1.41-.77-1.9-1.24-.66-.64-1.54-1.81-1.63-4.65.18-2.18,1.62-4.64,3.15-7.25l.49-.83c3.17-5.32,11.18-18.73,17.24-28.33l.07-.12c5.02-8.31,9.2-13.45,16.92-16.81l.1-.04c6.57-2.7,10.54-2.74,18.43-2.82.87-.01,1.78-.01,2.69-.03h1.99c11.5-.09,25.82-.19,35.33,0h.23c3.57-.04,10.55,1.02,11.88,5.48.14.84-.35,2.27-1.13,3.93-.34.72-.73,1.48-1.14,2.25Z"/>
</svg>
<span class="sp-name">PackyCode</span>
</a>
</div>
<style>
.foot-sponsor {
max-width: 1180px; margin: 0 auto; padding: 14px 40px 22px;
display: flex; flex-wrap: wrap; align-items: center; gap: 8px 14px;
border-top: 1px solid var(--line);
font-size: 13px; color: var(--ink-3);
}
.sp-link { display: inline-flex; align-items: center; gap: 8px; color: var(--ink-2); text-decoration: none; font-weight: 600; transition: color 0.2s; }
.sp-link:hover { color: var(--ink); }
.sp-link img { height: 18px; width: 18px; display: block; }
.sp-link svg { height: 18px; width: auto; fill: currentColor; stroke: currentColor; stroke-miterlimit: 10; }
</style>
-25
View File
@@ -1,25 +0,0 @@
---
import ChangelogPage from './ChangelogPage.astro';
import Base from '../layouts/Base.astro';
import SiteHeader from './SiteHeader.astro';
import { releasePath, studioReleases } from '../data/releases';
import '../styles/changelog.css';
const latest = studioReleases[0];
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
---
{latest ? <ChangelogPage release={latest} releases={studioReleases} canonical={new URL(`${base}${releasePath(latest.version)}`, Astro.site).href} /> : (
<Base title="Reasonix Studio release notes" titleEn="Reasonix Studio release notes" titleZh="Reasonix Studio 更新日志" description="Reasonix Studio release notes">
<SiteHeader active="changelog" scrolled />
<main class="release-stage">
<nav class="release-product-tabs" aria-label="Products">
<a href={`${base}/changelog/cli/`}><span class="l-en">CLI · 1.x (previous)</span><span class="l-zh">CLI · 1.x(上一代)</span></a>
<a href={`${base}/changelog/`} aria-current="page">Studio · 2.x</a>
</nav>
<article class="release-paper release-studio-empty">
<h1>Reasonix Studio</h1>
<p><span class="l-en">Website notes are awaiting review. Published releases remain available on GitHub.</span><span class="l-zh">网站发布说明正在等待审核。已发布版本可在 GitHub 查看。</span></p>
<a href="https://github.com/esengine/DeepSeek-Reasonix/releases">GitHub ↗</a>
</article>
</main>
</Base>
)}
-595
View File
@@ -1,595 +0,0 @@
{
"stars": 29222,
"mergedPrs": 2816,
"contributors": 98,
"list": [
{
"login": "SivanCola",
"avatar": "/av/SivanCola.webp",
"url": "https://github.com/SivanCola",
"c": 2311
},
{
"login": "esengine",
"avatar": "/av/esengine.webp",
"url": "https://github.com/esengine",
"c": 518
},
{
"login": "ttmouse",
"avatar": "/av/ttmouse.webp",
"url": "https://github.com/ttmouse",
"c": 121
},
{
"login": "lifu963",
"avatar": "/av/lifu963.webp",
"url": "https://github.com/lifu963",
"c": 105
},
{
"login": "HUQIANTAO",
"avatar": "/av/HUQIANTAO.webp",
"url": "https://github.com/HUQIANTAO",
"c": 74
},
{
"login": "GTC2080",
"avatar": "/av/GTC2080.webp",
"url": "https://github.com/GTC2080",
"c": 61
},
{
"login": "light-front-theory",
"avatar": "/av/light-front-theory.webp",
"url": "https://github.com/light-front-theory",
"c": 56
},
{
"login": "Li-Charles-One",
"avatar": "/av/Li-Charles-One.webp",
"url": "https://github.com/Li-Charles-One",
"c": 49
},
{
"login": "eghrhegpe",
"avatar": "/av/eghrhegpe.webp",
"url": "https://github.com/eghrhegpe",
"c": 28
},
{
"login": "CVEngineer66",
"avatar": "/av/CVEngineer66.webp",
"url": "https://github.com/CVEngineer66",
"c": 16
},
{
"login": "JesonChou",
"avatar": "/av/JesonChou.webp",
"url": "https://github.com/JesonChou",
"c": 15
},
{
"login": "HaoyueQin",
"avatar": "/av/HaoyueQin.webp",
"url": "https://github.com/HaoyueQin",
"c": 14
},
{
"login": "SuMuxi66",
"avatar": "/av/SuMuxi66.webp",
"url": "https://github.com/SuMuxi66",
"c": 11
},
{
"login": "lanshi17",
"avatar": "/av/lanshi17.webp",
"url": "https://github.com/lanshi17",
"c": 11
},
{
"login": "CnsMaple",
"avatar": "/av/CnsMaple.webp",
"url": "https://github.com/CnsMaple",
"c": 9
},
{
"login": "cyq1017",
"avatar": "/av/cyq1017.webp",
"url": "https://github.com/cyq1017",
"c": 9
},
{
"login": "ipanta",
"avatar": "/av/ipanta.webp",
"url": "https://github.com/ipanta",
"c": 8
},
{
"login": "XTLine",
"avatar": "/av/XTLine.webp",
"url": "https://github.com/XTLine",
"c": 8
},
{
"login": "YoungDan-hero",
"avatar": "/av/YoungDan-hero.webp",
"url": "https://github.com/YoungDan-hero",
"c": 8
},
{
"login": "paradoxSCH",
"avatar": "/av/paradoxSCH.webp",
"url": "https://github.com/paradoxSCH",
"c": 8
},
{
"login": "wade19990814-hue",
"avatar": "/av/wade19990814-hue.webp",
"url": "https://github.com/wade19990814-hue",
"c": 7
},
{
"login": "SauronSkywalker",
"avatar": "/av/SauronSkywalker.webp",
"url": "https://github.com/SauronSkywalker",
"c": 7
},
{
"login": "yizeyi18",
"avatar": "/av/yizeyi18.webp",
"url": "https://github.com/yizeyi18",
"c": 6
},
{
"login": "ashishexee",
"avatar": "/av/ashishexee.webp",
"url": "https://github.com/ashishexee",
"c": 6
},
{
"login": "erphenheimer",
"avatar": "/av/erphenheimer.webp",
"url": "https://github.com/erphenheimer",
"c": 6
},
{
"login": "Bernardxu123",
"avatar": "/av/Bernardxu123.webp",
"url": "https://github.com/Bernardxu123",
"c": 6
},
{
"login": "lizhengwu",
"avatar": "/av/lizhengwu.webp",
"url": "https://github.com/lizhengwu",
"c": 6
},
{
"login": "qiaone",
"avatar": "/av/qiaone.webp",
"url": "https://github.com/qiaone",
"c": 5
},
{
"login": "mchenziyi",
"avatar": "/av/mchenziyi.webp",
"url": "https://github.com/mchenziyi",
"c": 4
},
{
"login": "ferstar",
"avatar": "/av/ferstar.webp",
"url": "https://github.com/ferstar",
"c": 4
},
{
"login": "zhangsanouo",
"avatar": "/av/zhangsanouo.webp",
"url": "https://github.com/zhangsanouo",
"c": 4
},
{
"login": "par73e",
"avatar": "/av/par73e.webp",
"url": "https://github.com/par73e",
"c": 4
},
{
"login": "liaoyl830",
"avatar": "/av/liaoyl830.webp",
"url": "https://github.com/liaoyl830",
"c": 3
},
{
"login": "jiaxindeyang-a11y",
"avatar": "/av/jiaxindeyang-a11y.webp",
"url": "https://github.com/jiaxindeyang-a11y",
"c": 3
},
{
"login": "nostalgia296",
"avatar": "/av/nostalgia296.webp",
"url": "https://github.com/nostalgia296",
"c": 3
},
{
"login": "Diarica",
"avatar": "/av/Diarica.webp",
"url": "https://github.com/Diarica",
"c": 3
},
{
"login": "yekern",
"avatar": "/av/yekern.webp",
"url": "https://github.com/yekern",
"c": 3
},
{
"login": "maoxin1234",
"avatar": "/av/maoxin1234.webp",
"url": "https://github.com/maoxin1234",
"c": 3
},
{
"login": "lightfront",
"avatar": "/av/lightfront.webp",
"url": "https://github.com/lightfront",
"c": 3
},
{
"login": "ikelvingo",
"avatar": "/av/ikelvingo.webp",
"url": "https://github.com/ikelvingo",
"c": 3
},
{
"login": "ffff2004",
"avatar": "/av/ffff2004.webp",
"url": "https://github.com/ffff2004",
"c": 3
},
{
"login": "kekexunxun",
"avatar": "/av/kekexunxun.webp",
"url": "https://github.com/kekexunxun",
"c": 3
},
{
"login": "Tatlatat",
"avatar": "/av/Tatlatat.webp",
"url": "https://github.com/Tatlatat",
"c": 3
},
{
"login": "PaulDing98",
"avatar": "/av/PaulDing98.webp",
"url": "https://github.com/PaulDing98",
"c": 3
},
{
"login": "AtmoOmen",
"avatar": "/av/AtmoOmen.webp",
"url": "https://github.com/AtmoOmen",
"c": 3
},
{
"login": "billycat",
"avatar": "/av/billycat.webp",
"url": "https://github.com/billycat",
"c": 2
},
{
"login": "xianyu-sheng",
"avatar": "/av/xianyu-sheng.webp",
"url": "https://github.com/xianyu-sheng",
"c": 2
},
{
"login": "heshuimu",
"avatar": "/av/heshuimu.webp",
"url": "https://github.com/heshuimu",
"c": 2
},
{
"login": "drafish",
"avatar": "/av/drafish.webp",
"url": "https://github.com/drafish",
"c": 2
},
{
"login": "yhemeo613",
"avatar": "/av/yhemeo613.webp",
"url": "https://github.com/yhemeo613",
"c": 2
},
{
"login": "wqshan-cn",
"avatar": "/av/wqshan-cn.webp",
"url": "https://github.com/wqshan-cn",
"c": 2
},
{
"login": "warvyvr",
"avatar": "/av/warvyvr.webp",
"url": "https://github.com/warvyvr",
"c": 2
},
{
"login": "Xio-Shark",
"avatar": "/av/Xio-Shark.webp",
"url": "https://github.com/Xio-Shark",
"c": 2
},
{
"login": "LVGG",
"avatar": "/av/LVGG.webp",
"url": "https://github.com/LVGG",
"c": 2
},
{
"login": "assoyuan",
"avatar": "/av/assoyuan.webp",
"url": "https://github.com/assoyuan",
"c": 2
},
{
"login": "closss",
"avatar": "/av/closss.webp",
"url": "https://github.com/closss",
"c": 2
},
{
"login": "iysun",
"avatar": "/av/iysun.webp",
"url": "https://github.com/iysun",
"c": 2
},
{
"login": "whale-fall-ouo",
"avatar": "/av/whale-fall-ouo.webp",
"url": "https://github.com/whale-fall-ouo",
"c": 2
},
{
"login": "sudoviber",
"avatar": "/av/sudoviber.webp",
"url": "https://github.com/sudoviber",
"c": 2
},
{
"login": "qiukeren",
"avatar": "/av/qiukeren.webp",
"url": "https://github.com/qiukeren",
"c": 2
},
{
"login": "nanami7777777",
"avatar": "/av/nanami7777777.webp",
"url": "https://github.com/nanami7777777",
"c": 2
},
{
"login": "alxbnct",
"avatar": "/av/alxbnct.webp",
"url": "https://github.com/alxbnct",
"c": 1
},
{
"login": "Zhuocheng-Lang",
"avatar": "/av/Zhuocheng-Lang.webp",
"url": "https://github.com/Zhuocheng-Lang",
"c": 1
},
{
"login": "dcs02280653-collab",
"avatar": "/av/dcs02280653-collab.webp",
"url": "https://github.com/dcs02280653-collab",
"c": 1
},
{
"login": "dengbushi",
"avatar": "/av/dengbushi.webp",
"url": "https://github.com/dengbushi",
"c": 1
},
{
"login": "h4rk8s",
"avatar": "/av/h4rk8s.webp",
"url": "https://github.com/h4rk8s",
"c": 1
},
{
"login": "myipanta",
"avatar": "/av/myipanta.webp",
"url": "https://github.com/myipanta",
"c": 1
},
{
"login": "jackijianxa",
"avatar": "/av/jackijianxa.webp",
"url": "https://github.com/jackijianxa",
"c": 1
},
{
"login": "jbts6",
"avatar": "/av/jbts6.webp",
"url": "https://github.com/jbts6",
"c": 1
},
{
"login": "ji-tz",
"avatar": "/av/ji-tz.webp",
"url": "https://github.com/ji-tz",
"c": 1
},
{
"login": "kabaka9527",
"avatar": "/av/kabaka9527.webp",
"url": "https://github.com/kabaka9527",
"c": 1
},
{
"login": "9710willy",
"avatar": "/av/9710willy.webp",
"url": "https://github.com/9710willy",
"c": 1
},
{
"login": "onenewcode",
"avatar": "/av/onenewcode.webp",
"url": "https://github.com/onenewcode",
"c": 1
},
{
"login": "Ninot1Quyi",
"avatar": "/av/Ninot1Quyi.webp",
"url": "https://github.com/Ninot1Quyi",
"c": 1
},
{
"login": "xiaoshuai1024",
"avatar": "/av/xiaoshuai1024.webp",
"url": "https://github.com/xiaoshuai1024",
"c": 1
},
{
"login": "rixzkiye",
"avatar": "/av/rixzkiye.webp",
"url": "https://github.com/rixzkiye",
"c": 1
},
{
"login": "taibai233",
"avatar": "/av/taibai233.webp",
"url": "https://github.com/taibai233",
"c": 1
},
{
"login": "ying-hua",
"avatar": "/av/ying-hua.webp",
"url": "https://github.com/ying-hua",
"c": 1
},
{
"login": "yuanchenglu",
"avatar": "/av/yuanchenglu.webp",
"url": "https://github.com/yuanchenglu",
"c": 1
},
{
"login": "zhuguang-ZFG",
"avatar": "/av/zhuguang-ZFG.webp",
"url": "https://github.com/zhuguang-ZFG",
"c": 1
},
{
"login": "zlwu",
"avatar": "/av/zlwu.webp",
"url": "https://github.com/zlwu",
"c": 1
},
{
"login": "xinrenH",
"avatar": "/av/xinrenH.webp",
"url": "https://github.com/xinrenH",
"c": 1
},
{
"login": "zdjmrq",
"avatar": "/av/zdjmrq.webp",
"url": "https://github.com/zdjmrq",
"c": 1
},
{
"login": "i1j",
"avatar": "/av/i1j.webp",
"url": "https://github.com/i1j",
"c": 1
},
{
"login": "Abysstsuki",
"avatar": "/av/Abysstsuki.webp",
"url": "https://github.com/Abysstsuki",
"c": 1
},
{
"login": "themarchrain",
"avatar": "/av/themarchrain.webp",
"url": "https://github.com/themarchrain",
"c": 1
},
{
"login": "wudiandy",
"avatar": "/av/wudiandy.webp",
"url": "https://github.com/wudiandy",
"c": 1
},
{
"login": "EMEEEEMMMM",
"avatar": "/av/EMEEEEMMMM.webp",
"url": "https://github.com/EMEEEEMMMM",
"c": 1
},
{
"login": "HBLADEH",
"avatar": "/av/HBLADEH.webp",
"url": "https://github.com/HBLADEH",
"c": 1
},
{
"login": "HHHEEEWWW",
"avatar": "/av/HHHEEEWWW.webp",
"url": "https://github.com/HHHEEEWWW",
"c": 1
},
{
"login": "HorusJiang",
"avatar": "/av/HorusJiang.webp",
"url": "https://github.com/HorusJiang",
"c": 1
},
{
"login": "J3y0r",
"avatar": "/av/J3y0r.webp",
"url": "https://github.com/J3y0r",
"c": 1
},
{
"login": "JimmyDaddy",
"avatar": "/av/JimmyDaddy.webp",
"url": "https://github.com/JimmyDaddy",
"c": 1
},
{
"login": "LegGasai",
"avatar": "/av/LegGasai.webp",
"url": "https://github.com/LegGasai",
"c": 1
},
{
"login": "gcoder1991",
"avatar": "/av/gcoder1991.webp",
"url": "https://github.com/gcoder1991",
"c": 1
},
{
"login": "LouF666",
"avatar": "/av/LouF666.webp",
"url": "https://github.com/LouF666",
"c": 1
},
{
"login": "MaitreyeeDeshmukh",
"avatar": "/av/MaitreyeeDeshmukh.webp",
"url": "https://github.com/MaitreyeeDeshmukh",
"c": 1
},
{
"login": "ERroooooR",
"avatar": "/av/ERroooooR.webp",
"url": "https://github.com/ERroooooR",
"c": 1
}
]
}
-48
View File
@@ -1,48 +0,0 @@
{
"stars": 20843,
"mergedPrs": 1779,
"contributors": 41,
"list": [
{ "login": "esengine", "avatar": "https://avatars.githubusercontent.com/u/18465053", "url": "https://github.com/esengine", "c": 310 },
{ "login": "SivanCola", "avatar": "https://avatars.githubusercontent.com/u/32437197", "url": "https://github.com/SivanCola", "c": 158 },
{ "login": "HUQIANTAO", "avatar": "https://avatars.githubusercontent.com/u/58421104", "url": "https://github.com/HUQIANTAO", "c": 73 },
{ "login": "GTC2080", "avatar": "https://avatars.githubusercontent.com/u/140309575", "url": "https://github.com/GTC2080", "c": 16 },
{ "login": "CVEngineer66", "avatar": "https://avatars.githubusercontent.com/u/129239603", "url": "https://github.com/CVEngineer66", "c": 10 },
{ "login": "Li-Charles-One", "avatar": "https://avatars.githubusercontent.com/u/258708209", "url": "https://github.com/Li-Charles-One", "c": 10 },
{ "login": "SuMuxi66", "avatar": "https://avatars.githubusercontent.com/u/96619914", "url": "https://github.com/SuMuxi66", "c": 9 },
{ "login": "lanshi17", "avatar": "https://avatars.githubusercontent.com/u/94416777", "url": "https://github.com/lanshi17", "c": 9 },
{ "login": "paradoxSCH", "avatar": "https://avatars.githubusercontent.com/u/64133628", "url": "https://github.com/paradoxSCH", "c": 7 },
{ "login": "wade19990814-hue", "avatar": "https://avatars.githubusercontent.com/u/280641290", "url": "https://github.com/wade19990814-hue", "c": 7 },
{ "login": "YoungDan-hero", "avatar": "https://avatars.githubusercontent.com/u/66891653", "url": "https://github.com/YoungDan-hero", "c": 6 },
{ "login": "lizhengwu", "avatar": "https://avatars.githubusercontent.com/u/38285521", "url": "https://github.com/lizhengwu", "c": 5 },
{ "login": "Bernardxu123", "avatar": "https://avatars.githubusercontent.com/u/85089406", "url": "https://github.com/Bernardxu123", "c": 5 },
{ "login": "CnsMaple", "avatar": "https://avatars.githubusercontent.com/u/92523839", "url": "https://github.com/CnsMaple", "c": 5 },
{ "login": "AtmoOmen", "avatar": "https://avatars.githubusercontent.com/u/110901588", "url": "https://github.com/AtmoOmen", "c": 3 },
{ "login": "Tatlatat", "avatar": "https://avatars.githubusercontent.com/u/269959336", "url": "https://github.com/Tatlatat", "c": 3 },
{ "login": "kekexunxun", "avatar": "https://avatars.githubusercontent.com/u/44473551", "url": "https://github.com/kekexunxun", "c": 3 },
{ "login": "jiaxindeyang-a11y", "avatar": "https://avatars.githubusercontent.com/u/278341870", "url": "https://github.com/jiaxindeyang-a11y", "c": 3 },
{ "login": "nostalgia296", "avatar": "https://avatars.githubusercontent.com/u/207565364", "url": "https://github.com/nostalgia296", "c": 2 },
{ "login": "yhemeo613", "avatar": "https://avatars.githubusercontent.com/u/138780695", "url": "https://github.com/yhemeo613", "c": 2 },
{ "login": "ttmouse", "avatar": "https://avatars.githubusercontent.com/u/8982044", "url": "https://github.com/ttmouse", "c": 2 },
{ "login": "iysun", "avatar": "https://avatars.githubusercontent.com/u/102790274", "url": "https://github.com/iysun", "c": 2 },
{ "login": "closss", "avatar": "https://avatars.githubusercontent.com/u/106432698", "url": "https://github.com/closss", "c": 2 },
{ "login": "XTLine", "avatar": "https://avatars.githubusercontent.com/u/140948646", "url": "https://github.com/XTLine", "c": 2 },
{ "login": "LVGG", "avatar": "https://avatars.githubusercontent.com/u/20256205", "url": "https://github.com/LVGG", "c": 2 },
{ "login": "xinrenH", "avatar": "https://avatars.githubusercontent.com/u/121069519", "url": "https://github.com/xinrenH", "c": 1 },
{ "login": "lightfront", "avatar": "https://avatars.githubusercontent.com/u/13162893", "url": "https://github.com/lightfront", "c": 1 },
{ "login": "lifu963", "avatar": "https://avatars.githubusercontent.com/u/56394323", "url": "https://github.com/lifu963", "c": 1 },
{ "login": "kabaka9527", "avatar": "https://avatars.githubusercontent.com/u/142149737", "url": "https://github.com/kabaka9527", "c": 1 },
{ "login": "dcs02280653-collab", "avatar": "https://avatars.githubusercontent.com/u/272150807", "url": "https://github.com/dcs02280653-collab", "c": 1 },
{ "login": "ashishexee", "avatar": "https://avatars.githubusercontent.com/u/144021866", "url": "https://github.com/ashishexee", "c": 1 },
{ "login": "alxbnct", "avatar": "https://avatars.githubusercontent.com/u/52067352", "url": "https://github.com/alxbnct", "c": 1 },
{ "login": "PorunC", "avatar": "https://avatars.githubusercontent.com/u/63705582", "url": "https://github.com/PorunC", "c": 1 },
{ "login": "ERroooooR", "avatar": "https://avatars.githubusercontent.com/u/121479279", "url": "https://github.com/ERroooooR", "c": 1 },
{ "login": "LegGasai", "avatar": "https://avatars.githubusercontent.com/u/75920107", "url": "https://github.com/LegGasai", "c": 1 },
{ "login": "JimmyDaddy", "avatar": "https://avatars.githubusercontent.com/u/16460813", "url": "https://github.com/JimmyDaddy", "c": 1 },
{ "login": "drafish", "avatar": "https://avatars.githubusercontent.com/u/18543527", "url": "https://github.com/drafish", "c": 1 },
{ "login": "HorusJiang", "avatar": "https://avatars.githubusercontent.com/u/29286555", "url": "https://github.com/HorusJiang", "c": 1 },
{ "login": "HBLADEH", "avatar": "https://avatars.githubusercontent.com/u/27012363", "url": "https://github.com/HBLADEH", "c": 1 },
{ "login": "Nahiyi", "avatar": "https://avatars.githubusercontent.com/u/163129774", "url": "https://github.com/Nahiyi", "c": 1 },
{ "login": "i1j", "avatar": "https://avatars.githubusercontent.com/u/35729767", "url": "https://github.com/i1j", "c": 1 }
]
}
-3
View File
@@ -1,3 +0,0 @@
// Set this temporarily to an exact vX.Y.Z only during a documented download
// incident. The production default follows the current Stable manifest.
export const desktopDownloadVersion = "";
File diff suppressed because it is too large. Load diff
-91
View File
@@ -1,91 +0,0 @@
import source from './releases.json';
import { readFileSync } from 'node:fs';
import { resolve } from 'node:path';
export type LocalizedText = { en: string; zh: string };
export type ReleaseTarget = 'desktop' | 'cli' | 'site' | 'service';
export type ReleaseItem = {
title: LocalizedText;
body: LocalizedText;
refs?: number[];
targets?: ReleaseTarget[];
};
export type ReleaseHighlight = ReleaseItem & {
kind: 'new' | 'improved' | 'fixed' | 'security';
};
export type ReleaseGuide = ReleaseItem & { href: string };
export type ReleaseUpgrade = ReleaseItem & { level: 'info' | 'warning' };
export type ReleaseRecord = {
version: string;
product?: 'cli' | 'studio';
sourceNotes?: { language: 'zh'; markdown: string; sha: string; path: string };
targetingVersion?: 1;
releaseId?: string;
baseVersion?: string;
date: string;
channel: 'stable' | 'prerelease';
status?: 'reviewed' | 'published';
candidateSha?: string;
previousRelease?: string;
builds?: { cli: string; desktop: string; npm: string };
title: LocalizedText;
summary: LocalizedText;
surfaces: string[];
guides: ReleaseGuide[];
highlights: ReleaseHighlight[];
changes: { new: ReleaseItem[]; improved: ReleaseItem[]; fixed: ReleaseItem[] };
upgrade: ReleaseUpgrade[];
risks: ReleaseItem[];
contributors: string[];
links: { github: string; compare: string; download: string };
};
export const releaseCatalog = source as { schemaVersion: number; releases: ReleaseRecord[] };
export const allReleases = releaseCatalog.releases;
let publishedIds = new Set<string>();
try {
const generated = JSON.parse(
readFileSync(resolve(process.cwd(), '.generated/publications.json'), 'utf8'),
) as { publications?: string[] };
publishedIds = new Set(generated.publications ?? []);
} catch {
// Before prebuild, preserve legacy entries and fail closed for reviewed
// releases that require a successful all-surface publication marker.
}
export const publishedReleases = allReleases.filter(
(release) => !release.status || release.status === 'published' || publishedIds.has(release.version),
);
// Public navigation contains official releases only. Historical prereleases
// remain addressable by their exact version URL for compatibility.
export const studioReleases = publishedReleases.filter((release) => release.product === 'studio');
export const releases = publishedReleases.filter((release) => release.product !== 'studio' && release.channel === 'stable');
export const stableReleases = releases;
export const previewReleases = publishedReleases.filter((release) => release.channel === 'prerelease');
export const latestStableRelease = stableReleases[0];
export const latestPreviewRelease = previewReleases[0];
export const latestRelease = latestStableRelease;
export function releasePath(version: string): string {
return `/changelog/v${version}/`;
}
export function releaseContentItems(release: ReleaseRecord): ReleaseItem[] {
return [
...release.highlights,
...release.changes.new,
...release.changes.improved,
...release.changes.fixed,
...release.upgrade,
...release.risks,
];
}
export function releaseTargetCount(release: ReleaseRecord, target: ReleaseTarget): number {
return releaseContentItems(release).filter((item) => item.targets?.includes(target)).length;
}
-47
View File
@@ -1,47 +0,0 @@
---
import Base from './Base.astro';
import CommunityJoin from '../components/CommunityJoin.astro';
import SponsorSlot from '../components/SponsorSlot.astro';
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
const repo = 'https://github.com/esengine/DeepSeek-Reasonix';
const { title, description, titleEn, titleZh, wide, dash } = Astro.props;
---
<Base title={title} description={description} titleEn={titleEn} titleZh={titleZh}>
<Fragment slot="head">
<meta name="robots" content="noindex" />
<link rel="preconnect" href="https://id.reasonix.io" crossorigin="anonymous" />
<link rel="preconnect" href="https://studio.reasonix.io" crossorigin="anonymous" />
<link rel="dns-prefetch" href="//id.reasonix.io" />
<link rel="dns-prefetch" href="//studio.reasonix.io" />
</Fragment>
<header class="nav auth-nav scrolled">
<div class="nav-inner">
<a class="brand" href={`${base}/`}><img src={`${base}/logo.svg`} alt="Reasonix logo" /><span>Reasonix</span></a>
<div class="lang-switch" role="group" aria-label="Language" style="margin-left:auto">
<button type="button" data-lang="en" class="active">EN</button>
<button type="button" data-lang="zh">中文</button>
</div>
</div>
</header>
<main class="auth-main">
<div class={dash ? 'auth-card wide dash' : wide ? 'auth-card wide' : 'auth-card'}>
<slot />
</div>
</main>
<footer>
<CommunityJoin />
<div class="foot-sub" style="border-top:none">
<a class="brand" href={`${base}/`}><img src={`${base}/logo.svg`} alt="Reasonix logo" /><span>Reasonix</span></a>
<nav class="foot-links">
<a href={`${base}/`}><span class="l-en">Home</span><span class="l-zh">首页</span></a>
<a href={`${base}/docs/`}><span class="l-en">Docs</span><span class="l-zh">文档</span></a>
<a href={repo}>GitHub</a>
</nav>
</div>
<SponsorSlot />
</footer>
<script>import '../scripts/auth.js';</script>
</Base>
-47
View File
@@ -1,47 +0,0 @@
---
import '../styles/global.css';
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
const { title, description, titleEn, titleZh, canonical: canonicalOverride, noindex = false } = Astro.props;
const canonical = canonicalOverride ?? new URL(Astro.url.pathname, Astro.site).href;
const ogImage = new URL(`${base}/og.png`, Astro.site).href;
---
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<title>{title}</title>
<meta name="description" content={description} />
{noindex && <meta name="robots" content="noindex, nofollow" />}
<link rel="canonical" href={canonical} />
<link rel="icon" href={`${base}/favicon.svg`} type="image/svg+xml" />
<link rel="sitemap" href={`${base}/sitemap-index.xml`} />
<meta name="theme-color" content="#ffffff" />
<script is:inline>
(function(){try{var p=localStorage.getItem("reasonix-theme")||"system";var d=p==="dark"||(p==="system"&&window.matchMedia("(prefers-color-scheme: dark)").matches);document.documentElement.dataset.theme=d?"dark":"light";var m=document.querySelector('meta[name="theme-color"]');if(m)m.content=d?"#1f232b":"#ffffff";}catch(e){}})();
</script>
<meta property="og:type" content="website" />
<meta property="og:site_name" content="Reasonix" />
<meta property="og:title" content={title} />
<meta property="og:description" content={description} />
<meta property="og:url" content={canonical} />
<meta property="og:image" content={ogImage} />
<meta property="og:image:width" content="1200" />
<meta property="og:image:height" content="630" />
<meta property="og:image:alt" content="Reasonix — an open-source coding agent for your terminal, desktop, browser and editor" />
<meta property="og:locale" content="en_US" />
<meta property="og:locale:alternate" content="zh_CN" />
<meta name="twitter:card" content="summary_large_image" />
<meta name="twitter:title" content={title} />
<meta name="twitter:description" content={description} />
<meta name="twitter:image" content={ogImage} />
<slot name="head" />
</head>
<body data-motion="rich" data-lang="en" data-title-en={titleEn ?? title} data-title-zh={titleZh ?? title}>
<slot />
<script>
import '../scripts/site.js';
import '../scripts/fx.js';
</script>
</body>
</html>
-105
View File
@@ -1,105 +0,0 @@
---
import "../styles/community.css";
import CommunityJoin from "../components/CommunityJoin.astro";
const { title, description, active } = Astro.props;
const canonical = new URL(Astro.url.pathname, Astro.site).href;
---
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<title>{title}</title>
<meta name="description" content={description} />
<link rel="canonical" href={canonical} />
<link rel="icon" href="/favicon.svg" type="image/svg+xml" />
<meta name="theme-color" content="#ffffff" />
<script is:inline>
(function(){try{var p=localStorage.getItem("reasonix-theme")||"system";var d=p==="dark"||(p==="system"&&window.matchMedia("(prefers-color-scheme: dark)").matches);document.documentElement.dataset.theme=d?"dark":"light";var m=document.querySelector('meta[name="theme-color"]');if(m)m.content=d?"#1f232b":"#ffffff";}catch(e){}})();
</script>
<meta property="og:type" content="website" />
<meta property="og:site_name" content="Reasonix Community" />
<meta property="og:title" content={title} />
<meta property="og:description" content={description} />
</head>
<body data-lang="en">
<header class="nav">
<div class="nav-inner">
<a class="brand" href="/community/" aria-label="Reasonix Community"><span class="mark" aria-hidden="true">R</span><span class="brand-name">Reasonix</span><span class="ctag"><span class="l-en">Community</span><span class="l-zh">社区</span></span></a>
<nav class="nav-links">
<a class={active === "discussions" ? "here" : ""} href="/community/"><span class="l-en">Discussions</span><span class="l-zh">讨论</span></a>
<a href="/community/?category=skills"><span class="l-en">Skills</span><span class="l-zh">技能</span></a>
<a href="/community/?category=show"><span class="l-en">Showcase</span><span class="l-zh">展示</span></a>
<a href="/docs/"><span class="l-en">Docs ↗</span><span class="l-zh">文档 ↗</span></a>
</nav>
<div class="nav-right">
<div class="lang-switch" role="group" aria-label="Language">
<button type="button" data-lang="en" class="active">EN</button>
<button type="button" data-lang="zh">中文</button>
</div>
<div class="theme-switch" role="group" aria-label="Theme">
<button type="button" data-theme="system" class="active" aria-label="System theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><rect x="2" y="3" width="20" height="14" rx="2"/><line x1="8" y1="21" x2="16" y2="21"/><line x1="12" y1="17" x2="12" y2="21"/></svg></button>
<button type="button" data-theme="light" aria-label="Light theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><circle cx="12" cy="12" r="4"/><line x1="12" y1="1" x2="12" y2="4"/><line x1="12" y1="20" x2="12" y2="23"/><line x1="4.2" y1="4.2" x2="6.3" y2="6.3"/><line x1="17.7" y1="17.7" x2="19.8" y2="19.8"/><line x1="1" y1="12" x2="4" y2="12"/><line x1="20" y1="12" x2="23" y2="12"/><line x1="4.2" y1="19.8" x2="6.3" y2="17.7"/><line x1="17.7" y1="6.3" x2="19.8" y2="4.2"/></svg></button>
<button type="button" data-theme="dark" aria-label="Dark theme"><svg width="13" height="13" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" aria-hidden="true"><path d="M21 12.8A9 9 0 1 1 11.2 3a7 7 0 0 0 9.8 9.8z"/></svg></button>
</div>
<span id="nav-account"></span>
</div>
<button
class="nav-menu-toggle"
type="button"
data-mobile-nav-toggle
aria-controls="community-mobile-nav"
aria-expanded="false"
aria-label="Open navigation"
title="Open navigation"
>
<svg viewBox="0 0 24 24" aria-hidden="true"><path d="M4 6h16M4 12h16M4 18h16" /></svg>
</button>
</div>
<div class="mobile-nav" id="community-mobile-nav" data-mobile-nav hidden>
<button class="mobile-nav-backdrop" type="button" data-mobile-nav-close aria-label="Close navigation"></button>
<aside class="mobile-nav-panel" role="dialog" aria-modal="true" aria-labelledby="community-mobile-nav-title">
<div class="mobile-nav-head">
<span id="community-mobile-nav-title"><span class="l-en">Navigation</span><span class="l-zh">导航</span></span>
<button class="mobile-nav-close" type="button" data-mobile-nav-close aria-label="Close navigation" title="Close navigation">
<svg viewBox="0 0 24 24" aria-hidden="true"><path d="m6 6 12 12M18 6 6 18" /></svg>
</button>
</div>
<nav class="mobile-nav-links" aria-label="Mobile community navigation">
<a class:list={[{ here: active === "discussions" }]} href="/community/"><span class="l-en">Discussions</span><span class="l-zh">讨论</span></a>
<a href="/community/?category=skills"><span class="l-en">Skills</span><span class="l-zh">技能</span></a>
<a href="/community/?category=show"><span class="l-en">Showcase</span><span class="l-zh">展示</span></a>
<a href="/docs/"><span class="l-en">Docs ↗</span><span class="l-zh">文档 ↗</span></a>
</nav>
<div class="mobile-nav-actions">
<a class="mobile-nav-github" href="https://github.com/esengine/DeepSeek-Reasonix" target="_blank" rel="noreferrer">
<svg viewBox="0 0 24 24" aria-hidden="true"><path fill="currentColor" d="M12 .7a12 12 0 0 0-3.8 23.4c.6.1.8-.3.8-.6v-2.3c-3.3.7-4-1.4-4-1.4-.5-1.4-1.3-1.8-1.3-1.8-1.1-.7.1-.7.1-.7 1.2.1 1.8 1.2 1.8 1.2 1 1.8 2.8 1.3 3.5 1 .1-.8.4-1.3.8-1.6-2.6-.3-5.4-1.3-5.4-5.9 0-1.3.5-2.4 1.2-3.2-.1-.3-.5-1.5.1-3.1 0 0 1-.3 3.3 1.2a11.5 11.5 0 0 1 6 0c2.3-1.5 3.3-1.2 3.3-1.2.7 1.6.3 2.8.1 3.1.8.8 1.2 1.9 1.2 3.2 0 4.6-2.8 5.6-5.4 5.9.4.4.8 1.1.8 2.2v3.3c0 .3.2.7.8.6A12 12 0 0 0 12 .7Z" /></svg>
GitHub
</a>
<span id="mobile-nav-account"></span>
<a class="btn btn-primary" href="/community/new/"><span class="l-en">New topic</span><span class="l-zh">发起话题</span></a>
</div>
</aside>
</div>
</header>
<main>
<slot />
</main>
<CommunityJoin />
<footer class="foot">
<div class="foot-inner">
<a class="brand" href="/"><span class="mark">R</span>Reasonix</a>
<span><span class="l-en">© 2026 · MIT · built to be left running.</span><span class="l-zh">© 2026 · MIT 许可 · 为常驻运行而生。</span></span>
<nav class="links">
<a href="/community/guidelines/"><span class="l-en">Guidelines</span><span class="l-zh">规范</span></a>
<a href="/docs/"><span class="l-en">Docs</span><span class="l-zh">文档</span></a>
<a href="https://github.com/esengine/DeepSeek-Reasonix">GitHub</a>
</nav>
</div>
</footer>
<script>import "../scripts/community.js";</script>
</body>
</html>
-115
View File
@@ -1,115 +0,0 @@
const TIERS = [
["New", "新成员"],
["Basic", "基础"],
["Member", "成员"],
["Regular", "常客"],
["Leader", "领袖"],
];
// [en, zh] for a forum trust level; a value outside the known range reads as unknown.
export function trustName(level) {
return Number.isInteger(level) && level >= 0 && level < TIERS.length ? TIERS[level] : null;
}
export function deviceSummary(payload) {
const list = Array.isArray(payload?.devices) ? payload.devices.filter((d) => d && !d.revokedAt) : [];
return { total: list.length, online: payload?.presenceAvailable === false ? null : list.filter((d) => d.online === true).length };
}
export function backupCount(payload) {
return Array.isArray(payload?.backups) ? payload.backups.length : null;
}
const whole = (n) => (Number.isFinite(n) && n >= 0 ? Math.floor(n) : null);
// Only well-formed numbers reach the page; anything else renders as "—".
export function forumSummary(payload) {
const m = payload?.member;
const s = payload?.stats;
if (!m || !s) return null;
return {
trust: Number.isInteger(m.trust) ? m.trust : null,
role: m.role === "admin" || m.role === "moderator" ? m.role : "member",
dailyPostCap: whole(m.dailyPostCap),
canPostLinks: m.canPostLinks === true,
silencedUntil: typeof m.silencedUntil === "string" ? m.silencedUntil : null,
topics: whole(s.topics),
posts: whole(s.posts),
likesReceived: whole(s.likesReceived),
solved: whole(s.solved),
recent: Array.isArray(payload.recent)
? payload.recent.filter((r) => Number.isInteger(r?.id) && typeof r.title === "string").slice(0, 5)
: [],
};
}
export function initials(handle) {
return String(handle || "?").replace(/[^a-zA-Z0-9]/g, "").slice(0, 2).toUpperCase() || "?";
}
// "empty" is only for an answered request whose counts are all zero; a failed or
// malformed answer is "unavailable", never a claim that the member has not taken part.
export function forumState(summary) {
if (!summary) return "unavailable";
return summary.topics === 0 && summary.posts === 0 ? "empty" : "active";
}
const LEVELS = [
["New seed", "新种"],
["Sprout", "萌芽"],
["Seedling", "幼苗"],
["Sapling", "小树"],
["Bloom", "繁花"],
["Canopy", "成荫"],
["Grove", "共林"],
];
// [en, zh] for a feedback level, null outside the known ladder.
export function levelName(level) {
return Number.isInteger(level) && level >= 0 && level < LEVELS.length ? LEVELS[level] : null;
}
const TRUST = new Set(["active", "legacy_active", "lapsed", "revoked", "none"]);
const count = (n) => (Number.isInteger(n) && n >= 0 ? n : null);
function standing(p) {
if (!p || count(p.level) === null || count(p.adoptedCount) === null || !TRUST.has(p.trustState)) return null;
const limits = p.effectiveLimits ?? {};
return {
level: p.level,
adopted: p.adoptedCount,
base: count(p.currentThreshold),
nextLevel: count(p.nextLevel),
nextThreshold: count(p.nextThreshold),
remaining: count(p.remaining),
trustState: p.trustState,
trustExpiresAt: typeof p.trustExpiresAt === "string" ? p.trustExpiresAt : null,
perHour: count(limits.reportsPerHour),
perDay: count(limits.reportsPerDay),
repliesPerHour: count(limits.repliesPerHour),
};
}
// Share of the way to the next level, or null at the top or when the thresholds do not hold together.
export function levelProgress(s) {
if (!s || s.nextThreshold === null || s.base === null || s.nextThreshold <= s.base) return null;
return Math.min(1, Math.max(0, (s.adopted - s.base) / (s.nextThreshold - s.base)));
}
// "unavailable" is a failed or malformed answer; "none" is an answered request with no linked install.
export function feedbackSummary(payload) {
if (!payload || !Array.isArray(payload.installs) || !Array.isArray(payload.items)) return { state: "unavailable" };
const installs = payload.installs.map((i) => ({ id: String(i?.id ?? ""), linkedAt: i?.linkedAt, standing: standing(i?.profile) })).filter((i) => /^[0-9a-f]{12}$/.test(i.id));
if (installs.length === 0) return { state: "none" };
const items = payload.items
.filter((it) => typeof it?.receipt === "string" && typeof it.titleSnippet === "string")
.slice(0, 5)
.map((it) => ({
receipt: it.receipt,
title: it.titleSnippet,
status: typeof it.status === "string" ? it.status : "",
issueNumber: count(it.issueNumber),
version: typeof it.resolvedVersion === "string" && /^[0-9A-Za-z][0-9A-Za-z.+-]{0,31}$/.test(it.resolvedVersion) ? it.resolvedVersion : null,
}));
return { state: "linked", headline: standing(payload.profile), installs, items };
}
-63
View File
@@ -1,63 +0,0 @@
// The contributor board's pure parts: what a name may look like on the page, and the
// rows built from the public answer. Names come from users, so every one is cleaned
// and set as text; nothing here makes markup.
export const NAME_LIMIT = 60;
// Bidirectional controls and other invisible formatting characters can make a name
// read as something else (a right-to-left override flips what follows it), so none
// reaches the page.
const INVISIBLE = /[\u0000-\u001f\u007f-\u009f­؜᠎​-‏‪-‮⁠--]/gu;
export function cleanName(raw) {
const text = String(raw ?? "").normalize("NFKC").replace(/[\t\n\r]+/g, " ").replace(INVISIBLE, "").replace(/\s+/g, " ").trim();
const chars = [...text];
return chars.length > NAME_LIMIT ? chars.slice(0, NAME_LIMIT - 1).join("") + "…" : text;
}
export function newestFirst(a, b) {
const pa = a.replace(/^v/, "").split(".").map(Number);
const pb = b.replace(/^v/, "").split(".").map(Number);
for (let i = 0; i < 3; i++) if ((pa[i] ?? 0) !== (pb[i] ?? 0)) return (pb[i] ?? 0) - (pa[i] ?? 0);
return 0;
}
export function versionsOf(entries) {
return [...new Set(entries.flatMap((e) => e.releases.map((r) => r.version)))].sort(newestFirst);
}
// One row as plain parts, whatever the document is: the caller sets each as text.
export function rowOf(entry, ranked) {
return {
rank: ranked ? String(entry.rank ?? "") : null,
name: cleanName(entry.displayName),
credits: Number.isFinite(entry.credits) ? entry.credits : 0,
chips: ranked ? [] : (entry.releases ?? []).slice(0, 3).map((r) => (r.count > 1 ? `${r.version} ×${r.count}` : r.version)),
};
}
// buildRow draws a row with the given document. It writes only through
// textContent, so a name can never become markup.
export function buildRow(entry, ranked, doc) {
const row = rowOf(entry, ranked);
const li = doc.createElement("li");
const part = (cls, text) => {
const el = doc.createElement("span");
el.className = cls;
el.textContent = text;
return el;
};
if (row.rank !== null) li.append(part("board-rank", row.rank));
li.append(part("board-name", row.name));
const credits = doc.createElement("span");
credits.className = "board-credits";
credits.append(part("l-en", `${row.credits} adopted`), part("l-zh", `${row.credits} 条被采纳`));
li.append(credits);
if (!ranked) {
const where = doc.createElement("span");
where.className = "board-where";
for (const chip of row.chips) where.append(part("board-chip", chip));
li.append(where);
}
return li;
}
-14
View File
@@ -1,14 +0,0 @@
export const QQ_GROUP = {
name: 'DeepSeek-Reasonix官方群',
number: '1093562660',
joinUrl: 'https://qm.qq.com/q/i59b0z2R8s',
qrPath: '/community/qq-group.svg',
};
export const DISCORD_URL = 'https://discord.gg/XF78rEME2D';
export const DOUYIN = {
name: '做游戏的小鱼',
id: '22703872788',
qrPath: '/community/douyin.png',
};
-27
View File
@@ -1,27 +0,0 @@
// A forum thread with source "github" mirrors a GitHub Discussion, and one with source "feedback" mirrors an in-app report's issue: its text
// is GitHub's, so the page shows where it lives instead of a reply box.
export const DISCUSSIONS_URL = "https://github.com/esengine/DeepSeek-Reasonix/discussions";
export const ISSUES_URL = "https://github.com/esengine/DeepSeek-Reasonix/issues";
export function mirrorOf(topic) {
if (!topic || (topic.source !== "github" && topic.source !== "feedback")) return null;
const feedback = topic.source === "feedback";
const base = feedback ? ISSUES_URL : DISCUSSIONS_URL;
const url = Number.isInteger(topic.ghNumber) && topic.ghNumber > 0 ? `${base}/${topic.ghNumber}` : base;
const status = ["recorded", "in_progress", "fixed"].includes(topic.ghStatus) ? topic.ghStatus : null;
const version = status === "fixed" && typeof topic.fixedIn === "string" && /^[0-9A-Za-z][0-9A-Za-z.+-]{0,31}$/.test(topic.fixedIn) ? topic.fixedIn : null;
return { url, status, version, feedback };
}
const LABELS = {
recorded: ["Recorded", "已记录"],
in_progress: ["In progress", "处理中"],
fixed: ["Fixed", "已修复"],
};
// [en, zh] for the status badge, with the shipped version when there is one.
export function statusText(mirror) {
if (!mirror?.status) return null;
const [en, zh] = LABELS[mirror.status];
return mirror.version ? [`${en} in v${mirror.version.replace(/^v/, "")}`, `${zh}于 v${mirror.version.replace(/^v/, "")}`] : [en, zh];
}
-7
View File
@@ -1,7 +0,0 @@
// The repository owner is never thanked on release pages; change the login here only.
export const repositoryOwner = "esengine";
export function withoutOwner(logins) {
const owner = repositoryOwner.toLowerCase();
return logins.filter((login) => String(login).toLowerCase() !== owner);
}
-64
View File
@@ -1,64 +0,0 @@
const REPO_ISSUES = 'https://github.com/esengine/DeepSeek-Reasonix/issues/';
const TRAILING_REFS = /(\(?)(#\d{1,9}(?:\s*,\s*#\d{1,9})*)(\)?)\s*$/;
export function issueHref(digits) {
if (!/^\d{1,9}$/.test(digits)) throw new Error('issue number must be digits only');
return `${REPO_ISSUES}${digits}`;
}
function codeSpans(text) {
const out = [];
const pattern = /`([^`\n]+)`/g;
let last = 0;
for (const match of text.matchAll(pattern)) {
if (match.index > last) out.push({ type: 'text', value: text.slice(last, match.index) });
out.push({ type: 'code', value: match[1] });
last = match.index + match[0].length;
}
if (last < text.length) out.push({ type: 'text', value: text.slice(last) });
return out;
}
export function parseInline(line) {
const trailing = line.match(TRAILING_REFS);
const hasBoundary = trailing && (trailing.index === 0 || /\s/.test(line[trailing.index - 1]) || trailing[1] === '(');
const insideCode = trailing && (line.slice(0, trailing.index).split('`').length - 1) % 2 === 1;
if (!trailing || !hasBoundary || insideCode || (trailing[1] === '(') !== (trailing[3] === ')')) return codeSpans(line);
const body = line.slice(0, trailing.index);
const tokens = codeSpans(body);
tokens.push({ type: 'text', value: trailing[1] });
trailing[2].split(/(\s*,\s*)/).forEach((part) => {
const ref = part.match(/^#(\d+)$/);
tokens.push(ref ? { type: 'ref', number: ref[1], value: part } : { type: 'text', value: part });
});
if (trailing[3]) tokens.push({ type: 'text', value: trailing[3] });
return tokens;
}
export function parseStudioNotes(markdown) {
const blocks = [];
let list = null;
let summary = '';
for (const raw of String(markdown ?? '').split(/\r?\n/)) {
const line = raw.trimEnd();
if (!line.trim()) { list = null; continue; }
const heading = line.match(/^##\s+(\S.*)$/);
const bullet = line.match(/^[-*]\s+(\S.*)$/);
if (heading) {
list = null;
blocks.push({ type: 'heading', inline: parseInline(heading[1].trim()) });
} else if (bullet) {
if (!list) { list = { type: 'list', items: [] }; blocks.push(list); }
list.items.push(parseInline(bullet[1]));
} else {
list = null;
if (!summary && blocks.length === 0) summary = line.trim();
blocks.push({ type: 'paragraph', inline: parseInline(line.trim()) });
}
}
return { summary, blocks };
}
export function plainText(tokens) {
return tokens.map((t) => t.value).join('');
}
-44
View File
@@ -1,44 +0,0 @@
---
import Base from '../layouts/Base.astro';
import CommunityJoin from '../components/CommunityJoin.astro';
import SponsorSlot from '../components/SponsorSlot.astro';
import SiteHeader from '../components/SiteHeader.astro';
const base = import.meta.env.BASE_URL.replace(/\/$/, '');
---
<Base
title="Page not found — Reasonix"
titleEn="Page not found — Reasonix"
titleZh="页面不存在 — Reasonix"
description="The page you are looking for does not exist.">
<Fragment slot="head"><meta name="robots" content="noindex" /></Fragment>
<script is:inline>
// Preserve the documented /u/<handle> shape on static hosting by moving it
// to the client-rendered public profile page.
try {
const match = location.pathname.match(/^\/u\/([^/]+)\/?$/);
if (match) location.replace(`/u/?handle=${encodeURIComponent(decodeURIComponent(match[1]))}`);
} catch {}
</script>
<SiteHeader scrolled />
<main class="hero" style="padding-bottom:150px">
<div class="wrap">
<div class="eyebrow">404</div>
<h1><span class="l-en">This page went <span class="grad">cold.</span></span><span class="l-zh">这一页<span class="grad">冷掉了</span>。</span></h1>
<p class="sub"><span class="l-en">The page you're looking for doesn't exist — but the session is still warm.</span><span class="l-zh">你找的页面不存在——但会话还热着。</span></p>
<div class="cold-blocks" aria-hidden="true"><i></i><i></i><i></i><i></i><i></i><i></i><i></i><i class="new"></i></div>
<div class="hero-cta">
<a class="btn btn-dark" href={`${base}/`}><span class="l-en">Back to home</span><span class="l-zh">回到首页</span></a>
<a class="btn btn-ghost" href={`${base}/docs/`}><span class="l-en">Read the docs</span><span class="l-zh">查看文档</span></a>
</div>
</div>
</main>
<footer>
<CommunityJoin />
<SponsorSlot />
</footer>
</Base>
-125
View File
@@ -1,125 +0,0 @@
---
import Account from '../layouts/Account.astro';
import PasswordInput from '../components/PasswordInput.astro';
---
<Account
wide
dash
title="Your account — Reasonix"
titleEn="Your account — Reasonix"
titleZh="我的账号 — Reasonix"
description="Manage your Reasonix account.">
<div id="account-gate" class="auth-head">
<p><span class="l-en">Loading your account…</span><span class="l-zh">正在加载账号…</span></p>
</div>
<div id="account-view" hidden>
<div class="acct-id">
<span id="acct-avatar" class="acct-avatar" aria-hidden="true"></span>
<div class="acct-who">
<div id="acct-name" class="acct-name-big"></div>
<div id="acct-handle" class="acct-handle"></div>
<div id="acct-email" class="acct-email"></div>
<div class="acct-chips">
<span id="acct-role" class="acct-role"></span>
<span id="acct-verified" class="acct-chip"></span>
<span id="acct-joined" class="acct-chip"></span>
</div>
</div>
<a id="acct-profile-link" class="btn btn-ghost sm" href="/u/"><span class="l-en">Public profile</span><span class="l-zh">公开主页</span></a>
</div>
<div id="acct-overview" class="acct-grid" role="group" aria-label="Overview">
<article class="acct-card" id="card-forum">
<h3><span class="l-en">Community</span><span class="l-zh">社区</span></h3>
<div class="acct-level"><span id="forum-level" class="acct-lv">—</span><span id="forum-level-note" class="acct-note"></span></div>
<dl class="acct-stats">
<div><dt><span class="l-en">Topics</span><span class="l-zh">话题</span></dt><dd id="st-topics">—</dd></div>
<div><dt><span class="l-en">Replies</span><span class="l-zh">回复</span></dt><dd id="st-posts">—</dd></div>
<div><dt><span class="l-en">Likes</span><span class="l-zh">获赞</span></dt><dd id="st-likes">—</dd></div>
<div><dt><span class="l-en">Solved</span><span class="l-zh">已解决</span></dt><dd id="st-solved">—</dd></div>
</dl>
<p id="forum-perms" class="acct-note"></p>
<ul id="forum-recent" class="acct-recent"></ul>
<a class="acct-more" href="/community/"><span class="l-en">Open the forum →</span><span class="l-zh">进入论坛 →</span></a>
</article>
<article class="acct-card" id="card-feedback">
<h3><span class="l-en">Feedback level</span><span class="l-zh">反馈等级</span></h3>
<p class="acct-big" id="fb-level">—</p>
<div id="fb-track" class="acct-track" hidden><i id="fb-fill"></i></div>
<p class="acct-note" id="fb-note"></p>
<p class="acct-note" id="fb-limits"></p>
<ul id="fb-installs" class="acct-recent"></ul>
<ul id="fb-items" class="acct-recent"></ul>
</article>
<article class="acct-card" id="card-devices">
<h3><span class="l-en">Devices</span><span class="l-zh">设备</span></h3>
<p class="acct-big"><span id="dev-total">—</span> <span class="acct-unit"><span class="l-en">registered</span><span class="l-zh">台已注册</span></span></p>
<p class="acct-note" id="dev-online"></p>
<a class="acct-more" href="/remote/"><span class="l-en">Open Web Studio →</span><span class="l-zh">进入网页版 Studio →</span></a>
</article>
<article class="acct-card" id="card-backups">
<h3><span class="l-en">Config backups</span><span class="l-zh">配置备份</span></h3>
<p class="acct-big"><span id="bk-total">—</span> <span class="acct-unit"><span class="l-en">saved</span><span class="l-zh">份</span></span></p>
<p class="acct-note"><span class="l-en">Back up and restore your Studio settings from Studio.</span><span class="l-zh">在 Studio 里备份和恢复你的设置。</span></p>
</article>
</div>
<div id="verification-wrap" hidden>
<h2 class="acct-h2"><span class="l-en">Email verification</span><span class="l-zh">邮箱验证</span></h2>
<div id="verification-msg" class="auth-msg" hidden></div>
<p class="hint"><span class="l-en">Your email is not confirmed. Some community actions remain locked.</span><span class="l-zh">你的邮箱尚未验证,部分社区操作仍不可用。</span></p>
<button id="resend-verification-btn" type="button" class="btn btn-ghost"><span class="l-en">Resend verification email</span><span class="l-zh">重新发送验证邮件</span></button>
</div>
<h2 class="acct-h2"><span class="l-en">Profile</span><span class="l-zh">资料</span></h2>
<div id="profile-msg" class="auth-msg" hidden></div>
<form id="profile-form" class="auth-form" novalidate>
<div class="field">
<label for="f-displayName"><span class="l-en">Display name</span><span class="l-zh">显示名</span></label>
<input id="f-displayName" type="text" maxlength="80" />
</div>
<div class="field">
<label for="f-handle"><span class="l-en">Handle</span><span class="l-zh">用户名</span></label>
<input id="f-handle" type="text" minlength="3" maxlength="30" />
<span class="hint"><span class="l-en">Your public profile is linked above.</span><span class="l-zh">你的公开主页链接显示在上方。</span></span>
</div>
<div class="field">
<label for="f-bio"><span class="l-en">Bio</span><span class="l-zh">简介</span></label>
<textarea id="f-bio" rows="3" maxlength="500"></textarea>
</div>
<div class="field">
<label for="f-avatarUrl"><span class="l-en">Avatar URL</span><span class="l-zh">头像链接</span></label>
<input id="f-avatarUrl" type="url" maxlength="500" />
</div>
<button type="submit" class="btn btn-dark"><span class="l-en">Save profile</span><span class="l-zh">保存资料</span></button>
</form>
<h2 class="acct-h2"><span class="l-en">Password</span><span class="l-zh">密码</span></h2>
<div id="password-msg" class="auth-msg" hidden></div>
<form id="password-form" class="auth-form" novalidate>
<div class="field">
<label for="currentPassword"><span class="l-en">Current password</span><span class="l-zh">当前密码</span></label>
<PasswordInput id="currentPassword" autocomplete="current-password" required />
</div>
<div class="field">
<label for="newPassword"><span class="l-en">New password</span><span class="l-zh">新密码</span></label>
<PasswordInput id="newPassword" autocomplete="new-password" minlength={8} required />
</div>
<button type="submit" class="btn btn-ghost"><span class="l-en">Change password</span><span class="l-zh">修改密码</span></button>
</form>
<h2 class="acct-h2"><span class="l-en">Web Studio</span><span class="l-zh">网页版 Studio</span></h2>
<p class="hint"><span class="l-en">Use the full Studio interface from this browser and control a computer signed in to the same account.</span><span class="l-zh">在浏览器中使用完整的 Studio 界面,并控制已登录同一账号的电脑。</span></p>
<a class="btn btn-ghost acct-remote" href="/remote/"><span class="l-en">Enter Web Studio</span><span class="l-zh">进入网页版 Studio</span></a>
<div class="acct-foot">
<button id="logout-btn" type="button" class="btn btn-ghost"><span class="l-en">Sign out</span><span class="l-zh">退出登录</span></button>
<button id="delete-btn" type="button" class="acct-danger"><span class="l-en">Delete account</span><span class="l-zh">注销账号</span></button>
</div>
</div>
<script>import "../scripts/account-overview.js";</script>
</Account>
-18
View File
@@ -1,18 +0,0 @@
---
import ChangelogPage from '../../components/ChangelogPage.astro';
import { allReleases, publishedReleases, releases, studioReleases } from '../../data/releases';
export function getStaticPaths() {
const publishedVersions = new Set(publishedReleases.map((release) => release.version));
return allReleases.map((release) => ({
params: { version: `v${release.version}` },
props: { release, published: publishedVersions.has(release.version) },
}));
}
const { release, published } = Astro.props;
if (!published) {
return Astro.redirect(release.product === 'studio' ? '/changelog/' : '/changelog/cli/');
}
---
<ChangelogPage release={release} releases={release.product === 'studio' ? studioReleases : releases} />
-10
View File
@@ -1,10 +0,0 @@
---
import ChangelogPage from '../../components/ChangelogPage.astro';
import { latestStableRelease, releases, releasePath } from '../../data/releases';
/* /changelog/cli/ renders the latest 1.x release but canonicalizes to its version URL
to avoid duplicate content with /changelog/vX.Y.Z/. */
const canonical = new URL(releasePath(latestStableRelease.version), Astro.site).href;
---
<ChangelogPage release={latestStableRelease} releases={releases} canonical={canonical} />
-5
View File
@@ -1,5 +0,0 @@
---
import StudioChangelog from '../../components/StudioChangelog.astro';
---
<StudioChangelog />
-3
View File
@@ -1,3 +0,0 @@
---
return Astro.redirect('/changelog/cli/', 301);
---
-3
View File
@@ -1,3 +0,0 @@
---
return Astro.redirect('/changelog/cli/', 301);
---
-5
View File
@@ -1,5 +0,0 @@
---
import StudioChangelog from '../../components/StudioChangelog.astro';
---
<StudioChangelog />
-53
View File
@@ -1,53 +0,0 @@
---
import Community from "../../layouts/Community.astro";
---
<Community title="Contributors · Reasonix Community" description="The people whose suggestions shipped in Reasonix, by release." active="board">
<div class="wrap board">
<header class="board-head">
<h1><span class="l-en">Contributors</span><span class="l-zh">贡献榜</span></h1>
<p class="board-lead">
<span class="l-en">People whose feedback was adopted and shipped in a release. A release has a ranking; all releases together are listed by name, not ranked. Only people who chose to appear are here.</span>
<span class="l-zh">反馈被采纳并发布的人。每个版本有名次;全部版本只按名字排序,不比高低。只有自己选择加入的人才会出现。</span>
</p>
<label class="board-pick">
<span class="l-en">Release</span><span class="l-zh">版本</span>
<select id="board-release"><option value="" data-l-en="All releases" data-l-zh="全部版本">All releases</option></select>
</label>
</header>
<ol id="board-list" class="board-list" aria-live="polite"></ol>
<p id="board-empty" class="board-note" hidden>
<span class="l-en">Nobody is listed for this release yet.</span><span class="l-zh">这个版本还没有人上榜。</span>
</p>
<p id="board-off" class="board-note" hidden>
<span class="l-en">The contributor board is not open yet.</span><span class="l-zh">贡献榜还没有开放。</span>
</p>
<p id="board-error" class="board-note" hidden>
<span class="l-en">The board could not be loaded. Try again in a moment.</span><span class="l-zh">榜单暂时读不出来,稍后再试。</span>
</p>
<p class="board-note">
<span class="l-en">A ranking depends on what the maintainers chose to ship: a good report that was declined earns nothing. To appear, link your install to your account and turn the board on in Studio's feedback panel; you can leave at any time.</span>
<span class="l-zh">名次取决于维护者选择发布的内容:被婉拒的好反馈不计入。想上榜,在 Studio 的反馈面板里把这台电脑关联到账号并打开贡献榜;随时可以退出。</span>
</p>
</div>
<script>import "../../scripts/board.js";</script>
</Community>
<style is:global>
.board { max-width: 760px; margin: 0 auto; padding: 32px 16px 56px; }
.board-head { display: grid; gap: 10px; margin-bottom: 18px; }
.board-head h1 { margin: 0; font-size: 28px; letter-spacing: -0.01em; }
.board-lead { margin: 0; color: var(--ink-3); line-height: 1.6; }
.board-pick { display: inline-flex; align-items: center; gap: 8px; color: var(--ink-3); font-size: 14px; }
.board-pick select { min-width: 160px; padding: 5px 8px; border: 1px solid var(--line); border-radius: 6px; background: var(--bg); color: inherit; font: inherit; }
.board-list { list-style: none; margin: 0; padding: 0; border: 1px solid var(--line); border-radius: 10px; overflow: hidden; }
.board-list li { display: flex; align-items: center; gap: 12px; padding: 11px 16px; border-top: 1px solid var(--line); }
.board-list li:first-child { border-top: 0; }
.board-rank { flex: none; width: 28px; text-align: right; font: 600 14px ui-monospace, "JetBrains Mono Variable", monospace; color: var(--ink-3); }
.board-list[data-ranked] li:nth-child(-n+3) .board-rank { color: var(--accent); }
.board-name { flex: 1 1 auto; min-width: 0; overflow: hidden; text-overflow: ellipsis; white-space: nowrap; font-weight: 600; }
.board-credits { flex: none; color: var(--ink-3); font-size: 14px; }
.board-where { display: flex; flex-wrap: wrap; gap: 4px; justify-content: flex-end; }
.board-chip { padding: 1px 8px; border: 1px solid var(--line); border-radius: 999px; font-size: 12px; white-space: nowrap; }
.board-note { margin: 14px 2px 0; color: var(--ink-3); font-size: 14px; line-height: 1.6; }
@media (max-width: 560px) { .board-where { display: none; } .board-list li { padding: 10px 12px; } }
</style>
-14
View File
@@ -1,14 +0,0 @@
---
import Community from "../../layouts/Community.astro";
---
<Community title="Guidelines — Reasonix Community" description="How the Reasonix community forum works.">
<div class="wrap" style="padding:36px 32px 80px;max-width:760px">
<div class="crumb"><a href="/community/"><span class="l-en">Community</span><span class="l-zh">社区</span></a><span class="sep">/</span><span><span class="l-en">Guidelines</span><span class="l-zh">规范</span></span></div>
<h1 style="font-size:32px;font-weight:600;letter-spacing:-0.02em"><span class="l-en">Community guidelines</span><span class="l-zh">社区规范</span></h1>
<p style="margin:14px 0 28px;color:var(--ink-2);font-size:16px;line-height:1.7"><span class="l-en">A small forum works when everyone keeps it useful and kind. A few things worth knowing.</span><span class="l-zh">一个小论坛,靠大家保持有用与友善才能运转。几点值得先了解。</span></p>
<div class="side-card" style="margin-bottom:16px"><h4><span class="l-en">Be kind &amp; on-topic</span><span class="l-zh">友善、切题</span></h4><p style="color:var(--ink-2);line-height:1.7"><span class="l-en">Assume good faith, search before asking, and keep threads focused. Format code in fenced <code>```</code> blocks.</span><span class="l-zh">与人为善、提问前先搜索、保持话题聚焦。代码请放进 <code>```</code> 围栏块。</span></p></div>
<div class="side-card" style="margin-bottom:16px"><h4><span class="l-en">Trust levels</span><span class="l-zh">信任等级</span></h4><p style="color:var(--ink-2);line-height:1.7"><span class="l-en">Everyone signs in with their Reasonix account. New accounts start limited — no links, a small daily post cap — and unlock more as they read and contribute. It keeps the forum spam-free without getting in real members' way.</span><span class="l-zh">所有人用 Reasonix 账号登录。新账号有限制——不能发链接、每日发帖上限较低——随着阅读与贡献逐步解锁。既挡住广告,又不妨碍真实成员。</span></p></div>
<div class="side-card"><h4><span class="l-en">Moderation</span><span class="l-zh">审核</span></h4><p style="color:var(--ink-2);line-height:1.7"><span class="l-en">Flag anything off — a few flags auto-hide a post for review. Moderators can restrict accounts that abuse the forum. All moderator actions are logged.</span><span class="l-zh">发现不妥就举报——几次举报会自动隐藏帖子待审。版主可限制滥用论坛的账号。所有版主操作都有记录。</span></p></div>
</div>
</Community>
Loaded 100 of 349 files, more files were not shown because too many files have changed in this diff. Show more