mirror of
https://github.com/Twigpine/zero.git
synced 2026-11-10 05:01:28 -10:00
KRATOS
47c3cc8937
* stage 13: launch readiness (first-run + benchmark) First-run, model-agnostic-first: - provideronboarding: detect local OpenAI-compatible runtimes (Ollama/LM Studio) on their default ports and offer them with no API key required - provideronboarding: ClassifySetupProbe maps a live connectivity probe to a specific, fixable error class (bad key, wrong base URL, model not found, rate limit, config) instead of a stack trace; never panics - zero setup --verify: probe the provider after saving and report the fixable error on failure; print a concrete 'try this' headless example on success zero doctor hardening: - new sandbox.backend check (bubblewrap/sandbox-exec) with a platform-specific install remedy; warn (not fail) on policy-only fallback - new lsp.servers check listing missing language servers with per-binary install remedies; injectable GOOS/LookupExecutable for deterministic tests Self-correct surface + benchmark: - zero exec --self-correct wires the post-edit verify-and-correct loop via the project verifier; nil corrector when off keeps the agent loop byte-identical - perfbench task harness: reproducible Terminal-Bench-style runner over headless zero exec + stream-json; records model + commit + self-correct flag + date - zero-perf-bench tasks subcommand (with --dry-run) and a sample task set - docs/BENCHMARK.md: the number, the exact command, the model, and the with/without-self-correct methodology * stage 13: address review (verify-state, fixture paths, run_end exit, 404 classification) * stage 13: verifier inherits process environment (PATH/HOME/toolchain)
21 lines
622 B
JSON
21 lines
622 B
JSON
{
|
|
"id": "terminal-bench-sample",
|
|
"name": "Terminal-Bench (sample)",
|
|
"tasks": [
|
|
{
|
|
"id": "hello-fix",
|
|
"name": "make the failing test pass",
|
|
"prompt": "The test in ./hello fails. Fix the implementation so `go test ./...` passes.",
|
|
"workspaceFixture": "./hello",
|
|
"verificationCommand": ["go", "test", "./..."]
|
|
},
|
|
{
|
|
"id": "add-json-flag",
|
|
"name": "add a --json flag",
|
|
"prompt": "Add a --json flag to the CLI that prints the result as JSON, and a test for it.",
|
|
"workspaceFixture": "./cli",
|
|
"verificationCommand": ["go", "test", "./..."]
|
|
}
|
|
]
|
|
}
|