Files
Jobs_Applier_AI_Agent/tsconfig.json
feder-cr c0005a91e3 bench: agent benchmarks on real Dots, through Harbor, and a suite of 25 tasks of our own
Harbor (the harness of Terminal-Bench) runs each task in a new Dot: dots_harbor/ is its environment (the Dot
is created through the API, the task's Dockerfile is replayed as dot, with apt through dot-install, and the
task's root paths are moved under /home/dot/bench) and its agent (the instruction goes to the Dot as a task).
Every call goes through bridge.ts, on the end-to-end run's outside driver. Harbor's registry datasets run
the same way.

tasks/, written by author.py from fixed seeds: shell, files, coding, data analysis, the computer's
settings, questions with one answer, two long tasks, and what a Dot is for (its own automation, a careful
cleanup, a request it must refuse). In Dots: the oracle scores 25/25 and doing nothing 0/25; the Dot with
z-ai/glm-5.3-flash scored 23/25 in 9 minutes, 4 at a time (one miss was the grader's rounding, now fixed).
2026-10-08 14:24:39 +02:00

21 lines
511 B
JSON

{
"extends": "./tsconfig.base.json",
"compilerOptions": {
"allowImportingTsExtensions": true
},
"include": [
"*.ts",
"apps/*/src/**/*.ts",
"apps/*/test/**/*.ts",
"packages/*/src/**/*.ts",
"packages/*/test/**/*.ts",
"packages/*/scripts/**/*.ts",
"guest/image-builder/src/**/*.ts",
"guest/image-builder/test/**/*.ts",
"tests/repo/**/*.ts",
"tests/e2e/**/*.ts",
"tests/bench/**/*.ts"
],
"exclude": ["node_modules", "apps/web", "invisible_engine_dots"]
}