mirror of
https://github.com/Heretek-AI/harness-benchmark.git
synced 2026-10-12 02:03:46 +00:00
- benchmarks/harbor_adapter.py: HarborBenchmark loads tasks from directories containing instruction.md + test.sh + optional Dockerfile/verify_files.json - benchmarks/__init__.py: register 'harbor' in resolve_benchmark with configurable dataset_path (defaults to tasks/) - tasks/: 3 sample Harbor tasks (add-numbers, create-file, sort-list) with instruction, test script, and file-state assertions - tests/test_harbor.py: 11 tests covering parsing, discovery, grading, file-state checks, and edge cases (147 total tests now pass)