Skip to main content
Search

# Doc2Harness

1 related articles

Subscribe to updates
  1. arXiv

    Coding agents' harnesses get their own exam: Doc2Harness puts GPT-6 Astra on top at 53.05%, yet even the strongest model fails nearly half

    A coding agent's performance depends not only on the model but on the harness around it, the software layer that manages tool calls, context, permissions and result checking. Doc2Harness turns harness engineering itself into a scorable task: the model under test, working inside a fixed builder harness, writes a complete harness from a development document and an interface-only skeleton, and a scripted mock model then drives it case by case, judged through model requests, files on disk, process exit codes and command output. Across 19 frontier models with three builds each on 328 test cases, GPT-6 Astra has the highest pass rate at 53.05% and the weakest, Hy3, reaches 27.44%.

You’re all caught up