Skip to main content
Search

# Metrics-in-the-Loop

1 related articles

Subscribe to updates
  1. arXiv

    Coding agents get a complexity receipt mid-run: erosion falls by up to 24.6 points, held-out correctness holds

    Coding agents that write code autonomously over long runs are guided mainly by whether tests pass, so complexity accumulates as they extend their own work. MITL injects a short message after each code-changing turn, naming changed functions whose cyclomatic complexity exceeds a limit and changed lines the agent's own tests skip, giving it a chance to refactor or add tests first. Across three long-horizon benchmarks and four models, complexity feedback significantly lowered erosion, with a pooled reduction of 7.8 to 24.6 percentage points of starting erosion, while every per-model held-out correctness interval included zero.

You’re all caught up