Skip to main content
Search

# Grounding gap

1 related articles

Subscribe to updates
  1. arXiv

    An EDA scripting agent stops guessing: reading back full execution state lifts Pass@1 from 19.7% to 76.5% across 449 tasks

    For three EDA scripting interfaces, PyAether, SKILL and Tcl, an execution-grounded coding agent closes a generate-execute-read-back loop and reaches 76.5% pooled Pass@1 on the 449-task EDA-Scripting-Bench, against 19.7% for a pure LLM. With the model fixed, the observation axis spans 56.8 percentage points; with the harness fixed, the backbone axis spans 23.3 points. The authors frame this as a grounding gap: scripting correctness is bounded by how faithfully the agent observes the live design state, which model scale alone cannot supply.

You’re all caught up