Skip to main content
Search

# AuXSpec-Test

1 related articles

Subscribe to updates
  1. arXiv

    AuXSpec turns Lean spec generation into an executable score: its 27B model lifts pass@4 from 14.3% to 84.3% on a 300-problem test set

    AuXSpec splits a Lean program specification into a declarative postcondition and an executable postcondition, tied by a postcondition equivalence theorem that guarantees the two agree on valid inputs, so test cases can be executed directly to score a generated specification instead of proving each case separately. Using that execution feedback as a reinforcement-learning reward, Qwen3.5-9B and Qwen3.8-27B raise specification-generation pass@4 on the 300-problem AuXSpec-Test from 0.7% to 82.7% and from 14.3% to 84.3%, and the 27B model surpasses every frontier model compared on that test set.

You’re all caught up