Skip to main content
Search

Lijuan Li

1 related articles

Subscribe to updates
  1. arXiv

    Natural-language agent skills can be repaired like programs: Synapse tops six benchmark settings, beating the strongest baseline by up to 4.54 points

    For natural-language skill documents used by large language model agents, Synapse compiles a skill into a source-linked partial program view and then generates and validates patches through fault localization, dependence analysis and regression test selection. Across two single-turn question-answering benchmarks, DocVQA and LiveMath, and three execution models, it reaches the highest held-out success rate in all six settings, 1.60 to 4.54 percentage points above the strongest baseline in each. An ablation that replaces the intermediate-representation repair and its screening with constrained text editing lowers success rates in all four evaluated settings.

You’re all caught up