Skip to main content
Search

Jiaxin Pei

1 related articles

Subscribe to updates
  1. arXiv

    Why coding agents burn money: repeated runs of the same task can differ 30-fold in token use

    On SWE-bench Verified, eight frontier models ran 500 real GitHub issues through the OpenHands agent framework, four independent runs per issue. Agentic coding consumed roughly 3,500 times the tokens of single-turn code reasoning and 1,200 times those of multi-turn code chat, with cost driven mainly by input tokens fed back repeatedly rather than by output tokens. Token use varied widely across runs of the same task, the most expensive run costing about twice the cheapest, and higher token spend did not correspond to higher accuracy.

You’re all caught up