Agent harnesses can keep improving after a model swap: Self-Improvement Memory scores higher in 9 of 10 paired coding continuations
Automatic optimization of agent harnesses has usually been confined to one policy model and one benchmark, so when the model or data distribution changes the optimizer inherits an evolved harness but not the reasons behind its edits or how they performed. Self-Improvement Memory (SIM) groups each harness edit by the recurring harness problem it addresses and hands the proposer and selector the rationale, predicted and observed outcomes, and evaluation context, appending new records during target optimization. In ten paired continuations from independent source runs on coding, moving from Terminal-Bench 2.1 to Terminal-Bench 4, the SIM continuation finished higher in 9 of 10 pairs, averaging 2.36 points above harness-only continuation.