Robots stop imitating their own old moves: SeRA relabels autonomous rollouts with later policies, lifting real tomato-picking success from 40% to 80%
In interactive imitation learning, human corrections are sparse while autonomous robot rollouts yield abundant experience without action labels. SeRA has later policy checkpoints relabel that experience, filters relabels by agreement across checkpoints, and builds action sets around accepted relabels instead of imitating them exactly; across five simulated manipulation tasks in online and offline settings it beats SDP and baselines that imitate historical robot actions or exact relabels, and on a real tomato-picking task it reaches 80% success versus 40% for SDP under the same human feedback and training budget.