Train with a centralized safety filter, deploy without it: a three-agent policy scales zero-shot to twenty agents at constant per-agent cost
Multi-agent reinforcement learning can stay collision-free in training with a centralized control-barrier-function filter, but that filter solves a program whose constraint count grows quadratically with team size and cannot be kept at deployment. This approach extracts the policy from executed safe actions with implicit Q-learning, then distills the training filter into the policy at synthetic near-collision states so the filter-free policy still respects the constraints. Local-observation policies had no collisions in test episodes on their training settings, a three-agent policy transferred zero-shot to twenty agents at constant per-agent computation, and stayed collision-free up to eight agents.