Zero-shot detection drops propose-then-match: FOMO goes single-stage end-to-end, scoring 54.2 mAP at 0.23 s per image on BOP
Zero-shot model-based object detection has generally followed a propose-then-match pipeline, where target-agnostic proposals are generated and then matched to template features in loosely coupled stages, leaving them prone to fragmentation in clutter and mismatches under occlusion. FOMO injects CAD template information early in the detection pipeline, using learnable latent tokens that alternate bidirectional attention between templates and the query image before decoding boxes and confidence directly. On BOP-Classic-Core, FOMO reaches 54.2 mean AP at 0.23 s per image, 3.8 percentage points below the top method while running faster.