BLIP-Live makes when-to-speak part of the intelligence: on 326 ego-centric videos it cuts unnecessary responses by more than half versus state-of-the-art models
Salesforce AI Research introduces BLIP-Live, a video agent that treats when to speak as part of the intelligence itself rather than only recognizing what is happening on screen. Earlier video agents combined live camera and voice interaction with product-grounded knowledge to guide complex procedures, but when a visual assistant should speak remained a complementary research question. BLIP-Live trains on large-scale data containing both useful response moments and periods when the agent should stay quiet, and uses Agent Memory to reduce repetition. Across 326 ego-centric videos, it reduced unnecessary responses of state-of-the-art models by over 50%, under an evaluation that charges for repeated and out-of-window messages and gives no credit for silence.