Skip to main content
Search

# Proactive video assistance

1 related articles

Subscribe to updates
  1. BLIP-Live makes when-to-speak part of the intelligence: on 326 ego-centric videos it cuts unnecessary responses by more than half versus state-of-the-art models

    Salesforce AI Research introduces BLIP-Live, a video agent that treats when to speak as part of the intelligence itself rather than only recognizing what is happening on screen. Earlier video agents combined live camera and voice interaction with product-grounded knowledge to guide complex procedures, but when a visual assistant should speak remained a complementary research question. BLIP-Live trains on large-scale data containing both useful response moments and periods when the agent should stay quiet, and uses Agent Memory to reduce repetition. Across 326 ego-centric videos, it reduced unnecessary responses of state-of-the-art models by over 50%, under an evaluation that charges for repeated and out-of-window messages and gives no credit for silence.

You’re all caught up