Skip to main content
Search

# Computer-Use Agents

3 related articles

Subscribe to updates
  1. OpenAI News

    ChatGPT for Healthcare puts agents inside hospital software: reading screens, clicking, and moving records while clinicians keep review

    OpenAI is bringing computer-use agents to ChatGPT for Healthcare that carry out multi-step work across existing healthcare software, alongside improved trusted clinical search and more than 20 new healthcare plugins. Healthcare teams previously had to piece together information by hand from the EHR, hospital policies, scheduling systems, and payer portals; the agents read screens, click, type, and move between applications, with access controls and audit logs. In a blind evaluation spanning multiple specialties and multi-turn conversations, physicians rated the updated clinical answers more highly across all eight dimensions over more than 1,300 reviews.

  2. arXiv

    Computer-use agents stop swallowing every screenshot: VTR co-trains a router to keep 2.5–5.8× fewer visual tokens at full-resolution performance

    Computer-use agents encode each screenshot into thousands of visual tokens, and those tokens pile up into long contexts on long-horizon tasks and in real-time games. VTR trains a vision-language model jointly with a lightweight spatio-temporal router that inspects the same image region in the current and previous screenshots and decides whether that token enters the language model, using an adaptive loss to keep as few tokens as possible without losing action prediction. After only 2,000 training steps, VTR matches the full-resolution model on OSWorld, CUA-World and video-game action prediction while using 2.5–5.8× fewer visual tokens, cutting inference cost by up to 3.3× and speeding prefill by up to 2.9×.

  3. arXiv

    Browser agents can be steered down pre-approved branches: 94.4% attack success on STEER-Bench, 0% with COBRA

    Computer-use agents that act directly on graphical interfaces must branch on runtime web content, so an adversary can craft untrusted data that pushes the agent into a hazardous pre-approved branch without injecting explicit instructions. STEER-Bench measures this branch steering across 101 tasks in 9 domains, with 94.4% attack success against standard agents and 89.5% against vanilla Dual-LLM. COBRA pairs trusted branching plans with ahead-of-time capability constraints that bound each branch's parameters and destinations, cutting attack success to 0% while retaining 97% benign utility.

You’re all caught up