An 8B model learns to click precisely in professional software: GroundGUI pairs 586K screenshots with two-stage training to match closed-data models
GUI agents must turn a sentence into a specific pixel on screen, and high-quality cross-platform annotations have been scarce. GroundGUI releases both the ScreenRef dataset, with 586K screenshots and 633K referring expressions across desktop, web and mobile, and a two-stage training method, D2RL: a teacher that sees the ground-truth box distills token by token on the student's own rollouts, then RLOO reinforcement learning optimizes the click reward. Built on Qwen3-VL-8B-Instruct, GroundGUI-8B reaches 95.2% on ScreenSpot-V2 and 63.9% on the professional high-resolution ScreenSpot-Pro benchmark.