Skip to main content
Search

# Robotic Manipulation

31 related articles

Subscribe to updates
  1. arXiv

    Frontier models drive real robot arms: Reins gets GPT-6.1 Sol to 88% success on five long-horizon tasks

    Frontier multimodal models can plan and call tools, yet they struggle to drive real robot arms through long-horizon, contact-rich manipulation, blind while the arm moves and while the model thinks. Reins lets an off-the-shelf model operate a dual-arm robot through 3D perception tools and atomic actions that report contact and grip, chains actions with stopping conditions, and has a second model instance watch the cameras and report what changed. On five real tasks, GPT-6.1 Sol succeeds in 88% of episodes from natural-language prompts with no task-specific code; without the harness it never lifts the correct mug in the shell game and takes 8 times as long.

  2. arXiv

    Imitation policies learn a proprioceptive anchor: one measurement predicts sensitivity at new noise levels, but the protection fails in deployment

    Imitation policies trained on noisy object-position readings do not discount the reading by the classical reliability ratio. They combine it with a proprioceptive anchor, weighting the reading by the ratio of reading noise to the anchor's error variance, and that variance belongs to the learner and is far smaller than regression on the demonstrations implies. Measured once, the law predicted ten held-out sensitivities across two robomimic tasks and two learner classes with mean absolute error 0.025, against 0.37 for classical errors-in-variables regression. In closed loop the policy produces its own state, and none of the 15 policies that passed the registered gates kept its open-loop protection against a persistent reading offset, though 8 followed the offset fully.

  3. arXiv

    Robots need not imagine the future at every replan: Bind-WAM routes on language-object binding uncertainty and reaches 98.60% mean success on LIBERO

    World Action Models (WAMs) predict future visual states and actions together, but generating a visual future at every replanning step is expensive and sometimes unnecessary. Bind-WAM uses whether the roles named in a language instruction are stably bound to objects in the current view as an interpretable signal: an offline pipeline labels reference mismatch, invisibility and identity drift from complete demonstrations, and a lightweight router of about 6.65M parameters switches a shared WAM between direct action prediction and joint future-action denoising. On LIBERO, Bind-WAM reaches 98.60% mean success while invoking the joint path at only 40.58% of replanning states, cutting average completion time from 15.73 s for Fast-WAM-Joint to 11.71 s.

  4. arXiv

    SWAM carries video priors into robot actions: 61.56% success on randomized scenes, 12.86 points above OpenWAM

    Shanghai Jiao Tong University and collaborators assembled a roughly 47,000-hour multisource pool and extended a pretrained video model's language–video priors into language–video–action learning, yielding the world action model SWAM. On the 50 manipulation tasks of RoboTwin 2.0, SWAM reaches 61.56% success under the randomized Hard setting, 12.86 percentage points above the strongest baseline OpenWAM, and 88.10% under the clean Easy setting, slightly below OpenWAM's 89.30%. On a real bimanual platform, its three-task average Hard success rate is 40.00% against OpenWAM's 23.33%.

  5. arXiv

    Adapting long-chunk robot policies by learning how long to execute: ExRL keeps base policies frozen and nears perfect success on real cube stacking after about ten minutes

    Online reinforcement-learning adaptation of long-chunk robot policies previously optimized high-dimensional action sequences directly, which demanded many samples and made real-robot adaptation costly. ExRL instead adapts a scalar decision, how many steps of each predicted action chunk to execute, training a lightweight adapter with off-policy reinforcement learning while the base policy stays frozen. Across simulation benchmarks and four real manipulation tasks it improves diffusion policies, ACT, several vision-language-action models and a world action model with limited online interaction, approaching perfect success on real cube stacking after about ten minutes of physical interaction.

  6. NVIDIA Blog

    NVIDIA Brings Physical AI Into Korean Factories: Samsung Homogenization Case Drops From 18 Hours to 41 Seconds

    NVIDIA and several Korean industry partners are pushing physical AI into production, spanning semiconductor engineering, autonomous driving and robot learning. In chip-scale thermal and mechanical analysis, Samsung Electronics combined AI-predicted effective material properties, coarser grids and GPU acceleration to cut one homogenization case from about 18 hours on a 32-core CPU fine-grid solve to 41 seconds on a GPU coarse-grid solve, roughly 1,600x faster; selected quantum chemical calculations on its sMOL platform ran up to 5x faster end to end.

  7. VLA action choice stops trusting the top score alone: FRS-Grounding adds neighborhood consistency for 86.4% simulated success

    The highest-scoring action from a vision-language-action (VLA) model is not always the most reliable one to execute. FRS-Grounding keeps the finite candidate set after VLA inference, fuses normalized candidate scores with distance to a safe-action set into a fuzzy action set, and builds a pairwise relation from pose differences and collision-free states before fuzzy rough lower and upper approximations separate strongly supported candidates from boundary cases. Across 1500 randomized simulations the full pipeline reached 86.4% success and a 2.1% safety-violation rate, versus 74.8% and 8.2% for the pointwise hard-constraint baseline VLA-HC; under positional noise with σ = 10 mm it retained about 78% success against about 28% for VLA-HC.

  8. arXiv

    WorldBridge splits video prediction from action: one labeled demo per new task lifts success from 55.90% to 70.70%

    WorldBridge separates video prediction and action generation into two experts and uses structured attention to route predicted future frames into actions, then tests what video and action supervision each contribute on RoboTwin 2.0. With only in-distribution video-action supervision, out-of-distribution task success is 25.07%; adding videos of those tasks without action labels raises it to 55.90%, and one action-labeled demonstration per task raises it to 70.70%. Under the full data setting, WorldBridge reaches 96.23% average success on RoboTwin 2.0.

  9. 灵初智能

    Robot actions stop lining up by index: FAFM maps mixed-frequency demonstrations into frequency coefficients and lifts real-arm success by 10 to 15 points

    A team from Lingchu Intelligence with Beihang University, Peking University and the Chinese University of Hong Kong introduces FAFM, a frequency-aware flow-matching method that represents robot actions as frequency coefficients tied to real physical time instead of fixed-length discrete sequences, and explicitly constrains the first time derivative while generating actions by flow matching. Demonstrations recorded at 5 Hz, 10 Hz and 20 Hz can then be mapped onto one physical time scale and trained together without downsampling or interpolation. On a Franka arm, integrating FAFM into π₀.₅ raised success from 80% to 95% on grasp-and-place and from 80% to 90% on multi-obstacle avoidance.

  10. arXiv

    Robots stop asking the big model every step: a local CALL head pages Astra only for recovery, lifting 200 LIBERO episodes to 97.5%

    A frozen π0.5 policy gains a local CALL head that pages GPT-6 Astra only at critical recovery moments, raising success from 95.5% to 97.5% across 200 LIBERO episodes while confining Astra to a small share of environment steps.