Skip to main content
Search

# World Model

32 related articles

Subscribe to updates
  1. arXiv

    Candidate trajectory scoring drops per-candidate rollouts: RFWorld reads a shared scene memory and reaches 90.5 PDMS on NAVSIM

    End-to-end driving must pick one of several candidate trajectories, and earlier world-model evaluators explicitly predicted future states for each candidate over the planning horizon, so inference cost grew with candidates and horizon while prediction errors accumulated. RFWorld instead builds one trajectory-agnostic shared scene memory, shapes it during training with a lightweight temporal readout under semantic supervision, and lets candidates query it through sparse spatial readout at inference. On NAVSIM-v1 with a ResNet-34 backbone, RFWorld reaches 90.5 PDMS, above DriveDPO at 90.0 and ResWorld at 89.0 in the reported table.

  2. arXiv

    WeatherDreamer learns data assimilation itself: hourly global analyses in about 1.5 minutes, without reanalysis

    WeatherDreamer folds data assimilation and forecasting into one learned cycle trained directly on 18 Earth-observing systems, without reanalysis. It corrects a latent state with new observations every hour; at held-out stations its ensembles beat NOAA's GEFS for temperature, dew point and wind out to 12 hours and are better calibrated, while its assimilation matches GSI near the surface and in moisture channels but shows departures up to about five times larger in temperature-sounding channels. One global hourly analysis takes about 1.5 minutes on a single GPU.

  3. arXiv

    A2WM refines frozen imitation policies without retraining, lifting mean success from 27.18% to 59.51%

    Small execution errors in imitation policies accumulate into failure, and earlier fixes relied on additional on-policy learning or costly online planning. A2WM learns local action sensitivity offline from action-perturbed rollouts of a frozen policy, predicting task-relevant geometry as a nominal trajectory plus a linear response to corrections, which turns online refinement into one model evaluation and one convex quadratic program solve. Across four simulated manipulation tasks it reaches the highest mean success among the evaluated baselines, 59.51% versus 27.18% for Diffusion Policy, with 3.8 ms mean refinement overhead per control step excluding base-policy sampling.

  4. arXiv

    ScanDreamer gives quadrotors an online map to imagine with: 96.3% success and 3.6% collisions in unseen simulated layouts

    For quadrotor navigation through unknown clutter, ScanDreamer builds an online 2D scan-memory map from depth images and vehicle pose, and conditions its world model, actor and critic on that map, so imagined rollouts advance the pose over a frozen map and read geodesic progress and wall-contact signals from mapped geometry. Across 1560 test episodes in NVIDIA Isaac Sim spanning unseen layouts and parameter ranges, three seeds average 96.3% success and 3.6% collisions, against 59.6% success and 28.8% collisions for AirDreamer at the same online-interaction budget.

  5. arXiv

    DexForesight stops dexterous hands from imagining the future: spatial foresight moves into policy latents, reaching 58.3% on real robots

    DexForesight injects predictive features from an action-conditioned spatial world model into a dexterous policy's latent space through query alignment, and at deployment keeps only the policy, which acts from RGB, language and robot state. On 11 DexJoCo simulation tasks it raises the GR00T N1.7 backbone's overall success from 49.4% to 60.5%, and on three real-robot tasks it reaches 58.3%, 8.3 points above the strongest baseline. The world model, depth encoder and future-prediction heads are all removed at inference.

  6. arXiv

    Same Login Screen, Opposite Labels: LGWM Checks the Transition in 17 ms, Not the Screen

    For GUI agents, the safety signal may lie not in the screen but in the transition that produced it: the same credential screen can be a legitimate result of tapping Sign in or a hijacked result of tapping View order. LGWM skips rendering the next screen and predicts its representation directly in the observation encoder's space, reducing verification to a vector comparison; on RSWT-Bench, where each credential screen appears pixel-identically under both labels, the training-free consistency score reaches 0.987 AUC at 17 ms per decision, on par with the strongest closed-source vision-language models and about ten AUC points above generative GUI world models.

  7. arXiv

    World models need not rerun per candidate: one extraction of local shape scores sixteen actions faster than the source generator

    Extracting the local shape of the action-conditioned data manifold once lets any number of candidate actions be scored by matrix multiplication alone, making sixteen candidates over an order of magnitude faster than the source generator and more accurate at short horizons.

  8. arXiv

    Frozen world models skip retraining: Library of Hands calibrates only the "hand" and lifts success from 28.6% to 62.3% when hands change and return

    When a camera moves or a controller is replaced, the same command moves the robot in a different direction or by a different magnitude, while a frozen world model still plans under its training-time action convention, so every plan is expressed in the wrong action frame. Library of Hands (LoH) trains nothing and leaves the world model frozen: it uses the frozen predictor to infer the applied action from two successive camera images, estimates the map from commands to applied actions, and stores each identified map in a library for reuse. In closed-loop tests where hands change and come back, LoH raises a frozen planner's success from 28.6% to 62.3%, and loses only 0.6 percentage points when nothing changes.

  9. arXiv

    ICU planning no longer rebuilds states per question: one frozen patient world model drives admission, care and discharge simulations

    ICU resource planning has long relied on compact state-transition models hand-specified for a single policy question, so a new question means redefining states. A patient world model trained on MIMIC-IV and then frozen encodes irregular electronic health records as state-event sequences, returns predictions at any interval the simulator requests, and connects through scenario-specific mappings to shared bed and staff queues. Across admission, care-dispatch and discharge simulations it agrees with task-fitted Markov and semi-Markov comparators on directional responses to capacity and dispatch policies, and reproduces the dispatch gains obtained by replaying observed trajectories.

  10. arXiv

    LLM interactive narratives get a common yardstick: three experience managers trade off differently on one shared world model, and none wins everywhere

    LLM-driven interactive narrative systems have been hard to compare because each experience manager is tied to its own bespoke scenario. An LLM-based narrative platform turns experience managers into interchangeable modules over a shared symbolic world model of facts, operations and goals, and every applied operation carries explicit preconditions and effects, so any session can be replayed as a common state-transition path. On a Little Red Riding Hood scenario, open generation, Monte Carlo repair and autonomous characters each ran 100 simulated sessions, and no manager led on all four properties: player agency, manager controllability, author intent and robustness.