Skip to main content
Search

# 3D Generation

4 related articles

Subscribe to updates
  1. arXiv

    Position Forcing recovers token positions from VecSet latents and quantizes them progressively, reaching best or tied-best ULIP and Uni3D scores for single-stage 3D generation

    Observing that VecSet latent tokens retain recoverable spatial correspondences, the work proposes Position Forcing: during denoising it recovers token positions from the predicted clean latent, quantizes them at progressively finer resolutions according to the noise level, and feeds them back to the diffusion Transformer through 3D RoPE, providing coarse-to-fine spatial guidance for single-stage 3D generation without a separate position generation stage and achieving best or tied-best results on all four ULIP and Uni3D metrics.

  2. arXiv

    ArticuTable reconstructs tabletop scenes with executable part-level articulation from a single RGB image, reaching the lowest LPIPS of 0.2398 and highest DINOv2 of 0.8991 on 150 reference images and ranking first in 85.59% of user-study evaluations

    The work presents ArticuTable, a single-image tabletop scene reconstruction framework in which GRAM converts imperfect monolithic proxy meshes into executable URDF articulated assets via MLLM-guided joint fitting and semantic state reasoning, while PSGSR progressively registers point-cloud, top-view, and input-view constraints with structure-aware semantic pose selection to resolve yaw ambiguity; on 150 generated reference images it achieves LPIPS 0.2398, DINOv2 0.8991, and CLIP 0.9265, outperforming ACDC, Gen3DSR, MIDI, and TabletopGen with the lowest collision rate of 0.3819%, ranks first in 85.59% of user-study evaluations, and releases 100 USDZ scenes directly loadable in Isaac Sim.

  3. arXiv

    OctLLM treats octree occupancy bytes as an explicit 3D language, improving 3D generation and understanding in one unified multimodal model while preserving language ability

    OctLLM converts meshes into coordinate- and depth-anchored Sparse Octree (S-Octree) occupancy bytes as an explicit 3D language and places 3D capacity in full-rank branches separate from the pretrained weights, training about 2.80B parameters; it achieves the best 3D generation and understanding among unified multimodal LLMs, lowering image-to-3D Inception FID from ShapeLLM-Omni's 38.21 to 31.58 and raising render-grounded captioning from 18.14 to 46.88, while exactly reproducing the backbone on MMLU and HellaSwag and staying within one point on GSM8K.

  4. arXiv

    Writing Geometry into the Generative State: GAE Unifies Perception and Generation with a Geometry-Native Latent Space

    The work introduces the geometry-native autoencoder (GAE), which compresses the four feature levels of the frozen geometry foundation model DA3 into a single compact latent of 64 or 128 channels that decodes jointly to RGB, depth, cameras, and point maps, and in controlled comparisons holding the generator and training protocol fixed it lowers FVD on RealEstate10K and DL3DV and roughly halves camera-trajectory error on RealEstate10K relative to the strongest non-GAE latent.

You’re all caught up