Skip to main content
Search

# Latent Diffusion Model

12 related articles

Subscribe to updates
  1. arXiv

    Changing only 5% of pixels blocks face cloning: SEAL holds identity similarity to 0.15 or less on CelebA-HQ and VGGFace2

    Adversarial perturbations added to photos can stop a diffusion model from learning a person's identity, but earlier methods altered the whole face densely, and the accumulated distortion became visible around facial features. SEAL confines the perturbation to 5% of spatial locations, jointly optimizing where it lands and its values with a differentiable top-k mask, and disrupts the latent variance of a frozen VAE encoder. On CelebA-HQ and VGGFace2, protected images reach above 41 dB PSNR, 0.97 SSIM and at most 0.07 LPIPS, while identity similarity after DreamBooth personalization stays at most 0.15.

  2. bioRxiv

    A single-cell simulator with a dial for batch strength: scDeepSim varies batch effects and trajectory geometry on demand

    Benchmarking single-cell methods has been limited by costly annotation of real data and by datasets that capture only one observed condition. scDeepSim encodes expression into latent subvectors assigned to cell type, batch and residual variation, learns their distribution with latent diffusion, and at generation time modifies only the target subvector, imposing batch effects or constructing branching trajectories at user-set strengths. On scIB human pancreas data at intervention strength α=1, the structured model reached a mean cell-type silhouette width of 0.519 versus 0.432 for a plain variational autoencoder.

  3. arXiv

    LungMend fills the cavities severe-TB CT masks miss, using only a healthy-lung shape prior and reaching 0.986 Dice

    On severe tuberculosis CT, cavities and consolidations have soft-tissue density and are left out of lung masks by segmenters such as R231. LungMend treats mask correction as shape completion: a latent diffusion prior trained on 57 healthy lungs, conditioned on a synthetically corrupted mask and on bone anatomy that disease does not alter, with no pathological data or CT intensities. On 200 radiologist-corrected slices from 20 severe TB cases it reaches 0.986 Dice and 0.57 mm average surface distance, with cavity and consolidation recall of 0.993 and 0.981.

  4. arXiv

    Subsurface flow data assimilation gets adaptive-tempered sequential Monte Carlo: posteriors match reference MCMC on four synthetic truths, with 2.5–7.0× single-GPU speedups

    Geological uncertainty in subsurface flow systems is often hierarchical: a set of geological metaparameters controls overall statistics while cell-by-cell property fields vary, and both must be estimated from observations. An adaptive-tempered sequential Monte Carlo method estimates metaparameters and Gaussian latent variables jointly within one likelihood framework, with surrogate models supplying all forward evaluations. Across four synthetic true models, its posterior metaparameter distributions and flow predictions agree closely with reference MCMC results, while single-GPU data assimilation is 2.5–7.0 times faster and needs fewer function evaluations.

  5. arXiv

    Subsurface fracture networks skip fracture-by-fracture sampling: a latent diffusion model generates native 3D voxel fields and honors 84.2% of sparse well voxels

    Subsurface fracture networks were previously sampled fracture by fracture from prescribed statistics, which made sparse well observations hard to enforce. Here 2D and 3D networks are represented as binary occupancy fields, compressed by a variational autoencoder into a compact latent space, and learned by a diffusion model, with well observations injected through a learned conditioning encoder, classifier-free guidance, and diffusion posterior sampling. The 2D conditional model satisfies 99.6% of prescribed well observations, while the native 3D volumetric field satisfies 84.2% of observed well voxels while keeping fracture volume fraction close to the reference ensemble.

  6. arXiv

    Event forecasting stops ranking on accuracy alone: aggregating a diffusion model's realism beats dedicated predictors on TMS

    Event sequence forecasting has long been ranked by prediction accuracy alone, even though generative models can produce many possible futures. A benchmark for heterogeneous event sequences such as card transactions measures accuracy and distributional realism together and finds no method leads on both: diffusion models lead on realism, dedicated predictors on accuracy. A post-hoc aggregation called Wasserstein BaryBooster collapses a diffusion model's samples into one trajectory, reaching the highest TMS on three datasets while keeping non-trivial cDFS.

  7. arXiv

    MPAD synthesizes 3D multi-contrast MRI with 2D diffusion and multi-plane autoregression, cutting training FLOPs 7x and inference FLOPs 3x

    The authors propose MPAD: a 3D autoencoder compresses MRI volumes into an isotropic latent representation, a 2D diffusion model reconstructs masked target-contrast latent slices conditioned on source-contrast slices, unmasked target slices, and a text modality prompt, and inference generates slices autoregressively per plane while propagating completed volumes as priors to orthogonal planes, achieving full-volume 3D synthesis with 2D operations, reducing training and inference FLOPs by 7x and 3x versus 3D latent diffusion baselines, and improving PSNR, SSIM, and NMSE on ADNI and IXI.

  8. arXiv

    VolCo uses volumetric contact and volume-wise latent diffusion to generate tighter human grasps with shallower penetration

    The authors introduce VolCo, a hierarchical contact representation that expands object-surface sample points into local 3D volumetric grids whose points encode contact likelihood and Continuous Surface Embedding correspondences, and build VolCoDiff on it: a VolumeVAE models feasible local hand configurations while a prior-guided latent diffusion model captures global hand geometry, yielding the lowest penetration depth and highest stability on GRAB and HO3D with tighter, larger-contact-area grasps.

  9. arXiv

    EagleDepth pairs latent diffusion guidance with a pixel diffusion decoder for faster, finer monocular depth at 4K

    EagleDepth combines depth-adapted latent diffusion with pixel-space generation: it first fine-tunes FLUX.2-klein-4B on paired RGB-depth data to predict a coarse depth latent from resized low-resolution RGB, then freezes that branch and fine-tunes the pretrained pixel diffusion decoder PiD to generate the depth map directly at the target resolution in a single step, conditioned on the coarse latent and the original high-resolution RGB, bypassing the VAE decoder; it reaches competitive overall accuracy on five common depth datasets and Synth4K, leads on high-frequency-masked metrics and boundary F1 across all five Synth4K subsets, and is the fastest among evaluated methods at 4K inference.

  10. arXiv

    CrashSim generates crash scenarios from real-world crash priors, builds the 4,000+ scenario nuCrash dataset, and widens measured safety gaps across five planners

    The authors present CrashSim, a human behavior-informed crash scenario generation framework that uses a vision-language model to interpret naturalistic driving scenes, hierarchically retrieves real-world crash priors, and converts their relative-motion patterns and behavior-stage timings into anchor guidance for a diffusion generator pretrained on nuScenes; results show CrashSim reproduces real-world pre-impact behavior, collision dynamics, collision geometry and crash-type distributions more closely than Strive and LD-scene, and it is used to build nuCrash, a dataset of over 4,000 crash and near-crash scenarios on which five planners show larger closed-loop performance differences than on nuScenes, with an LLM evaluation agent providing capability-level diagnoses and improvement guidance.