Skip to main content
Search

# Flow Matching

67 related articles

Subscribe to updates
  1. arXiv

    EEG-to-image reconstruction stops leaning on alignment alone: an image teacher supervises denoising, and the method beats its same-backbone baseline on all seven THINGS-EEG metrics

    EEG-to-image reconstruction has long aligned brain signals to pretrained visual embeddings and used them to condition a generator. Retrieval experiments here show that better alignment does not mean better reconstruction: retrieval improved by up to 77, while high-level reconstruction gains stayed modest and low-level fidelity showed no consistent improvement. An image teacher conditioned on DINOv2 features is trained first to express fixed encoder features as intermediate denoising representations, and an EEG-conditioned student generator aligns to these dynamic targets during denoising, with the teacher discarded at inference. On ten THINGS-EEG subjects, the method beats a SiT-XL/2 baseline trained on the same Brain-HiVE embeddings without representation alignment on all seven metrics.

  2. arXiv

    Iris-Z folds depth into image generation: one set of weights reaches mean AbsRel 2.92 on Marigold's benchmarks, below MoGe-3's 3.12

    Iris-Z is a general image generator that encodes image and depth into one token sequence and denoises them together, so a single set of weights generates images, estimates depth from photographs and paints images onto a given depth. Monocular geometry accuracy had belonged to task-specific ViTs such as MoGe-3, and image generators repurposed as depth estimators, the Marigold family, stayed behind it. Iris-Z-big reaches a mean AbsRel of 2.92 on Marigold's benchmark sets against 3.12 for MoGe-3 while keeping its generative abilities, at about 15 seconds per image versus about 0.41 seconds for MoGe-3.

  3. arXiv

    GeneFlow reads 1,000 genes straight from H&E slides, cutting inference to 0.31 GFLOPs

    Predicting spatial gene expression from H&E histology has relied on complex architectures and multi-stage pipelines, usually limited to fixed panels of about 200 genes. GeneFlow pairs flow-matching generative modeling with histology and gene tokenizers to predict each spot's expression profile directly, reaching the highest PCC across four public datasets, a 17.1% gain on PRAD PCC-1000, with a 0.31 GFLOPs trainable module and 0.61 s sampling per sample.

  4. arXiv

    Conditional flow matching can transfer too: a correction on top of a frozen source representation cuts energy discrepancy 26.4% on five-dimensional responses

    When target samples are limited, conditional flow matching can borrow a covariate representation learned from a related source population. TFM-Freeze keeps the source encoder fixed and trains only a target velocity head; TFM-Adapt jointly learns the head and a representation correction under a functional anchoring penalty. In simulations with related five-dimensional representations and 10000 source samples, unpenalized TFM-Adapt lowered energy discrepancy from 0.3158 for TFM-Freeze to 0.2325, a 26.4% reduction; target validation falls back to a target-only generator when transfer does not help.

  5. arXiv

    WaveGen folds zero-shot TTS into one model: text goes straight to waveform, hitting WER 1.47 and SIM 0.75 on Seed-en

    WaveGen pulls zero-shot speech synthesis back from multi-stage pipelines into a single diffusion model: text produces raw waveform directly, without a neural audio codec, Mel vocoder, VAE latent or duration predictor. Spectral Forcing makes the same model learn a low-resolution spectral trajectory alongside the target waveform trajectory, giving text-speech alignment a structured guide in high-resolution waveform space. Trained in one stage on open Emilia data, the 0.6B-parameter WaveGen reaches WER 1.47 and speaker similarity SIM 0.75 on the Seed-en benchmark.

  6. arXiv

    Duo v1 turns the world model into a two-way conversation: 17-frame chunks, it watches while it speaks, and it can be interrupted

    Duo v1 is a full-duplex world model that generates the assistant's audio and video in real time while continuously taking in the user's audiovisual input. Earlier world models largely kept intelligence outside the world, letting users steer scenes through keyboard, mouse or text prompts while nothing inside perceived the user or decided how to respond. Duo v1 cuts interaction into 17-frame chunks, about 0.71 s at 24 fps; a language intent module decides per chunk whether to speak or wait, and a causal audiovisual module generates the matching sound and picture. Of 180 checks across 30 real-time duplex cases and six binary criteria, 168 passed, including all 90 on language, speech intelligibility and visual identity, while content responsiveness reached 73.3%.

  7. arXiv

    Constrained sampling stops patching endpoints: MAFM evolves a persistent anchor along geometric dynamics and cuts PDE error on five benchmarks

    When a pretrained flow-matching model must satisfy an equality constraint supplied only at inference time, common practice repeatedly corrects predicted endpoints, and those discrete corrections can disturb the learned physical structure. MAFM instead evolves a persistent endpoint anchor continuously under an ordinary differential equation, separating model-guided tangential motion from normal attraction toward the constraint. On five PDE benchmarks—Poisson, Burgers, reaction–diffusion, Euler and Navier–Stokes—MAFM meets the prescribed constraint tolerance and achieves lower sample-level relative error than baselines that meet the same tolerance.

  8. arXiv

    Quasar periodicity tests drop the DRW null: Nullasar learns noise from light curves and reaches AUC 0.9648 on AR(2) data

    Quasar variability is usually tested for periodic signals against a damped random walk (DRW) null, and a mis-specified noise model biases the significance estimates. Nullasar uses flow matching to learn the statistical structure of stochastic variability from an ensemble of synthetic light curves without assuming a noise model, then generates null realizations conditioned on a single observed curve. On synthetic AR(2) light curves its periodicity-detection AUC is 0.9648, averaged over three independently trained models, above 0.9180 for fitting AR(2) per curve; in the AR(1) case it matches fitting the correct DRW model.

  9. arXiv

    Unpaired medical image translation split in two: structure frozen first, OCT-to-OCTA PSNR up to 11.2% higher

    Unpaired medical image translation previously packed structure preservation and appearance generation into one source-to-target mapping, which without paired supervision can drop vessels or distort the foveal avascular zone. This work separates the two: a cross-modality shared structure latent space is learned first, then the structure encoder is frozen and a conditional flow model renders only target-modality appearance. On OCT-to-OCTA and brain MR-to-CT, it outperforms all unpaired baselines and, despite no paired supervision, surpasses paired baselines, improving PSNR by up to 11.2% and SSIM by up to 26.4% on OCT-to-OCTA.

  10. arXiv

    Humanoids stop waiting for the big model: DASH holds 20 Hz from 0.8B to 8B backbones

    In humanoid manipulation, a large vision-language-action backbone is slow, so synchronous execution acts on stale observations and control frequency falls as the backbone grows. DASH splits the policy into a slow vision-language model and a fast flow-matching action head running as three concurrent processes over LCM, so the control rate is set by the action head alone. On a RoboTwin benchmark that charges inference latency in simulated time, DASH holds 20 Hz from 0.8B to 8B backbones while the synchronous rate falls from 9.7 Hz to 4.1 Hz, with higher success at every size; on a real dexterous humanoid, pick-and-place succeeds in 23 of 24 trials versus 16 of 24 for the synchronous pipeline.