Skip to main content
Search

# Variational Inference

7 related articles

Subscribe to updates
  1. arXiv

    A few specimens can define a whole family of hyperelastic laws: hierarchical Bayesian PANNs separate specimen spread from noise

    A hierarchical Bayesian physics-augmented neural network (PANN) learns the constitutive laws of several specimens of one material as a population: all specimens share polyconvex features learned by the network, each specimen is described only by its own amplitude and feature shares, and the population mean and covariance and the measurement noise are inferred in one posterior. On synthetic populations it recovers the population from few specimens and predicts new specimens more reliably than three published methods; on Treloar's rubber and on healthy and aneurysmal aortas it reaches the accuracy of a deterministic PANN and assigns no aorta specimen to the wrong cohort with confidence, although its bands for untested curves are too narrow.

  2. arXiv

    KL-regularized RL gets a sharp sample count: with a generative model, samples scale linearly in the effective horizon and temperature no longer slows learning

    KL-regularized reinforcement learning, the objective behind maximum-entropy RL and RL fine-tuning of language models from human feedback, previously had guarantees whose sample counts grew with a worse power of the effective horizon, and no MDP lower bound depended on the temperature. For tabular discounted MDPs with a generative model, this work shows that a plug-in estimator, which draws a fixed number of samples per state-action pair and solves the empirical MDP, reaches KL suboptimality at the temperature scale with samples linear in the effective horizon, and that no algorithm, even one choosing where to sample, can do with fewer.

  3. arXiv

    A single brain scan can still place a patient on the disease timeline: ELPAC anchors on clinical endpoints and integrates backward

    Most members of an Alzheimer's cohort contribute only one partially observed cross-sectional snapshot, leaving their stage, subtype and stage-varying multimodal coupling unresolved. ELPAC anchors subtype trajectories at clinically reliable endpoint groups and integrates backward along biologically constrained velocity fields, then factorizes residual multimodal variation around that stage axis into sparse coordination axes that strengthen or fade with stage. On synthetic data and a harmonized ADNI+NACC/SCAN cohort it recovers the latent structure, returns calibrated prediction intervals and yields multimodal coordination programs that differ by subtype.

  4. arXiv

    Neural processes assumed clean inputs: DnNP folds denoising into meta-learning and cuts PM2.5 interpolation RMSE by up to 30%

    Standard neural processes treat inputs as noise-free observations, so sensor measurement error degrades both predictions and uncertainty estimates. DnNP makes the clean input a latent variable inside the neural-process framework and trains a denoiser jointly with meta-learning through variational inference, predicting directly from noisy inputs. On PM2.5 spatial interpolation from 34 air-quality sensors in Brookline, Massachusetts, DnNP reduces RMSE by up to 30% and NLL by up to 73% relative to standard neural processes.

  5. arXiv

    Array coherence loss stops being discarded as noise: Topophone2 inverts array covariance into a slowness energy distribution

    Array processing has long treated inter-sensor coherence loss as a nuisance, and conventional beamforming assumes a far-field point source with incoherent noise between sensors. Topophone2 models the array covariance as a mixture of energy distributions over slowness, describing signal and environmental noise with skew-normal and angular-harmonic distributions that have analytical characteristic functions, then computes the posterior by variational Bayesian inference. On a synthetic abyssal T-phase, adding a fourth hydrophone raises the information gain on the angular-harmonic noise coefficients by 142%, while the gain on signal parameters and SNR rises by less than 8%.

  6. bioRxiv

    Spatial transcriptomics skips the region map: 45.8% more DE genes in chronic stress, with attention maps showing where

    Comparative spatial transcriptomics usually partitions tissue into anatomical regions or clusters first and then tests differential expression inside those fixed units, separating localization from testing. SpaceDX instead learns gene-specific spatial attention weights while testing, aggregating spots into an attention-weighted pseudobulk that enters a hierarchical Bayesian logistic regression for subject-level association. In 19 stressed and 19 control mice it found 175 DE genes at 5% empirical FDR, 45.8% more than regional DESeq2's 120; in an Alzheimer's model the two found similar numbers alone, and combining them raised discovery 19.1% over DESeq2 alone.

  7. arXiv

    Likelihood tempering in linear Bayesian neural networks makes predictive mean and variance transition at different temperature scales, so no schedule recovers both NNGP posterior moments

    For single-hidden-layer linear Bayesian neural networks under NTK parameterization, the authors derive the limiting variational predictive distribution when the temperature decays as a power of width, and find that the predictive mean and variance undergo phase transitions at different temperature scales: the mean leaves its prior value below an explicit threshold and eventually equals the least-squares prediction, while the variance departs from the prior only at colder temperatures, and no schedule of this form recovers both the untempered NNGP posterior mean and variance.

You’re all caught up