Skip to main content
Search

# Bayesian Neural Network

2 related articles

Subscribe to updates
  1. arXiv

    Likelihood tempering in linear Bayesian neural networks makes predictive mean and variance transition at different temperature scales, so no schedule recovers both NNGP posterior moments

    For single-hidden-layer linear Bayesian neural networks under NTK parameterization, the authors derive the limiting variational predictive distribution when the temperature decays as a power of width, and find that the predictive mean and variance undergo phase transitions at different temperature scales: the mean leaves its prior value below an explicit threshold and eventually equals the least-squares prediction, while the variance departs from the prior only at colder temperatures, and no schedule of this form recovers both the untempered NNGP posterior mean and variance.

  2. arXiv

    DMA approximates factor-to-variable messages directly, bounds marginal KL by message KL, and yields a Bayesian neural network inference algorithm without a learning-rate hyperparameter

    The work introduces Direct Message Approximation (DMA), which instead of approximating the marginal at each factor edge as expectation propagation (EP) and variational message passing (VMP) do, approximates factor-to-variable messages directly; for normalisable factors it defines a consistency condition (requiring exactness when all other incoming messages are Dirac deltas), proves a master theorem bounding marginal KL from message KL for proper messages on any graph with three structural corollaries—Dirac-input consistency, no EP-style inner-loop iteration, and no negative-precision messages—and additionally proves a complementary O(1/r2) guarantee for the inherently improper backward message of the product factor; as a concrete instantiation it derives explicit DMA messages for the prod

You’re all caught up