Skip to main content
Search

# High-Dimensional Asymptotics

2 related articles

Subscribe to updates
  1. arXiv

    Detection error in latent spaces also double-descends: high-dimensional theory predicts miss rates at a fixed false alarm

    Once foundation models encode images, text and audio into high-dimensional latent vectors, how detection and classification error probabilities vary with the ratio of model size to training samples has lacked a computable characterization. The work derives explicit large-deviation rates for linear and quadratic decision statistics and finds the rate depends non-monotonically on the shape parameter, including double descent and, in some regimes, multiple descent; in latent-space experiments with DINOv3, Llama-Nemotron-Embed-1B-v2 and BEATs, predicted rates and detection probabilities at fixed false alarm track the measured curves closely.

  2. arXiv

    High-dimensional asymptotics yield a criterion for deciding whether private external datasets are worth buying using only summary statistics

    The work models dataset selection as high-dimensional regression with multiple heterogeneous sources and a weighted ridge estimator, uses only summary statistics, and provides privacy guarantees either on labels only or jointly on features and labels in terms of rho-zero-concentrated differential privacy; its main technical contribution is a deterministic equivalent of the test error that captures interactions among sample size, covariance structure, model shift, regularization, and privacy noise, allowing hyperparameters (weights and ridge regularizers) to be optimized and the usefulness of private external datasets to be judged without accessing the data itself, supported by experiments on synthetic and real-world datasets.

You’re all caught up