Skip to main content
Search

# Conformal Prediction

18 related articles

Subscribe to updates
  1. bioRxiv

    ProtCOVER swaps per-variant conformal calibration for homology families: with no shift, pathogenic coverage on new families returns to the 0.90 target from 0.823–0.873

    Zero-shot variant effect predictors calibrated conformally per variant let well-studied protein families set the error rate, leaving pathogenic coverage on new families at 0.823–0.873. ProtCOVER treats homology families rather than individual variants as the exchangeable unit and calibrates conditionally on label-free family descriptors; under the shift those descriptors define, its worse-class shortfall is 0.000, against 0.010 for group weighting and 0.029 for hierarchical conformal, at the price of larger sets. On 12,225 proteins outside the benchmark every method still falls short, with ProtCOVER at 0.027 and group weighting at 0.034, within the 0.01 margin.

  2. arXiv

    Language models stop placing trades: Gated-CSRC turns news into risk certificates, cutting semantic breaches from 4.05% to zero in backtests

    Reinforcement-learning portfolio policies can propose allocations but lack a calibrated, replayable way to certify before execution that a proposal stays inside a bounded risk envelope. Gated-CSRC has a language model read timestamped news only into structured semantic risk states, converts those states into factor-shock ellipsoids through rolling conformal calibration, and lets a second-order cone gate correct an allocation only when its budget is breached. In walk-forward tests on nine U.S. sector SPDR ETFs, raw PPO earned 12.7% annual return with a 4.05% semantic violation rate; gating cut violations to zero while retaining 11.7% annual return.

  3. arXiv

    Linear ACE potentials get calibrated uncertainty: a delete-one-configuration jackknife sets the shape and one conformal quantile the scale, putting most of 20 silicon properties inside 95% intervals

    Linear atomic cluster expansion (ACE) potentials are misspecified when trained on deterministic density-functional labels, so Bayesian posterior variances understate their errors. A delete-one-configuration CR3 jackknife covariance supplies the shape and one conformal quantile from held-out data supplies the scale, bringing per-atom force regions close to nominal coverage on held-out silicon and propagating the same parameter distribution through implicit differentiation to 21 silicon properties; of 20 scored properties, 17 fall inside 95% intervals for the smaller model and 15 for the larger, whose intervals are about 4 times tighter.

  4. arXiv

    Clinical imaging decisions get a harm gate: HC-ROCP cuts severe-case misrouting from 4.68% to 0.54%

    A clinical image classifier that returns a set of possible diagnoses does not guarantee that a severe case avoids a harmful action. HC-ROCP adds a harm penalty weighted by predicted severe-class probability to frozen classifier probabilities, tests coverage and severe-action error on disjoint calibration splits, and then certifies, reports descriptively, or refuses each claim. On COVID-19 radiographs across ten calibration seeds, severe-action errors fall from the exact ROCP baseline's 4.68% to 0.54%, at higher modeled loss.

  5. arXiv

    Polynomial-chaos surrogates get locally adaptive intervals: high-noise regions stop being under-covered, from a single fit

    Polynomial chaos expansions have long offered only global error metrics, leaving the reliability of an individual prediction unstated; normalizing jackknife+ conformal nonconformity scores with an auxiliary polynomial chaos model makes interval width follow local input uncertainty. For fixed-basis, least-squares-fitted expansions every quantity is available in closed form, so the finite-sample jackknife+ coverage guarantee is retained without retraining; on a cantilever-beam benchmark with known heteroscedastic noise and on steam-generator clogging simulation data, the adaptive intervals reach target coverage and clearly outperform non-adaptive ones in high-uncertainty regions.

  6. Grammar grading that shows its work: a shared evidence graph ties every Chinese-language mark to a rule certificate

    Grammar assessment for international Chinese education is recast as proof-carrying constrained inference: retrieved rules, error spans, minimal repairs and ordinal grades are coupled through one latent evidence graph, and every score-affecting judgment must carry a rule-level support certificate. On public corpora including MuCGEC, PC2G reaches an error-detection F0.5 of 71.4 against 67.6 for the strongest listed retrieval baseline, CRAG-style, while five-level grade MAE falls from 0.57 to 0.42 and evidence faithfulness reaches 91.8%. Those grades are measured against a silver rubric derived from reference edits, not independent teacher ratings.

  7. arXiv

    95% intervals calibrated on random splits fail outside the training envelope: hard-shift coverage falls to 0.40–0.75 across seven engineering datasets

    Prediction intervals for engineering regression are usually calibrated on random splits, while deployment happens outside training conditions. A benchmark splits seven public engineering datasets into in-distribution, soft-shift and hard-shift rungs along physically meaningful shift variables, and compares 12 uncertainty quantification methods from five families tuned on source data only. In distribution, conformal methods cover at least 0.946 on every dataset; under hard shift, mean coverage falls to 0.40–0.75 for the 11 methods that always return an interval, and no systematic difference in method ranks is detected.

  8. Causal pairs pulled from nuclear event reports now carry a confidence score: reviewing the top 20% catches 82% of extraction errors

    Large language models extract cause-effect pairs from nuclear Licensee Event Reports as flat assertions, leaving risk analysts unable to separate reliable relations from spurious ones. A study stacks four signals, token-level probabilities, self-consistency across stochastic decoding runs, disagreement among three independently fine-tuned models, and conformal prediction, into a calibrated confidence score per pair. On a held-out test set the integrated score reached an expected calibration error of 0.067 and an AUROC of 0.84, above every individual signal, and uncertainty-guided review found 82% of extraction errors within the first 20% of relations reviewed, against 24% for random selection.

  9. SRAM sign-off stops simulating every corner: transferred design points plus conformal calibration still deliver 99.88% yield on a 1-Mb macro

    SRAM yield sign-off needs per-cell failure probabilities of 10⁻⁶ to 10⁻¹² at every PVT condition, and running importance sampling at each one is expensive. The method transfers each failure lobe's design point across PVT, corrects it with one SPICE run per lobe, and adds split-conformal margins computed from importance sampling on a random subset of sign-off conditions, escalating undecided conditions to importance sampling. Across all 242 unseen conditions of a SkyWater 130-nm cell and an ASAP7 7-nm cell, no calibrated decision was unsafe, the minimum operating voltage read from the conformal upper limit lay −1 to +34 mV from importance sampling, and a 1-Mb macro delivered at least 99.88% yield.

  10. Omani crude pipelines skip per-case CFD: a surrogate returns heat, head and power loss in milliseconds

    Omani crude oil flows non-isothermally as a viscoplastic fluid, and predicting its heat and head losses has meant running high-fidelity CFD case by case, too slowly for real-time decisions. A physics-informed surrogate trained on 962 COMSOL simulations, with a dimensionless Rheological Heat-Loss Index (RHLI) as an input feature, now predicts total heat loss, head loss and total power loss together. Under five-fold cross-validation heat loss was the most learnable target, with cross-validated R² near 1; uncertainty quantification gave a mean calibration error of 0.0211 and 97.4% empirical 95% coverage, and SHAP ranked ambient temperature as the dominant heat-loss driver.