Skip to main content
Search

# Predictive Entropy

2 related articles

Subscribe to updates
  1. arXiv

    EASE adapts logit perturbation and sampling temperature by predictive entropy during generation, cutting average TPR@1%FPR across five detectors on Qwen3-8B from 0.655 to 0.339

    Observing that perturbing next-token logits or adjusting sampling temperature reduces AI-generated-text detector performance, the authors propose EASE, a training-free and detector-agnostic framework that computes predictive entropy from the source LLM's next-token distribution and uses it to adapt both logit perturbation strength and sampling temperature, consistently reducing detection performance across three source LLMs and multiple detectors with negligible inference overhead and limited text-quality degradation.

  2. arXiv

    HierEM treats each site's prostate lesion contour as a noisy view of a latent clean mask, lifting leave-one-site-out Dice to 27.91%–32.67% across three sites

    The study proposes HierEM, a hierarchical expectation-maximization framework that treats each site's observed prostate lesion annotation as a noisy observation of a latent clean lesion mask, alternating between inferring a voxel-wise posterior over that latent mask and training a CNN with the posterior as a soft target while estimating site- and case-level sensitivity and specificity under a logistic-normal hierarchical prior; on three-site data it reaches per-site mean DSC of 29.50%–39.69% in pooled held-out evaluation and 27.91%–32.67% in leave-one-site-out generalization, with statistically significant improvements over comparison methods (p < 0.039) and interpretable per-site label-quality estimates (sensitivity α of 31.5%–47.3% at specificity β ≈ 0.99).

You’re all caught up