Skip to main content
Search

# Kullback–Leibler Divergence

2 related articles

Subscribe to updates
  1. arXiv

    Discovery agents stop asking only true or false: swapping a hypothesis for rival explanations resolves 67% more questions at the same budget

    Scientific discovery agents usually test one hypothesis at a time, so when evidence rejects it the agent learns that one explanation is unlikely but not which alternative the evidence supports. Contrastive Discovery replaces each discovery step with a set of mutually exclusive, collectively exhaustive competing explanations for the same question, and scores an experiment by how far its evidence redistributes belief across that set. Across six datasets spanning materials, astronomy, mortgage discrimination, online discourse, software engineering practice and social behavior, guiding search with contrast sets resolved 67% more questions than pointwise surprisal under the same experiment budget, and 38 blinded experts chose the same explanation on 78% of resolved questions.

  2. arXiv

    Controlled distillation study finds on-policy rollouts are not universally better, with KL direction and learning rate dominating

    Independently varying rollout policy, token-level KL direction, and learning rate in strong-to-weak distillation across Llama 3 and Qwen2.5 model families and scientific, medical, and arithmetic reasoning tasks, the study finds no consistent advantage for on-policy rollouts in final accuracy, catastrophic forgetting, or parameter-update sparsity; forward KL is robust to rollout policy while reverse KL is substantially more sensitive and favors student-generated rollouts, learning rate governs forgetting and sparsity, and on-policy data helps only for generalisation to harder Countdown variants, an advantage that does not reliably persist after subsequent RLVR.

You’re all caught up