Skip to main content
Search

# CoCHI

1 related articles

Subscribe to updates
  1. arXiv

    LLMs Can Be Confidently Wrong: CoCHI masks a few attention heads at inference and lowers calibration error on five multiple-choice benchmarks

    Large language models often attach high confidence to incorrect predictions, while temperature scaling and similar methods adjust confidence only at the output. CoCHI sorts predictions into four classes by correctness and confidence, uses gating optimization to find attention heads causally tied to high-confidence errors, and masks only a few of them at inference without changing parameters. On LLaMA-3.1-8B, Gemma-2-9B and Mistral-7B, calibration metrics improve across five four-choice QA benchmarks while accuracy stays competitive.

You’re all caught up