Skip to main content
Search

Zichuan Fu

1 related articles

Subscribe to updates
  1. arXiv

    After learning new facts, LLMs still misjudge what they can answer: training feeling of knowing separately lifts post-update AUROC to 0.809

    After knowledge fine-tuning, a large language model answers more questions, but its judgment of whether it can answer a given question often stays at the pre-update boundary. This work splits knowledge updating and the feeling-of-knowing judgment into two trainable channels, using on-policy supervised fine-tuning, feeling-of-knowing training across knowledge states, and feeling-of-knowing-guided policy optimization so the judgment follows current knowledge. On a TriviaQA knowledge update with Qwen2.5-7B, the full pipeline raises held-out feeling-of-knowing AUROC from 0.519 after vanilla knowledge fine-tuning to 0.809, and held-out answer accuracy from 0.546 to 0.692.

You’re all caught up