Skip to main content
Search

# Confabulation

1 related articles

Subscribe to updates
  1. arXiv

    A hidden activation edit rewrites what a reasoning model thinks it was asked, and it defends the fake request

    A reasoning model's belief about what it was asked can be overwritten by an activation edit invisible in the prompt text: after injecting the forming-trace of an unrelated concept, the model reasons about, answers, and restates the injected topic as its task, with the forced quote-back returning that topic in 47 of 48 model-concept cells across six models. Even a warning that names the true topic leaves clean recovery under 5%; the model instead confabulates a story that the user changed their mind, a concrete limit on chain-of-thought monitoring and self-report.

You’re all caught up