Skip to main content
Search

# Value of Thinking

1 related articles

Subscribe to updates
  1. arXiv

    A reasoning model gains a no-token switch: HDM reads one forward pass's hidden state to decide whether to write a chain of thought

    The hybrid decision model HDM puts token-free answering and full autoregressive reasoning inside one frozen backbone, with a lightweight self-routing block choosing between them before any token is generated. The block estimates the value of thinking, the accuracy gain the slow mode is expected to add over the fast one, and escalates only when that gain exceeds a price set per request. On MiniWoB, HDM reaches a reward of 0.469 against always-thinking's 0.519, cutting thinking tokens by 80% and wall-clock by 67%.

You’re all caught up