Skip to main content
Search

# Self-Consistency

6 related articles

Subscribe to updates
  1. arXiv

    Parallel reasoning stops writing every path to the end: PreG scores short prefixes first and saves tokens in 54 of 60 settings

    Parallel test-time scaling for large language models normally generates every reasoning path to completion before internal confidence can score it, so compute on low-quality paths is already spent. PreG instead generates short prefixes in parallel, ranks them by internal confidence, and completes only the most promising candidates before aggregating as before. On Qwen3-8B and Llama-Nemotron-4B across math competition sets and GPQA-Diamond, it reaches the accuracy of the original method at a 1000k-token budget with fewer tokens, saving tokens in 54 of 60 configurations and up to 80%.

  2. arXiv

    Reasoning search stops voting only after the fact: VGSC resamples steps during decoding and reaches 63.1% average accuracy

    Test-time search for multi-step LLM reasoning has long traded between two imperfect signals: post-hoc voting keeps diversity but cannot steer generation toward correct paths, while beam-style verifier guidance intervenes early but over-concentrates and amplifies verifier errors. VGSC multiplies step-level correctness with a future-outcome prediction into an acceptance weight, applies bounded rejection-resampling to candidate steps during decoding, and keeps multiple trajectories for final self-consistency voting. Across five reasoning benchmarks with the Qwen2.5 Math 1.5B Instruct generator and Qwen2.5 Math PRM 7B verifier, VGSC reaches 63.1% average accuracy at verifier-trust exponent 10, above the strongest non-VGSC baseline BS+SC-Future at 60.7%.

  3. Causal pairs pulled from nuclear event reports now carry a confidence score: reviewing the top 20% catches 82% of extraction errors

    Large language models extract cause-effect pairs from nuclear Licensee Event Reports as flat assertions, leaving risk analysts unable to separate reliable relations from spurious ones. A study stacks four signals, token-level probabilities, self-consistency across stochastic decoding runs, disagreement among three independently fine-tuned models, and conformal prediction, into a calibrated confidence score per pair. On a held-out test set the integrated score reached an expected calibration error of 0.067 and an AUROC of 0.84, above every individual signal, and uncertainty-guided review found 82% of extraction errors within the first 20% of relations reviewed, against 24% for random selection.

  4. Self-consistency backfires on long context: seven of eight samples agree on the same wrong answer

    On long-context tasks, self-consistency, the practice of sampling several answers and aggregating them, no longer improves performance and often lowers it, because positional bias makes the samples repeat the same mistake and the vote turns that mistake into a consensus.

  5. Health economic model conceptualisation moves to agentic AI: two cases match the core staging logic of NICE appraisals, with automated runs of about an hour

    An agentic generative-AI framework produced disease concept diagrams and model structure diagrams for breast cancer and hATTR-PN that were structurally concordant with the core disease-staging logic of the NICE appraisal accepted for each indication, with automated runs of about 1 hour, or 1–2 days including expert validation, against up to 3 months of fully manual conceptualisation.

  6. USTC and Baidu team survey parallel reasoning: a unified formal framework maps non-interactive, interactive, and efficiency methods into one roadmap

    This survey defines parallel reasoning as a three-stage inference paradigm of decomposition, parallel processing, and aggregation, gives a formal formulation and distinguishes it from Chain-of-Thought and long-thinking, then organizes representative methods along three lines—non-interactive (self-consistency, Best-of-N ranking, structured reasoning), interactive (intra-model and multi-agent interaction), and efficiency (parallel decoding, parallel function calling, speculative decoding)—and summarizes applications, core challenges, and future directions.

You’re all caught up