Skip to main content
Search

# LLM Pairwise Ranking of Synthesis Recipes

1 related articles

Subscribe to updates
  1. arXiv

    GPT-5.6-Sol ranks solid-state recipes: hiding all chemistry leaves overall accuracy at 0.72, hiding temperature drops it to 0.56

    A team built a benchmark from 240 measured solid-state syntheses across eight oxide targets, each run through the same 30 firing conditions, then had GPT-5.6-Sol compare two recipes for the same target and pick the one expected to yield higher target-phase purity. Its pairwise accuracy was 0.72; hiding all chemical identity moved overall accuracy from 0.74 to 0.72, while on the six thermally driven targets accuracy was 0.68 without chemistry and 0.56 without temperature. The authors therefore describe the model as a thermally informed prior rather than a ranker that understands target chemistry.

You’re all caught up