Similarity needs more than one ruler: BASIS infers which criterion fits the instance from weak feedback, lifting six-probe concept recovery from 56.0% to 68.1%
Language models repeatedly compare similarity at test time to pick exemplars, candidates and revisions, yet lexical, semantic, structural and stylistic resemblance can point to different candidates, and the task-aligned notion can shift from instance to instance. BASIS places the choice of candidate and the choice of criterion in one Bayesian posterior, updates it from scalar scores, pairwise preferences or verifier outputs, and picks each next probe by expected information gain. On concept recovery, six probes give 68.1% Success@1 against 56.0% for a tuned static mixture; reasoning accuracy is 73.1% versus 72.3% and refinement win rate 63.8% versus 61.4%, with the largest gains under criterion mismatch and larger candidate pools.