STaSBO hands strategy, not points, to an LLM: best average rank of 2.17 and 2.60 across 22 benchmarks
Bayesian optimization depends heavily on how its surrogate model and acquisition function are paired, and a fixed pairing transfers poorly across problems. STaSBO gives that pairing decision to a large language model acting as an online meta-controller: it first plans the search intent, then jointly picks a configuration using surrogate fit evidence and prospective candidate diagnostics, while numerical Bayesian optimization still handles modeling and candidate generation. Across 12 synthetic mathematical tasks and 10 scientific and engineering tasks it reaches average ranks of 2.17 and 2.60, against 4.08 and 4.10 for the strongest baseline in each suite.