Self-driving labs drop the Q-learning rate: heteroscedastic Gaussian processes set a noise level per target and near the best return in fewer episodes across five benchmarks
Each campaign in a self-driving laboratory is a real reactor or culture run, and tens to hundreds of episodes leave no room to tune a learning rate as well. Heteroscedastic Gaussian Process Q-learning (HGPQ) places a Gaussian process directly on the Q-function, uses the Kalman gain as the learning rate, and estimates each Bellman target's noise variance with a second heteroscedastic Gaussian process so noisy targets move the estimate less. Pooled over five simulated benchmarks that include a chemical reactor and a bioprocess, HGPQ approaches the best return found by any method in fewer episodes than GP, kernel and deep RL baselines.