Medical LLM fine-tuning no longer trades away patient safety: S-BDS lifts PatientSafetyBench safe rates by 4.64 points
Patient-facing medical LLMs usually gain domain knowledge through supervised fine-tuning on large medical instruction sets, but that process can erode their existing safety alignment. S-BDS adds entropy regularization to the upper-level objective of bilevel data selection, curbing excessive concentration of selection weights so that sample rankings stay reliable over large candidate pools, and uses clinician-validated safe data as the upper-level signal. On Llama-3.1-8B-Instruct and Qwen3-8B-Instruct, S-BDS achieves the highest PatientSafetyBench safe rates among compared methods, 4.64 and 3.00 percentage points above the strongest baseline SEAL, while keeping competitive HealthBench medical capability scores.