Skip to main content
Search

# Bilevel Optimization

1 related articles

Subscribe to updates
  1. arXiv

    Medical LLM fine-tuning no longer trades away patient safety: S-BDS lifts PatientSafetyBench safe rates by 4.64 points

    Patient-facing medical LLMs usually gain domain knowledge through supervised fine-tuning on large medical instruction sets, but that process can erode their existing safety alignment. S-BDS adds entropy regularization to the upper-level objective of bilevel data selection, curbing excessive concentration of selection weights so that sample rankings stay reliable over large candidate pools, and uses clinician-validated safe data as the upper-level signal. On Llama-3.1-8B-Instruct and Qwen3-8B-Instruct, S-BDS achieves the highest PatientSafetyBench safe rates among compared methods, 4.64 and 3.00 percentage points above the strongest baseline SEAL, while keeping competitive HealthBench medical capability scores.

You’re all caught up