Skip to main content
Search

# Defense Against Malicious Fine-tuning

1 related articles

Subscribe to updates
  1. arXiv

    Poisoned fine-tuning can be repaired at two layers: harmful score falls from 11.54 to 0.08

    In fine-tuning-as-a-service, malicious fine-tuning can weaken a model's refusal behavior while keeping its downstream task performance. SLDR replaces layer-wise safety diagnostics with a signed sensitivity spectrum, trains a LoRA recovery adapter only on the two layers with the highest and lowest sensitivity, and uses a representation-based maliciousness score at inference to decide when to activate it. On Llama3.1/SST2, the average harmful score drops from 11.54 to 0.08 while downstream accuracy matches undefended fine-tuning, and the harmful score stays near zero up to a poisoning ratio of 0.9.

You’re all caught up