Skip to main content
Search

# RegLLM

1 related articles

Subscribe to updates
  1. arXiv

    RegLLM diagnostic harness exposes run-to-run variance in two nominally identical GPU pilots: escalation recall 1.0 versus 0.5, with the same adapter's effect flipping direction

    The authors propose RegLLM, a diagnostic harness for bounded autonomy in regulated agentic workflows that instruments six trustworthiness signals (citation validity, source grounding, schema compliance, escalation correctness, constitutional alignment, unsafe-action rate) alongside a deterministic runtime supervisor; an offline reference run (n=12) lifts escalation recall from 0 to 0.67 and cuts the unsafe-action rate from 0.33 to 0.08, while two nominally identical single-GPU Qwen2.5-3B LoRA/DPO pilots (n=8, same seed and eval split) show task success of 0.25 versus 0.12 and escalation recall of 1.0 versus 0.

You’re all caught up