Skip to main content
Search

University of Maryland, Baltimore County

2 related articles

Subscribe to updates
  1. arXiv

    CroissantMiner releases a 602-paper benchmark: single-pass full-context extraction beats four agentic architectures, with the best system reaching only 0.709 composite

    The work builds CroissantMiner, a benchmark pairing 602 ML dataset papers (102 with human-validated gold annotations, 500 with LLM-generated silver annotations) with the full 30-field Croissant 1.1 schema, and evaluates 24 extraction systems under a two-tier framework combining rule-based scoring with a human-audited LLM judge, finding that single-pass full-context extraction outperforms all four evaluated agentic architectures on every backbone and that long-form RAI fields are hardest, with the strongest system reaching only 0.709 composite.

  2. medRxiv

    The Online Health Safety Gap: Consensus Alignment Does Not Imply Safety in Peer-to-Peer Health Narratives

    This work identifies and empirically validates the Online Health Safety Gap: across 704 health narratives (699 classified), two scores computed from non-overlapping feature sets, Narrative Truth Distance for epistemic divergence and Narrative Risk Score for health risk potential, share only 4.9% of their variance (r=0.222, p<0.001), so 39.6% of narratives fall in the two off-diagonal quadrants that single-axis systems mishandle by construction (aligned-but-risky 25.2%, divergent-but-safe 14.4%), and on an expert-labeled misinformation benchmark of 437 posts containing 127 misinformation instances the highest discrimination is Youden J of 0.349, motivating a Classification Quadrant and a shift from fact-centric evaluation to risk-aware assessment.

You’re all caught up