Skip to main content
Search

# LLM Judge Panel

1 related articles

Subscribe to updates
  1. arXiv

    ZooWork aligns e-commerce rerankers with cross-family LLM judge labels: the 8B and 4B significantly beat the strongest open baseline on ShopRank-Bench, and the distilled 0.6B matches a 4B base on structured text

    ZooWork presents ZooWork-ShopRanker, a family of e-commerce rerankers (0.6B, 4B, 8B) trained on preference labels produced by three reasoning LLM families (Qwen3.5-122B, Gemma-4-31B, DeepSeek-V4-Pro) under a constraint-first, both-orders judging protocol, with the aligned 8B distilling into the 4B and 0.6B; on ShopRank-Bench, built from Gensmo private traffic (10,511 pairs tiered gold/silver/bronze), the 8B and 4B significantly outperform the strongest open baseline Jina-m0, every size significantly beats its own un-aligned base, the 0.6B is statistically indistinguishable from the 4B base on structured text, and alignment costs nothing in general MTEB reranking quality or serving latency.

You’re all caught up