Skip to main content
Search

# LLM judges

1 related articles

Subscribe to updates
  1. langchain.com

    LangSmith now reviews whole conversations in annotation queues, so multi-turn agent errors no longer hide behind the last reply

    LangSmith's annotation queues can now treat a full multi-turn session as one review item, not just a single run or step. Multi-turn agent errors often begin several turns earlier and only become visible in the final reply, so step-level review misses the earlier messages and tool calls that explain the answer. Reviewers score the conversation and give their reasoning, and those labels are used to align LLM judges, fix online evaluators and build golden datasets.

You’re all caught up