Follow Discord
Sweep 22 Oct 2026 · 21:04Z Build v2.1.309 528 read Stable v2.1.308 Latest v2.1.309 Next v2.1.309 Feeds RSS JSON llms.txt llms-full.txt Unofficial

Claude Code v2.1.224 ·

Grading results record whether a criterion was scored

Evaluation grader output now says explicitly whether each criterion was scored.

Under the hood Internal Changes
JSON All of v2.1.224
Under the hoodTier: how much it should matter to you
1Useful: my rating, 1 to 5
2Signal: worth watching, 1 to 5
ElsewhereArea: what it touches
Internal ChangesKind: in v2.1.224,
Internal ChangesSection of the release
What

Evaluation grader output now carries an explicit flag for whether each criterion was actually scored, derived as the negation of the existing "with only" flag.

Details
  • The result schema gains an optional boolean scored alongside withOnly, judgeVotes and evidence.
Evidence

withOnly

Strings lifted out of the shipped bundle, so the claim above can be checked against them.

See this entry in the whole of v2.1.224 →

Feedback