Follow Discord
Sweep 22 Oct 2026 · 21:04Z Build v2.1.309 528 read Stable v2.1.308 Latest v2.1.308 Next v2.1.309 Feeds RSS JSON llms.txt llms-full.txt Unofficial

Claude Code v2.1.224 ·

plugin eval: report publishing flags reworked

Plugin eval publishes its HTML report by default; --publish-report now means require publishing.

Use it now Notable Improvements
JSON All of v2.1.224
Use it nowTier: how much it should matter to you
4Useful: my rating, 1 to 5
2Signal: worth watching, 1 to 5
Plugin EvalArea: what it touches
ImprovementsKind: in v2.1.224,
What probably matters to youSection of the release
What

claude plugin eval now publishes the HTML report by default when your account supports it. --publish-report changed meaning to "require publishing", and explains why if it is unavailable; --no-publish keeps the report local. Passing both is now an error. --report now means the report replaces the results directory, implying a default location.

Details
  • Results from the LLM judge on long inputs now append an advisory suggesting a regex grader instead.
Evidence

Error: --no-publish and --publish-report are contradictory — pass at most one.

Strings lifted out of the shipped bundle, so the claim above can be checked against them.

Read from
Names in the bundle--publish-report--no-publish--reportclaude plugin eval
How sure we are
One source agreesOne thing we can check says the same as this entry.
The name it cites is new in this buildNew in this build: --no-publish

See this entry in the whole of v2.1.224 →

Feedback