What probably matters to youSection of the release
What
claude plugin eval now publishes the HTML report by default when your account supports it. --publish-report changed meaning to "require publishing", and explains why if it is unavailable; --no-publish keeps the report local. Passing both is now an error. --report now means the report replaces the results directory, implying a default location.
Details
Results from the LLM judge on long inputs now append an advisory suggesting a regex grader instead.
Evidence
Error: --no-publish and --publish-report are contradictory — pass at most one.
Strings lifted out of the shipped bundle, so the claim above can be checked against them.