Use it now
Useful3 Signal2
Plugin eval docs now say image focus files are shown to the judge, and document new exit codes.
What's wrong with this entry?
Anonymous. No account, no email.
claude plugin eval
What
The offline reference bundled for claude plugin eval now says image focus files (PNG, JPEG, GIF, WebP) are shown to the LLM judge as images, which it previously listed as upcoming. It also documents exit code 2 for hitting the cost ceiling or an auth failure, and 143 for a terminated run.
Details
--jsonruns still write load errors and notices to stderr; this is now stated rather than implied.- Partial runs carry a reason field explaining why they stopped.
Evidence
partialReason
Strings lifted out of the shipped bundle, so the claim above can be checked against them.
Related
Other releases about the same thing. Found by shared names or similar wording; neither means one caused the other.
-
v2.1.235
plugin evalnow tells you when a nearby plugin is not being loadedBoth mention eval
-
v2.1.235
--eval-diron the eval command, with warnings that name the fixBoth mention eval
-
v2.1.235
Eval setup refuses directories it cannot vouch for
Both mention eval