Test plugins with evals changedplugin-evals
Nearest release: v2.1.285, published under an hour after upstream edited the page. Shown because the two are within 24 hours of each other. Nothing here says the release caused the edit.
Upstream edited this page at 29 Sep 2026 16:35 UTC, give or take a minute or two: the time comes from Anthropic’s own sitemap rather than from a commit. This site recorded the change at 29 Sep 2026 16:37 UTC.
Upstream edited
Recorded here
Lines+3added
Lines−1removed
From line
683
where the diff opens
First seen
11 Sep 2026
this site's first read of the page
Recorded edits9to this page, all time
### "--json output path must end in .json"
The whole hunk
from line 683, old and new numbered
/
from line 683
683683
684684The default `--threshold` is 1.0, so the command exits 1 when any case scores below perfect. Set a threshold that matches the score you require. Exit 1 also covers a case file that failed to load, which is reported on stderr above the table.
685685
686### "--json output path must end in .json"
686<h3 id="json-output-path-must-end-in-json">
687 `--json output path must end in .json`
688</h3>
687689
688690You put the target after `--json`, so it was read as the output path. Put the target first, as in `claude plugin eval . --json`, or give `--json` an explicit `.json` path.
689691
No line in this hunk matches that.