Follow Discord
Sweep 22 Oct 2026 · 04:32Z Build v2.1.308 527 read Stable v2.1.308 Latest v2.1.308 Next v2.1.308 Feeds RSS JSON llms.txt llms-full.txt Unofficial

Claude Code v2.1.235 ·

plugin eval can target a non-default eval directory

claude plugin eval gets an --eval-dir <dir> flag to target a non-default eval directory

Use it now Improvements
JSON All of v2.1.235
Use it nowTier: how much it should matter to you
3Useful: my rating, 1 to 5
2Signal: worth watching, 1 to 5
Plugin EvalArea: what it touches
ImprovementsKind: in v2.1.235,
What probably matters to youSection of the release

The plugin eval command accepts a new --eval-dir <dir> flag, and the eval directory can also come from a plugin manifest's experimental.evals key; evals/ remains the fallback, and mis-shaped manifest values produce warnings that name the fix. Case discovery now screens the target path for trust before walking it and resolves it relative to the working directory. The error text shown when ablation runs with no plugin was rewritten to suggest targeting the plugin directory itself.

Read from
Names in the bundle--eval-dir
What the documentation says
Since it was published

The entry above is what we published on the day. These lines were added later, as Anthropic's own pages caught up, and they sit beside the original rather than replacing it.

Confirmed since Anthropic's documentation has since written up --eval-dir, on Plugins reference. | `experimental.evals` | string\|array | Directory below the plugin root that holds the plugin's [eval cases](/docs/en/plugin-evals#use-a-different-eval-directory), when it isn't the default `evals/`. `claude plugin eval --eval-dir` overri… plugins-reference see the edit
Added since A small documentation edit on Create and distribute a plugin marketplace touched a line naming plugin eval after this was published. Test your marketplace before sharing. Validation checks file structure; to test whether a plugin changes what Claude does on realistic prompts, run its eval suite with [`claude plugin eval`](/docs/en/plugin-evals) before you publish a new … plugin-marketplaces see the edit
Confirmed since Anthropic's documentation has since written up plugin eval, on Claude Code changelog. * Added `claude plugin eval`: run a plugin's eval suite against Claude Code and get scored, reproducible results (JSON + HTML report); see `claude plugin eval --help` changelog see the edit
How sure we are
Two sources agreeTwo things we can check say the same as this entry.
Anthropic's documentation agreesAnthropic's documentation has since written up plugin eval, on Claude Code changelog.
The name it cites is new in this buildNew in this build: --eval-dir

See this entry in the whole of v2.1.235 →

Feedback