--eval-dir
A Claude Code CLI flag, read out of the shipped bundle. It has been in the build since v2.1.235, including the newest one read.
claude plugin eval now checks which plugin is actually loaded before running
Not Anthropic's. This is the line from the earliest changelog entry here that named it, v2.1.235.
In the changelogs
7Releases whose published page names --eval-dir.
-
v2.1.242
claude plugin eval initrefuses to scaffold in the wrong directoryEval scaffolding refuses to create files outside a plugin or skill folder unless you pass --eval-dir.
named in this entry, found in this entry's text
-
v2.1.235
claude plugin evalrewritten around which plugin is actually loadedclaude plugin evalnow checks which plugin is actually loaded before runningfound in this entry's text, named in this entry
-
v2.1.235
claude plugin eval --eval-dirshipped, with ownership checks on where cases and results are writtenplugin eval's --eval-dir flag ships with checks that it isn't writing results to a symlinked or foreign-owned directory
found in this entry's text, named in this entry
-
v2.1.235
plugin evalgains --eval-dir and a manifest eval directory, still early accessplugin eval gets a configurable case directory via --eval-dir or a manifest key, still gated as early access
found in this entry's text, named in this entry
-
v2.1.235
plugin evalcan target a non-default eval directoryclaude plugin evalgets an--eval-dir <dir>flag to target a non-default eval directoryfound in this entry's text, named in this entry
-
v2.1.235
Plugin eval gains an --eval-dir flag and advisories in the HTML report
plugin eval and eval init gain an --eval-dir flag, and reports now show per-case advisories
found in this entry's text, named in this entry
-
v2.1.235
plugin eval warns when the eval directory overlaps the plugin's declared component paths
plugin eval warns or errors when its eval directory overlaps a plugin's own command, agent, or MCP server paths
found in this entry's text
First cited
3The earliest release whose published evidence quoted --eval-dir was v2.1.235, 18 Aug 2026. That is the oldest release this project wrote about it, so it is a floor on the name's age and not the release that introduced it. It is not a presence reading: which builds carried the name is the table below.
Presence across releases
1Build by build
63One row per release since the first build this name was read out of. Absent means the build was read and the name was not in it, never mined means no bundle for that release was ever archived, and a declared type or a default is only ever what that release's own bundle stated.
Read out of the published npm bundle release by release, and out of Anthropic's own documentation as this site captured it. Nothing on this page is a description anybody here wrote about what the CLI flag does. All CLI flags.