{"name":"--eval-dir","slug":"eval-dir","family":"cli","title":"CLI flags","noun":"CLI flag","description":"`claude plugin eval` now checks which plugin is actually loaded before running","description_source":"entry","described_by":{"version":"2.1.235","anchor":"claude-plugin-eval-rewritten-around-which-plugin-is-actual"},"presence":{"first_seen":"2.1.235","removed_in":null,"in_current_build":true,"newest_mined":"2.1.308","builds":63,"mined_builds":149,"first_cited":{"version":"2.1.235","released_at":"2026-08-18 18:24:10","spans":3}},"aliases":[],"entries":[{"version":"2.1.242","anchor":"claude-plugin-eval-init-refuses-to-scaffold-in-the-wrong-dir","heading":"claude plugin eval init refuses to scaffold in the wrong directory","line":"Eval scaffolding refuses to create files outside a plugin or skill folder unless you pass --eval-dir.","released_at":"2026-08-24 19:16:14","reason":"named in this entry, found in this entry's text"},{"version":"2.1.235","anchor":"claude-plugin-eval-rewritten-around-which-plugin-is-actual","heading":"claude plugin eval rewritten around which plugin is actually loaded","line":"`claude plugin eval` now checks which plugin is actually loaded before running","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text, named in this entry"},{"version":"2.1.235","anchor":"claude-plugin-eval-eval-dir-shipped-with-ownership-chec","heading":"claude plugin eval --eval-dir shipped, with ownership checks on where cases and results are written","line":"plugin eval's --eval-dir flag ships with checks that it isn't writing results to a symlinked or foreign-owned directory","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text, named in this entry"},{"version":"2.1.235","anchor":"plugin-eval-gains-eval-dir-and-a-manifest-eval-directory","heading":"plugin eval gains --eval-dir and a manifest eval directory, still early access","line":"plugin eval gets a configurable case directory via --eval-dir or a manifest key, still gated as early access","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text, named in this entry"},{"version":"2.1.235","anchor":"plugin-eval-can-target-a-non-default-eval-directory","heading":"plugin eval can target a non-default eval directory","line":"`claude plugin eval` gets an `--eval-dir <dir>` flag to target a non-default eval directory","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text, named in this entry"},{"version":"2.1.235","anchor":"plugin-eval-gains-an-eval-dir-flag-and-advisories-in-the-h","heading":"Plugin eval gains an --eval-dir flag and advisories in the HTML report","line":"plugin eval and eval init gain an --eval-dir flag, and reports now show per-case advisories","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text, named in this entry"},{"version":"2.1.235","anchor":"plugin-eval-warns-when-the-eval-directory-overlaps-the-plugi","heading":"plugin eval warns when the eval directory overlaps the plugin's declared component paths","line":"plugin eval warns or errors when its eval directory overlaps a plugin's own command, agent, or MCP server paths","released_at":"2026-08-18 18:24:10","reason":"found in this entry's text"}],"entries_total":7,"docs":[{"source":"claude-code","path":"plugin-evals","title":"Test plugins with evals","documented":false},{"source":"claude-code","path":"plugins\/cli-reference","title":"Plugin commands reference","documented":false},{"source":"claude-code","path":"plugins\/manifest-reference","title":"Plugin manifest reference","documented":false},{"source":"claude-code","path":"plugins\/troubleshooting","title":"Troubleshoot plugins","documented":false}],"docs_total":4,"gates":[],"related":[{"name":"--eval-mock-server","slug":"eval-mock-server","description":"This is version 2.1.242, and the CLI gained an --eval-mock-server mode taking two arguments."}],"url":"https:\/\/changelogs.core-directive.com\/reference\/cli\/eval-dir","family_url":"https:\/\/changelogs.core-directive.com\/reference\/cli.json"}