What
When results go to the default location rather than one given with --output-dir, the tool now verifies the directory it just created is new and fails if a directory of that name already existed, instead of writing into whatever was there.
Evidence
results directory ${Se} already existed — a default results directory is always new; refusing to write into it
Strings lifted out of the shipped bundle, so the claim above can be checked against them.
Names in the bundle--output-dir
The entry above is what we published on the day. These lines were added later, as Anthropic's own pages caught up, and they sit beside the original rather than replacing it.
Confirmed since
Anthropic's documentation has since written up --output-dir, on Plugins reference.
This table lists the options most runs use. Run `claude plugin eval --help` for the complete set, including `--case`, `--tag`, `--output-dir`, `--report`, `--allow-real-servers`, `--keep-temp`, and `--verbose`.plugins-reference see the edit
One source agreesOne thing we can check says the same as this entry.
Anthropic's documentation agrees
Anthropic's documentation has since written up --output-dir, on Plugins reference.