{"version":"2.1.224","anchor":"claude-plugin-eval-writes-a-report-and-publishes-it-by-defau","canonical_anchor":"claude-plugin-eval-writes-a-report-and-publishes-it-by-defau","heading":"claude plugin eval writes a report and publishes it by default","tier":"use","area":"Plugin Eval","scope":null,"heads_up":null,"url":"https:\/\/changelogs.core-directive.com\/v\/2.1.224\/e\/claude-plugin-eval-writes-a-report-and-publishes-it-by-defau","release_url":"https:\/\/changelogs.core-directive.com\/v\/2.1.224","markdown":"### `claude plugin eval` writes a report and publishes it by default\n\nPlugin eval now writes report.html and publishes it to claude.ai unless you pass --no-publish.\n\n**What**\n\nAfter cases run, `report.html` is written into the results directory even without `--report`, and the report is published to claude.ai by default rather than only with `--publish-report`. Pass `--no-publish` to keep it local. `--no-publish` and `--publish-report` together are an error. Publish-by-default is controlled by a server flag whose built-in fallback is on, so with no server value it publishes; an explicit `--publish-report` ignores the flag entirely.\n\n**Details**\n\n- The JSON result is now computed once and shared between writing, publishing and printing.\n- Publishing failures explain that artifacts are turned off for the account, provider or privacy mode, and the failure text names the local copy when one was written.\n- `--publish-report`'s help text changed to match the new default.\n\n**Usage**\n\n`claude plugin eval .\/my-plugin --no-publish` **Evidence** `tengu_quartz_thimble`, `--no-publish and --publish-report are contradictory \u2014 pass at most one.`\n\n- Flag `tengu_quartz_thimble`: On for this account, and not off by default (read for one account on one subscription tier against v2.1.224; this account: on, anonymous baseline: on, compiled default: on) These values were read against a different version of Claude Code, so treat them as the nearest reading available instead of one taken on this release.\n- Area: Plugin Eval\n- Names: `claude plugin eval`, `--no-publish`, `--publish-report`, `--report`\n- Tier: Use it now\n- Useful: 4\/5\n- Signal: 3\/5"}