{"version":"2.1.233","anchor":"plugin-eval-checks-your-credentials-before-running-any-case","canonical_anchor":"plugin-eval-checks-your-credentials-before-running-any-case","heading":"Plugin eval checks your credentials before running any case","tier":"soon","area":"Plugin Eval","scope":null,"heads_up":null,"url":"https:\/\/changelogs.core-directive.com\/v\/2.1.233\/e\/plugin-eval-checks-your-credentials-before-running-any-case","release_url":"https:\/\/changelogs.core-directive.com\/v\/2.1.233","markdown":"### Plugin eval checks your credentials before running any case\n\nPlugin eval checks your credentials first and aborts instead of failing every case.\n\n**What**\n\n`claude plugin eval` now runs an authentication preflight up front. If it fails, the whole suite aborts with exit code 2 and a report status of `auth_failed` rather than burning every case on a broken credential. A preflight problem that is not fatal is printed as a notice and the run continues.\n\n**Details**\n\n- The result object carries an `authPreflightFailed` flag alongside the report status.\n- Plugin eval as a whole is early access, gated on `tengu_walnut_spire` or `CLAUDE_CODE_WALNUT_SPIRE`.\n\n**Evidence**\n\n`authentication check failed before running any case`\n\n- Flag `tengu_walnut_spire`: Off in both readings (read for one account on one subscription tier against v2.1.233; this account: off, anonymous baseline: off, compiled default: off) These values were read against a different version of Claude Code, so treat them as the nearest reading available instead of one taken on this release.\n- Area: Plugin Eval\n- Names: `claude plugin eval`\n- Tier: Nothing to try yet\n- Useful: 3\/5\n- Signal: 2\/5\n- Present in the build but not switched on"}