{"version":"2.1.233","anchor":"plugin-eval-runs-report-exit-codes-stderr-and-auth-rejection","canonical_anchor":"plugin-eval-runs-report-exit-codes-stderr-and-auth-rejection","heading":"Plugin eval runs report exit codes, stderr and auth rejection","tier":"soon","area":"Plugin Eval","scope":null,"heads_up":null,"url":"https:\/\/changelogs.core-directive.com\/v\/2.1.233\/e\/plugin-eval-runs-report-exit-codes-stderr-and-auth-rejection","release_url":"https:\/\/changelogs.core-directive.com\/v\/2.1.233","markdown":"### Plugin eval runs report exit codes, stderr and auth rejection\n\nPlugin eval runs now report exit codes and stderr tails when a case fails.\n\n**What**\n\nEval run summaries now separate ok, error and exit outcomes. A non-zero exit produces an error built from the result message, or from the exit code plus the tail of stderr, falling back to \"(no stderr)\" when there is none. Behind the plugin eval early-access gate.\n\n**Details**\n\n- Runs where a top-level assistant message reported `authentication_failed` or `oauth_org_not_allowed` are now flagged as auth-rejected rather than as generic errors.\n\n**Evidence**\n\n`(no stderr)`\n\n- Area: Plugin Eval\n- Names: `claude plugin eval`\n- Tier: Nothing to try yet\n- Useful: 2\/5\n- Signal: 2\/5\n- Present in the build but not switched on"}