You'll noticeTier: how much it should matter to you
2Useful: my rating, 1 to 5
1Signal: worth watching, 1 to 5
PluginsArea: what it touches
ImprovementsKind: in v2.1.233,
ImprovementsSection of the release
What
If the very first run in an eval suite is rejected for bad credentials, the suite halts immediately rather than working through every remaining case and failing each one the same way.
Details
The stop is reported as auth_failed, with a new auth_preflight_failed alongside it; previously partial runs were always attributed to cost_ceiling.
The printed message points you at the credential error above and asks you to re-run.
Evidence
every remaining run would fail the same way, so the suite stops here. Fix the credential above and re-run.
Strings lifted out of the shipped bundle, so the claim above can be checked against them.
