DisclaimerUnofficial, and not affiliated with Anthropic. Nearly all of this is read straight out of what ships: npm bundles, captured prompts, published docs. Anthropic's own notes go in verbatim, marked as theirs. The rest is my reading, and every entry carries the strings behind it. If one looks wrong, vote it down and say why.
Plugin eval guidance now names the real fields, suite.plugins and costUsd.
What's wrong with this entry?
Anonymous. No account, no email.
suite.pluginscostUsdaggregate-result.json
What
The guidance for writing plugin evals now names the fields that actually exist: suite.plugins for checking the plugin loaded, and costUsd for the cost figure in aggregate-result.json. It previously said plugins and cost_usd.
Evidence
The pilot's top-level \costUsd\ in \aggregate-result.json\``
Strings lifted out of the shipped bundle, so the claim above can be checked against them.