Source Intelligence
Follow Discord
Sweep 28 Aug 2026 · 00:00Z Build v2.1.250 478 read Stable v2.1.236 Latest v2.1.250 Next v2.1.251 Feeds RSS JSON llms.txt
Reading a new release v2.1.251 Analysing changes · 2/5 Analysis pass · 14/27 agents ~3-4 min left 232 findings $6.28 so far

DisclaimerUnofficial, and not affiliated with Anthropic. Nearly all of this is read straight out of what ships: npm bundles, captured prompts, published docs. Anthropic's own notes go in verbatim, marked as theirs. The rest is my reading, and every entry carries the strings behind it. If one looks wrong, vote it down and say why.

Reference / CLI flags

plugin eval init

A Claude Code CLI flag, read out of the shipped bundle. No mined inventory carries it: everything below comes from what this site has written about it.

What it is

Point plugin eval at any case directory with --eval-dir, still behind an early-access gate or env var.

Not Anthropic's. This is the line from the earliest changelog entry here that named it, v2.1.235.

Presence across releases

The miner has never read a build containing this name. It is here because a changelog entry of ours names it, which is evidence that it existed and not evidence of which releases carried it. The inventory starts at v2.1.138 and everything older than that was never mined.

Changelog entries naming it

  1. v2.1.242claude plugin eval init refuses to scaffold in the wrong directory

    Eval scaffolding refuses to create files outside a plugin or skill folder unless you pass --eval-dir.

    named in this entry

  2. v2.1.235plugin eval can be pointed at a different case directory

    Point plugin eval at any case directory with --eval-dir, still behind an early-access gate or env var.

    named in this entry

  3. v2.1.235Eval runs record their output directory and show per-case advisories

    Eval runs record which directory they used and show per-case warning notes in the HTML report.

    named in this entry

Documentation pages

None of Anthropic's documentation pages this site has a copy of carries this name.

Names beside it

Every CLI flag in the inventory starting plugin eval, up to twelve of them.

plugin evalPlugin eval now writes report.html and publishes it to claude.ai unless you pass --no-publish. never mined

Read out of the published npm bundle release by release, and out of Anthropic's own documentation as this site captured it. Nothing on this page is a description anybody here wrote about what the CLI flag does. All CLI flags.