Sweep 19 Sep 2026 · 02:36Z Build v2.1.278 500 read Stable v2.1.267 Latest v2.1.278 Next v2.1.278 Feeds RSS JSON llms.txt Unofficial
Claude Code v2.1.269 ·

Eval scaffold_script now warns explicitly when skipped

Eval cases with a scaffold_script now warn explicitly when --scaffold wasn't passed instead of silently skipping it

TierYou'll noticehow much it should matter to you
Useful2my rating, 1 to 5
Signal1worth watching, 1 to 5
AreaPlugin Evalwhat it touches
KindImprovementsin v2.1.269,
You'll notice

Eval cases with a scaffold_script now warn explicitly when --scaffold wasn't passed instead of silently skipping it

What

When an eval case defines a scaffold_script (author-supplied setup code) but the --scaffold flag wasn't used, Claude Code now prints an explicit warning that the script won't run and that the case will execute against an unstaged workspace, rather than skipping it silently.

Why

This makes it clear when a case is running without its intended setup, and reminds you that --scaffold runs author-supplied bash code as you, so it should only be passed for eval suites you trust.

Read from
Names in the bundle--scaffoldscaffold_script
What the documentation says
--scaffold Plugins reference modified, high confidence | `--scaffold` | Run each case's [`scaffold_script`](/docs/en/plugin-evals#add-setup-or-history-with-case-yaml) | Off | see the edit
How sure we are
One source agreesOne thing we can check says the same as this entry.
Anthropic's documentation agrees--scaffold on Plugins reference

See this entry in the whole of v2.1.269 →