Source Intelligence

DisclaimerUnofficial, and not affiliated with Anthropic. Nearly all of this is read straight out of what ships: npm bundles, captured prompts, published docs. Anthropic's own notes go in verbatim, marked as theirs. The rest is my reading, and every entry carries the strings behind it. If one looks wrong, vote it down and say why.

All of v2.1.236 Home All releases olderv2.1.235 v2.1.237newer
Claude Code v2.1.236

Plugin eval cases must have a prompt, and unfilled templates are rejected

Use it now
Useful3 Signal2
Plugin Evals not in their notes

Plugin eval cases now must include a prompt, and untouched init placeholders are rejected.

execution.promptcase.yamlprompt.md
What

A plugin eval case that supplies only a session history file is now refused; you need execution.prompt in case.yaml or a prompt.md body. A case or grader still containing the placeholder line written by init is refused with an error explaining that.

Details
  • Directory scanning for cases was rewritten, and paths written inside a case are now resolved with a check that they do not escape the case folder.
Evidence

execution.prompt is required (a prompt.md body, or execution.prompt in case.yaml)

Strings lifted out of the shipped bundle, so the claim above can be checked against them.

See this entry in the whole of v2.1.236 →