Sweep 19 Sep 2026 · 02:36Z Build v2.1.278 500 read Stable v2.1.267 Latest v2.1.278 Next v2.1.278 Feeds RSS JSON llms.txt Unofficial
Claude Code v2.1.269 ·

Eval/mocking harness gains a 'withheld' mock-server concept

Eval mocking now supports 'withheld' mock servers that are excluded from without-server checks

TierUnder the hoodhow much it should matter to you
Useful1my rating, 1 to 5
Signal1worth watching, 1 to 5
AreaPlugin Evalwhat it touches
KindInternal Changesin v2.1.269,
Under the hood

Eval mocking now supports 'withheld' mock servers that are excluded from without-server checks

What

The evaluation and mocking system (used to test Claude Code against simulated MCP servers, which are external tools/data sources Claude can connect to) now supports marking a mocked server as withheld. A related internal function filters out withheld servers before deciding whether a test case actually ran without a given server dependency.

Why

This lets the eval harness distinguish a server that is deliberately left out of a test from one that's simply absent, so cases aren't miscounted as running "without" a server when that server was intentionally withheld.

See this entry in the whole of v2.1.269 →