Under the hoodTier: how much it should matter to you
1Useful: my rating, 1 to 5
1Signal: worth watching, 1 to 5
Plugin EvalArea: what it touches
Internal ChangesKind: in v2.1.269,
Internal ChangesSection of the release
Unclear What causes a server to be marked withheld, and what practical effect it has on the eval, isn't stated.
What
When running a mock evaluation of a plugin, the summary of results for each MCP server can now include a withheld: true flag, in addition to the existing replayPinned count.
Why
This lets plugin developers see when a server was withheld during a mock eval run, giving clearer insight into what happened during testing.
How sure we are
Something disagreesSomething we can check disagrees with this entry, or the writer said they could not settle it.
The writer flagged doubtWhat causes a server to be marked withheld, and what practical effect it has on the eval, isn't stated.
