Eval runs stop with a clear policy error when your org's MCP rules block the mock servers.
What's wrong with this entry?
If your organisation's allowedMcpServers or deniedMcpServers settings would block the stand-in servers, the eval run stops with a policy-blocked error instead of quietly starting nothing.
- The message advises allowlisting the stand-in command for eval runs, or passing
--mocks off.
mocks: stand-in blocked by managed MCP policy
Strings lifted out of the shipped bundle, so the claim above can be checked against them.
Related
Other releases about the same thing. Found by shared names or similar wording; neither means one caused the other.
-
v2.1.219
MCP allow/deny rules compare expanded env-var values
Both mention allowed server denied
-
v2.1.248
MCP server allow and deny lists get settings keys
Both mention allowed server denied
-
v2.1.219
MCP policy allow/deny entries now expand
${VAR}environment references, and unsafe URL expansions fail closedBoth mention allowed server denied