{"version":"2.1.242","anchor":"eval-runs-fail-loudly-when-managed-policy-blocks-the-mock-se","canonical_anchor":"eval-runs-fail-loudly-when-managed-policy-blocks-the-mock-se","heading":"Eval runs fail loudly when managed policy blocks the mock servers","tier":"notice","area":"Plugin Eval","scope":null,"heads_up":null,"url":"https:\/\/changelogs.core-directive.com\/v\/2.1.242\/e\/eval-runs-fail-loudly-when-managed-policy-blocks-the-mock-se","release_url":"https:\/\/changelogs.core-directive.com\/v\/2.1.242","markdown":"### Eval runs fail loudly when managed policy blocks the mock servers\n\nEval runs stop with a clear policy error when your org's MCP rules block the mock servers.\n\n**What**\n\nIf your organisation's `allowedMcpServers` or `deniedMcpServers` settings would block the stand-in servers, the eval run stops with a policy-blocked error instead of quietly starting nothing.\n\n**Details**\n\n- The message advises allowlisting the stand-in command for eval runs, or passing `--mocks off`.\n\n**Evidence**\n\n`mocks: stand-in blocked by managed MCP policy`\n\n- Area: Plugin Eval\n- Names: `allowedMcpServers`, `deniedMcpServers`, `--mocks`\n- Tier: You'll notice\n- Useful: 2\/5\n- Signal: 2\/5"}