claude plugin eval adds --trust-plugin for CI and --allow-real-servers to run real MCP servers without mocks
The plugin evaluation command gains two new flags:
--trust-plugin: skips the first-run trust prompt, meant for use in CI (continuous integration) pipelines, similar in spirit to--dangerously-skip-permissions--allow-real-servers: when combined with--mocks record, lets a plugin's real MCP server processes start and run for any servers that have no mock available, running outside Claude Code's OS sandbox (a restricted execution environment)
The --mocks help text was also expanded to better explain the difference between record and off behavior. Separately, when a plugin's MCP servers can't be enumerated (for example, an invalid manifest, archive, or MCPB bundle), setting allowRealServers now runs the real servers instead of refusing or mocking them; without it, an invalid manifest now causes affected cases to be refused outright in record mode, rather than just noted.
These flags make it practical to run plugin evals unattended in automated pipelines and to test against real MCP servers when no mock exists, at the cost of running outside the sandbox's protections.
Added claude plugin eval: run a plugin's eval suite against Claude Code and get scored, reproducible results (JSON + HTML report); see…
New in this build: --allow-real-servers