Under the hood
Eval mocking now gives specific errors when a plugin's MCP servers can't be enumerated for mocking
What
The eval mocking system can now detect and explain three specific cases where a plugin's MCP servers can't be listed for mocking:
- the plugin is a packaged archive
- the plugin's manifest fails to load
- the plugin declares its servers through an MCPB bundle
Instead of failing with a generic error, record mode now tells the operator exactly what to do: extract the archive, fix the manifest, or pass --allow-real-servers.
Why
This turns a previously generic failure into an actionable message, so someone recording an eval knows exactly what's blocking it and how to resolve it.