Under the hood
Useful1 Signal2
Eval runs can output mock call records and grade results on mock calls alone.
What's wrong with this entry?
Anonymous. No account, no email.
What
Eval runs can select mock call records as an output alongside trace, last message and files, and results carry the mocks block and a flag for runs graded on mock calls alone.
Details
- The suite adoption record now tracks a separate consent decision alongside the adoption decision, both derived rather than fixed to true.
- The judge's closing instruction, previously the hardcoded "Respond with exactly one word: PASS or FAIL.", is now supplied by the caller.
Evidence
"mock_calls"
Strings lifted out of the shipped bundle, so the claim above can be checked against them.