You'll notice
Useful2 Signal1
Pointing a regex grader at an image now explains what to use instead.
What's wrong with this entry?
Anonymous. No account, no email.
What
A regex grader pointed at something that resolves to an image now fails with a message naming the media type and what to do instead: use an LLM grader focused on that file, or, if you are asserting something is absent, write a text rendering of it first and match against that.
Details
- The eval authoring documentation now tells authors to set
allowed_toolson every case alongsidetimeout_seconds.
Evidence
is an image (
Strings lifted out of the shipped bundle, so the claim above can be checked against them.