Under the hood
Useful2 Signal2
Partial assistant output can stream event by event instead of in batches when the flush interval is zero.
What's wrong with this entry?
Anonymous. No account, no email.
What
When the stream flush interval is set to zero, partial output is sent event by event instead of in batches. Consecutive pieces of the same kind on the same content block are merged together up to a byte budget, and any single event larger than the 61440-byte frame budget is dropped. Whether the zero interval is ever used in practice is set outside this code.
Details
- Merging covers text, tool-input JSON and thinking increments; for thinking, the token estimates are summed.
- The merge budget is the frame budget minus 4096 bytes.
- Dropped oversize events are recorded as
oversize_ephemeral_skipped.
Evidence
oversize_ephemeral_skipped
Strings lifted out of the shipped bundle, so the claim above can be checked against them.