What
The request that /insights sends to the model now sets sendSideQueryBeta: true, alongside querySource: "insights". A side query is a separate, smaller model request made in the background, apart from the main conversation.
- The insights facet extraction side query sets
sendSideQueryBeta. - Another part of the code treats a request as eligible for some beta handling when its
querySourceis in a fixed list or whensendSideQueryBetais true. Insights requests now meet that condition. The members did not trace what that handling is. - Other call sites set the same option.
- The insights run now uses a new mechanism that tracks whether it is currently running.
Why
In practice, /insights requests may now be sent differently, for example with a beta header or along a different request path. A beta header is an extra label on a request that switches on features still being tested. If insights results or failures change after this release, this is a likely place to look.