You'll noticeTier: how much it should matter to you
2Useful: my rating, 1 to 5
3Signal: worth watching, 1 to 5
Prompt CacheArea: what it touches
ImprovementsKind: in v2.1.293,
ImprovementsSection of the release
Unclear It is not clear which other condition must also hold for this to apply.
What
The prompt cache keeps recent conversation text on the server so it does not have to be processed again. Overage, also called extra usage, is usage beyond what your plan includes. Two cache checks now look at whether the account is using overage (isUsingOverage).
The 1-hour cache lifetime for subscribers is now off when the account is using overage. This extra condition is added where a flag was already checked.
A step that touches the cache to keep it alive no longer runs while the account is using overage.
Why
If you are a subscriber working in overage, cached text may expire sooner than the 1-hour lifetime. More text may then be processed again, which could change what a session costs.
How sure we are
Something disagreesSomething we can check disagrees with this entry, or the writer said they could not settle it.
The writer flagged doubtIt is not clear which other condition must also hold for this to apply.
