You'll noticeTier: how much it should matter to you
5Useful: my rating, 1 to 5
5Signal: worth watching, 1 to 5
Prompt CacheArea: what it touches
ImprovementsKind: in v2.1.286,
What probably matters to youSection of the release
Unclear It is not known whether cache keepalive is active for ordinary users.
What
The prompt cache lets the API reuse the start of a conversation instead of processing it again. A new module keeps a one-hour cache entry alive by sending a small request to /v1/messages/cache_touch at a regular interval.
It runs only for subscribers with a one-hour cache lifetime. It does not run in a cloud session, when using overage (usage beyond your plan), or when ANTHROPIC_UNIX_SOCKET is set.
The requests carry the header anthropic-cache-keepalive.
A new policy entry, allow_cache_keepalive, labelled "Renewing the prompt cache lifetime" (requirement HIPAA-R65), must also allow it. It is denied for hipaa organizations and is denied when the policy cannot be read.
Why
Keeping the cache alive could mean fewer cache misses after idle pauses in long sessions. Organizations under HIPAA rules will not get it. Nothing has been read about tengu_sequential_cloud, so whether keepalive is running is not known.
Read from
Names in the bundleallow_cache_keepalive
How sure we are
Something disagreesSomething we can check disagrees with this entry, or the writer said they could not settle it.
The writer flagged doubtIt is not known whether cache keepalive is active for ordinary users.