Five Minutes Or Sixty
Your provider offers two cache lifetimes on the same 30,000-token prefix. A 5-minute write costs 1.25x the base input price, a 1-hour write costs 2x, and a read costs 0.1x either way.
Your traffic is a long tail of agents that come back at irregular intervals. You instrument both settings for a week:
| TTL | measured cache hit rate |
|---|---|
| 5 minutes | 55% |
| 1 hour | 97% |
Which setting is cheaper per request on the cached prefix, and by roughly how much?
Sign in to answer questions and track your progress
Sign In