TLDRNew

What Are Cached Tokens?

Alex Garrett-SmithNov 133:04Agents and context
Takeaway

Prompt caching reuses matching prompt tokens from recent requests at a lower cache-read price, so you can reduce input costs on repeated requests.

Transcript

More TLDRs

All TLDRs