TLDRNew
What Are Cached Tokens?
Takeaway
Prompt caching reuses matching prompt tokens from recent requests at a lower cache-read price, so you can reduce input costs on repeated requests.
Prompt caching reuses matching prompt tokens from recent requests at a lower cache-read price, so you can reduce input costs on repeated requests.