LLM API costs

Prompt Caching Explained: Slash Your LLM API Bills

The Verdict: Is Prompt Caching Worth It? TL;DR: Prompt caching stores the computed state of the stable start of your prompt. You pay a write fee to store it once, then a fraction of the normal input price on each hit. Anthropic bills a 5-minute cache write at 1.25 times the base input price and […]