From Dev.to
Prompt caching explained: what a cache hit actually saves on your LLM bill
An agent loop sends the same long prefix on every call: the system prompt, the tool definitions, the reference documents pinned at the top, the conversation so far. On a long session that prefix can d...