GlossaryShared across all subject areas

Prompt caching

Reusing the processed form of a repeated prompt prefix instead of paying to process it again.

Why it matters

Usually the largest single cost lever for tasks with a stable preamble — schema descriptions, policy text, tool definitions. It falls whenever prompts change, which creates a quiet incentive against improving them.