GlossaryShared across all subject areas

Token

The unit of text a model processes, roughly a word fragment.

Why it matters

The unit of cost. Input, output and cached tokens are priced differently, which is why reporting a single total obscures the lever most worth pulling.