Token

The smallest text unit a language model processes (often a word piece, not a full word).

A token is the unit text is split into before an LLM processes it. Tokens are often subword fragments rather than full words.

Token counts matter for cost, latency, and context-window limits. When people say “this prompt is long,” they usually mean “it has many tokens.”