Token

The smallest text unit a language model processes (often a word piece, not a full word).

A token is the unit text is split into before an LLM processes it in natural language processing (NLP). Tokens are often subword fragments rather than full words.

Token counts matter for cost, latency, and context-window limits. When people say “this prompt is long,” they usually mean “it has many tokens.”