Token
Definition
A unit into which AI models break information when processing input and generating output.
Put simply
AI doesn't process language exactly word by word. It breaks information into smaller pieces called tokens.
What boards and leaders should understand
Tokens sound technical, but they have two practical consequences.
First, they help determine how much information a model can process within its context window.
Second, AI services are frequently measured or priced partly according to token consumption.
A token is therefore both a technical unit and part of the emerging economics of AI use.
Questions to consider
- Where AI consumption is growing, do we understand what is driving token use and whether it is producing corresponding value?
