Chatbots & language AI Dictionary

Token

A small piece of text, often part of a word, that language models read and write.

Models don’t see whole words; they see tokens. Pricing and context-window limits are measured in tokens. Roughly, 100 tokens is about 75 English words.

Example

“Unbelievable” might be split into “un”, “believ” and “able”.

Why it matters to you

It explains usage limits and why very long chats get cut off.

Topic Chatbots & language
Starts with T
Appears in
Tool page
All 46 terms
https://test2.motanutest.com/knowledge-base/ Every term is its own page, so it can rank on its own in search.