Context window
Also known as: token limit
Definition
The amount of text a language model can consider at once when generating a response, measured in tokens.
Why it matters
A larger context window lets a model read more of a page, a document, or a conversation history before answering, which affects how much nuance it can draw on from a single source.
Example
A model with a large context window could read an entire product page and FAQ section in one pass; one with a small window might only see a truncated excerpt.
Related terms
Concepts
Large language model (LLM)
A large language model is an AI system trained on very large amounts of text to predict and generate language.
Concepts
Retrieval augmented generation (RAG)
Retrieval augmented generation is a technique in which a system retrieves relevant documents and gives them to a language model to use when writing an answer.
Keep learning
What is Context window?
The amount of text a language model can consider at once when generating a response, measured in tokens.
Why does context window matter?
A larger context window lets a model read more of a page, a document, or a conversation history before answering, which affects how much nuance it can draw on from a single source.
See these terms measured on your brand.
Start with a first audit. We show where you appear, who is named instead, and what to fix first.