What Context Window means
It's measured in tokens, roughly three-quarters of a word each. Everything the model considers has to fit: your question, any retrieved passages, and the answer being generated.
Windows have grown substantially, but they remain finite and retrieval systems budget them carefully.
Why it matters for AI search
This is why only a handful of sources get cited. The system can't pass fifty retrieved documents into a limited window, so it ranks candidates and passes the top few.
It also rewards concise, self-contained passages: a tight answer costs fewer tokens than a rambling one, so more sources fit alongside it.
See it in action
Budgeting a context window across retrieved sources.
The window, not the index, is why citations are scarce.
Concise self-contained passages cost fewer tokens, so more of them fit. That's a mechanical argument for tight writing rather than a stylistic one.
How to get it right
Writing for a limited window
- Keep answers tight — a 60-word answer costs a fraction of a 400-word build-up
- Front-load the substance so the useful part survives truncation
- Make each section self-contained so it can be passed alone
- Avoid repetition; it wastes budget without adding retrievable value
- State facts explicitly rather than requiring inference across paragraphs
Common questions
Do bigger context windows mean more citations?
Not proportionally. Systems budget conservatively for speed and cost, so the practical number of cited sources stays small even as windows grow.
Does page length affect citation odds?
Indirectly. Retrieval selects passages rather than pages, so a long page is fine if its sections are tight and self-contained.
What is a token exactly?
Roughly three-quarters of an English word. A 750-word passage is about 1,000 tokens.
Related concepts
These come up alongside Context Window constantly.