The context window, and why bigger is not simply better

A larger context window removes the constraint of not fitting and introduces the constraint of relevance, because a model given a great deal of loosely related material attends less well to the part that mattered, so what you include matters more than how much you could.

A context window is how much a model can hold at once: your prompt, the conversation, whatever you pasted, and its own reply. They have grown enormously and the growth is genuinely useful.

What a bigger window genuinely fixes

Not having to choose. Whole files instead of excerpts, the entire conversation instead of a summary, the full document instead of the section you guessed was relevant. That is a real improvement and it removed a great deal of engineering that existed only to work around the limit.

What it does not fix

Relevance. A model given a hundred pages to find one fact in performs less reliably than one given the page that contained it, and the difference grows with the distance between the fact and the question. The limit moved from what fits to what competes for attention, which is a subtler problem and a less visible one.

Why this bites hardest with code

A whole repository technically fits now. But the model has no way to know which of two similar functions is the one your codebase actually calls, and giving it both makes that worse rather than better. Selection is still the work; the window growing has just made it optional to do it badly.

The stale-context problem nobody mentions

Anything you pasted is frozen at the moment you pasted it. A price, a balance, a file you have since edited: the model will reason confidently over the old version with no sense that it is out of date. A large window makes this worse, because more material means more of it is old.

Why a tool call beats a big paste

A tool fetches the current value at the moment it is needed and can say when it failed. A paste is a snapshot that cannot. For anything that changes, giving a model the ability to look is strictly better than giving it more to remember, and that is the argument for connecting a model to something live rather than filling its window.

Live, right now, on this page

MarketPriceFunding24h volume
BTC$78,492.50-0.0002%$483,871,545
ETH$2,416.950.0012%$278,636,031
SOL$101.530.0013%$76,202,922
HYPE$82.700.0013%$8,995,529

Read from a live market as this page rendered, through a public endpoint that needs no key. Read at 2026-09-03 13:07 UTC; accurate as of that time and not afterwards.

Describe something and watch it get built.

Open the builder, or start from a working app and change it.

Live market pages