Skip to content
DigitalNeuron

Models & research

New frontier models, benchmarks, training methods and the research behind them.

2 articles

What is a context window, and why does it run out?

A context window is the maximum amount of text, measured in tokens, that a model can consider in a single request. It holds the system instructions, the conversation so far, any documents you paste in, and the answer being generated. When the total exceeds the limit, something has to be dropped or summarised.

Updated 4 min read