Skip to content
DigitalNeuron

Modelos e investigación

Nuevos modelos frontera, benchmarks, métodos de entrenamiento y la investigación detrás.

2 artículos

What is a context window, and why does it run out?

A context window is the maximum amount of text, measured in tokens, that a model can consider in a single request. It holds the system instructions, the conversation so far, any documents you paste in, and the answer being generated. When the total exceeds the limit, something has to be dropped or summarised.

Actualizado 4 min de lectura